InTechOpen uses cookies to offer you the best online experience. By continuing to use our site, you agree to our Privacy Policy.

Computer and Information Science » "Multi-agent Systems", book edited by Jorge Rocha, ISBN 978-953-51-3536-4, Print ISBN 978-953-51-3535-7, Published: September 13, 2017 under CC BY 3.0 license. © The Author(s).

Chapter 5

Robust Adaptive Cooperative Control for Formation-Tracking Problem in a Network of Non-Affine Nonlinear Agents

By Muhammad Nasiruddin bin Mahyuddin and Ali Safaei
DOI: 10.5772/intechopen.69352

Article top


A diagram for kinematics of a nonholonomic planar wheeled robot.
Figure 1. A diagram for kinematics of a nonholonomic planar wheeled robot.
(Left) A diagram for the desired positions of four agents in a network; (right) the communication graph for a network of four agents and a leader.
Figure 2. (Left) A diagram for the desired positions of four agents in a network; (right) the communication graph for a network of four agents and a leader.
The reference trajectory (red) and position of agents in the desired formation (agent #1: blue, agent #2: green, agent #3: black and agent #4: yellow).
Figure 3. The reference trajectory (red) and position of agents in the desired formation (agent #1: blue, agent #2: green, agent #3: black and agent #4: yellow).
The reference trajectory and position of the centroid of the agents in the desired formation.
Figure 4. The reference trajectory and position of the centroid of the agents in the desired formation.
Translational and angular speed of agent #4.
Figure 5. Translational and angular speed of agent #4.
Observed data for control parameters of the leader at agent #4.
Figure 6. Observed data for control parameters of the leader at agent #4.
Adapted nonlinear terms at agent #4.
Figure 7. Adapted nonlinear terms at agent #4.

Robust Adaptive Cooperative Control for Formation-Tracking Problem in a Network of Non-Affine Nonlinear Agents

Muhammad Nasiruddin bin Mahyuddin and Ali Safaei
Show details


In this chapter, a decentralized cooperative control protocol is proposed with application to any network of agents with non-affine nonlinear multi-input-multi-output (MIMO) dynamics. Here, the main purpose of cooperative control protocol is to track a time-variant reference trajectory while maintaining a desired formation. The reference trajectory is defined to a leader, which has at least one information connection with one of the agents in the network. The design procedure includes a robust adaptive law for estimating the unknown nonlinear terms of each agent’s dynamics in a model-free format, that is, without the use of any regressors. Moreover, an observer is designed to have an approximation on the values of control parameters for the leader at the agents without connection to the leader. The entire design procedure is analysed successfully for the stability using Lyapunov stability theorem. Finally, the simulation results for the application of the proposed method on a network of nonholonomic wheeled mobile robots (WMR) are presented. Desirable leader-following tracking and geometric formation control performance have been successfully demonstrated through simulated group of wheeled mobile robots.

Keywords: cooperative protocol, formation control, decentralized control, robust adaptive law, distributed observer, mobile robot, non-affine nonlinear system

1. Introduction

Great attention has been paid to the problems of the multi-agent network ranging from consensus, collective behaviours of flocks and swarms, formation control of multi-robot systems, leader-following, algebraic connectivity of complex network, rendezvous, containment and so on [16]. The formation control problem is an interesting issue in biology, automatic control, robotics, artificial intelligence and so on, which requires each agent to move according to the prescribed trajectory. Various control strategies have been formulated to achieve the group control objectives.

The systems are usually in nonlinear form due to unpredictable environmental disturbances, unmodelled dynamics or other uncertainties. A class of nonlinear first-order multi-agent systems with external disturbances consensus problem was discussed in Ref. [7], whereas other works that involve second-order and higher order nonlinear multi-agent systems are reported in Refs. [8] and [9], respectively. Wang et al. [10] reported the design of distributed state/output feedback cooperative control approaches for uncertain multi-agents in undirected communication graphs. This is later extended to a condition of directed graphs containing a spanning tree [11]. To remedy the problem of a non-affine system for a general class, several reported works such as Ref. [12] employ a direct adaptive approach using an artificial neural network (ANN) to approximate an ideal controller. By employing a system transformation, a non-affine system can be transformed into an affine system as demonstrated in Ref. [11]. However, the transformation technique to convert a multi-agent non-affine system to a multi-agent affine system is still new and open to further studies which are to be discussed in this chapter.

Hou et al. [13] illustrate the method of dealing with non-affine multi-agent system by incorporating dynamic surface control or DSC but it is limited to a single-input-single-output (SISO) type of system, that is, with one control input. A similar approach is reported in Ref. [14] where the distributed dynamic surface design approach is used to design local consensus controllers using the transformation to convert the system to an affine strict-feedback multi-agent system. The work is also limited to a single control input per agent.

In this chapter, several novel contributions can be highlighted, that is, the introduction of transformation techniques from a non-affine multi-agent system to an affine multi-agent system for a network of generic nonlinear multi-input-multi-output (MIMO) systems, that is, a single agent may have more than one control input and more than one output. The second contribution to be highlighted in the chapter is the estimation of nonlinear terms in the dynamics without requiring the linear-in-parameter condition (LIP), that is, the dependence on any model regressor is elevated. The lumped nonlinear function existing in the model agent can be estimated online despite time-varying characteristics. This implies that the estimation is model free. By virtue of a sigma-modified adaptive law with projection algorithm that drives the estimation using the cooperative consensus error, the unknown nonlinear function can be reconstructed. The proposed cooperative control scheme requires a robust adaptive observer which can reconstruct the control signal from all agents to be used in the consensus formation control. Owing to the robustification term in the observer, the control signals can be estimated in finite time. The proposed robust adaptive formation control is to be exemplified in a form of simulation of multi nonholonomic mobile robots with differential drive configurations. They are commissioned to follow the leader trajectory while at the same time required to maintain predefined geometric formation guaranteeing safe inter-agent separation.

The chapter is organized into preliminaries, problem definition, design procedure of the proposed robust adaptive formation control algorithm, simulated results and lastly the conclusion of the chapter.

2. Preliminaries

2.1. Mean value theorem

Suppose that the function F is continuous on the closed interval [a,b] and differentiable on the open interval (a,b) (i.e. F is Lipschitz). Then, there is a point X0 in the open interval (a,b) at which [15]

F˙(X0)= F(b)F(a)ba

In physical terms, the mean value theorem says that the average velocity of a moving object during an interval of time is equal to the instantaneous velocity at some moment in the interval [15].

2.2. Kronecker product

The Kronecker product of matrices ARm×n and BRp×q is defined as [16]


which satisfies the following properties [16]


2.3. Schur complement lemma

For any constant symmetric matrix S=[S11S12S12TS22], the following statements are equivalent [17]

   S>0   S11>0 . S22S12TS111S12>0   S22>0 . S11S12S221S12T>0

2.4. Graph theory preliminaries

Consider a network consisting of N agents. Let G(V,E,A) be a graph with the set of N nodes V={ν1,ν2,, νN}, a set of edges E={eij}RN×N and associated adjacency matrix A=(aij)RN×N. An edge eij in G is a link between a pair of nodes (νj,νi), representing the flow of information from νj (as parent) to νi (as child). The eij is in existence if and only if aij>0. The graph is undirected, that is, the eij and eij in G are considered to be the same. We name νi and νj as neighbors if eijE . A path is defined as a sequence of connected edges in a graph. A graph is connected if there is a path between every pair of the nodes. The degree matrix DL=diag{d1,d2,… ,dN}RN×N, where each di is the input degree to each node, which is equal to the number of all edges through it (i.e. di=j=1:Naij). Hence, we can define Laplacian Matrix (L) as below [16, 18, 19]

Furthermore, we can define an adjacency matrix for the leader as follows

B=diag{b1,b2,… , bN}RN×N

where each bi indicates the existence of a communication link between the leader and each agent [16, 18, 19]. Besides, we would have,

3. Problem definition

Consider a network of N agents with general non-affine nonlinear dynamics for each of them. The problem is to design a set of decentralized control protocols for all agents to enhance a desired formation in the state space and also track a reference trajectory on state variables. Here, a virtual node is considered as the leader, which knows the desired trajectory and has at least one communication link with the agents in the network. It means that some agents are unaware about the leader states and also their control inputs. The whole problem in a general format can be considered as a platform for any possible state space in diverse applications.

For a MIMO system, one can define the following general nonlinear formulation


where n is the number of states for the system, t is the total number of nonlinear terms in the system (which tn), xiRn is the states vector, uiRm is the input (or control parameters) vector, m is the number of control parameters, hj for j=[1,n] is any linear combination on xi, Rj for j=[1,n] is any Lipschitz continuous nonlinear function on xi and fj for j=[1,n] is any Lipschitz continuous nonlinear function on both xi and ui. The last term defines the non-affine property of the system which represents the completely coupled inter-relation between states and control parameters. Each agent dynamic can be represented in matrix form as follows

X˙i=CXi+Ri+FiXi=[xi1,xi2,… ,xin]T C :constant matrixRi=[R1(xi),R2(xi),… ,Rt(xi)]T , tnFi=[F1(xi,ui),F2(xi,ui),… ,Fn(xi,ui)]T

where CRn×n is a constant matrix including the multipliers for each state. The elements of C define the dependence of each state’s derivative to the other states.

For a network of N of similar agents (or systems), dynamics for each agent i can be represented by Eq. (9). Also, the dynamic of the leader node can be proposed by this format. The difference is that the control parameters for the leader are defined with respect to a time-varying reference trajectory, that is


where hjfor j=[1,n] is any linear combination on the leader control parameters (i.e. reference trajectory u0). Actually, the reference trajectory is a set of inputs which provide certain dynamics in state space for the leader agent. The leader dynamics can be represented in the matrix form as the following:

X0=[x01,x02,,x0n]T , u0=[u01,u02,,u0m]TC & D :constant matrices

where DRn×m is a constant matrix including the multipliers for each control parameters.

Moreover, the desired formation among the agents in a network can be presented by a set of constant values F(RN×Rn), which determines the relative distance between agents in the state space.

The problem is to enhance F among the network agents and track the reference trajectory defined by (x0, u0) at the leader node with inter-agent communication topology defined by the communication graph.

4. Design procedure for robust adaptive cooperative control protocol

This section is dedicated to presenting the design process for cooperative control protocol, an observer to estimate the control parameters of the leader at each agent and a robust adaptive law to estimate the nonlinear terms at each agent. The design process is initiated by dealing with the non-affinity property of the agents.

4.1. Dealing with non-affinity property

Using the mean-value theorem presented in Section 1, for the nonlinear functions fj, which has a coupled terms of xi and ui, we have [19]

fj(xi,ui)u|u=u*=μ=fj(xi,ui)fj(xi,ui¯)uiu¯i , u¯i<u*<u

and without any loss of generality we can consider μ = 1 and u¯i is any constant value.


where qj(xi) is an unknown nonlinear function depending only on xi. As can be seen, the non-affine nonlinear function fj(xi,ui) is converted to an affine form. Now, the dynamics of each agent can be modified as



gj(xi)= Rj(xi)+qj(xi) , j[1,t] , tn

where gj(xi) is an unknown nonlinear function depending on xi, the matrix format for each agent dynamics can be presented as

X˙i=CXi+Dui+D1GiD & D1 :constant matricesGi=[g1(xi),g2(xi),,gt(xi)]T

where DRn×m is a constant matrix including the multipliers for each control parameter. Actually, the elements of D define the dependence of each state’s derivative to each control parameters. Moreover, D1Rn×t is a diagonal matrix defining the existence of nonlinear functions in the equation for derivative of each state. Elements of D1 can only be one or zero. It should be noted that since tn, we may have some states’ derivatives which do not include any nonlinear terms.

In the following subsections, the elements of Gi, which define the unknown nonlinear functions on each state’s derivative, would be estimated (adapted) online using consensus error of the network.

4.2. Cooperative protocol for formation and tracking problem

For a network of N agents with the dynamics described by Eq. (16), we can have a lumped formulation for the dynamics of all agents using the Kronecker product,

X˙=(INC)X+(IND)U+(IND1)GX=XNn×1=[X1,X2,, XN]T , U=UNm×1=[u1,u2,, uN]TG=GNt×1=[G1,G2,, GN]T , IN=diag{1,1,,1}RN×N

For this network, we can define the combined formation and tracking errors in a single formulation in relation to the neighbouring information available to each agent i via the communication graph [16]


where ΔRn×1 is the vector of desired values for states of agents and also the leader. We can consider ei as the consensus error for agent i. Hence


By changing the variables, we have


Trying to lump the consensus errors of all agents in an N-array format, we have

E=(HIn)Z(BZ0)1¯Z=ZNn×1=[Z1,Z2,, ZN]TIn=diag{1,1,,1}Rn×n ,1¯=[1,1, ,1]T  RN×1

Besides, considering Eq. (17), we can have an N-array form for dynamics of agents in the changed variables space


If the consensus errors of all agents converge to zero, then both formation and tracking objectives are reached, that is

limtE= 0¯

Here, the cooperative protocol U is designed using the Lyapunov stability theorem to ensure Eq. (23) is reached. Consider the following Lyapunov function



Considering Eq. (3), we have


Besides, using Eqs. (3) and (21), we have

(HIn)(INC)Z=(INC)E+ (BCZ0)1¯

Then, Eq. (25) leads to,


Forcing V˙<0 and referring to Eq. (11), we have

(INC)E+(BDu0)1¯+(HD)U+(HD1)G= PEP=PT>0 , PRNn×Nn


(HD)U= (P+(INC))E(BDu0)1¯(HD1)G 

Based on Lyapunov stability theorem, using URNm×1 in Eq. (30) as the cooperative control protocol will ensure that V˙<0 and that E reaches zero asymptotically. Hence, the objectives in formation problem and tracking problem have been accomplished. Expressing the control signal at agent level for agent i

Pi=P(k*,r*) , k*,r*=[((i1)×n+1):(i×n)] , Hij=H(i,j)

and then

HiiDui=(Pi+C)eibiDu0j=1NHijD1Gj j=1iNHijDuj 

Finally, the control parameter for agent i can be presented as the following

ui=1Hii(DTD)1DT((Pi+C)eibiDu0j=1NHijD1Gj j=1iNHijDuj )

Here, a pseudo-inverse method is employed on D.

There are two required conditions on achieving this goal, which are explained in the following assumptions.

Assumption 1. The communication graph should be undirected and connected. It means sufficient information can be available on agents.

Assumption 2. The dynamics of each agent should be completely controllable, that is D matrix should be full rank. It leads us to a state transformation in some applications.

Looking at the proposed cooperative control protocol in Eq. (33), there are two terms, which are not totally available to all agents:

  1. uj (fourth term in the prentices in Eq. (33)), which is the control parameter for the neighbouring agent at the current moment.

  2. Gj (third term in the prentices in Eq. (33)), which includes the unknown nonlinear terms for dynamics of neighbouring agents.

By reaching consensus on the states of agents, we can conclude that the control parameters of each agent has converged to the values of leader control parameters [20]

limt(uju0)= 0¯ , j[1,N]

Hence, the control parameters for the neighbouring agent (uj) are approximated by the control parameter of the leader, which in turn will be observed locally at each agent. It means that each agent has its own estimation on u0 and sends it to the neighbouring agents as its control parameter. The observed data will be transmitted to the neighbouring agents via communication graph to compute the control protocols.

The unknown nonlinear terms (Gj) also will be estimated using the consensus error of each agent. Similarly, the adapted data are shared with neighbouring agents through the communication graph.

4.3. Observer design for leader control parameters

Here, the objective is to have consensus on the value of u0 among the all agents in the network. For this objective, we can define the following consensus error for each agent

Δci= j=1Naij(T^iT^j)+bi(T^iu0) 

where T^iRm×1 is the observed vector at agent i for the leader control parameter, and again the aij and bi are the elements of adjacency matrix for the communication graph in the network. Eq. (35) can be represented in a lumped format as the following

Δc=(HIm)T^(Bu0)1¯Δc=ΔcNm×1=[Δc1,Δc2,, ΔcN]TT^=T^Nm×1=[T^1,T^2,, T^N]T

If the equation

limtΔc= 0¯

is satisfied, we can say that the observation objective is achieved. Considering the following Lyapunov function, we have



Since the summation of all elements in each row of the Laplacian matrix is zero, we can say that


and recalling Eq. (7), Eq. (39) can be written as following,


Considering T^˙=Δc+T^', we have


where since (HIm) is the positive definite recalling the Schur Complement Lemma, the first term is surely negative. To achieve V1˙<0, we should show that

V˙11= ΔcT(HIm)T^'ΔcT(Hu˙0)1¯0.

Recalling Eq. (3), we have


Hence, the Eq. (43) is,

V˙11=ΔcT(HIm)T^'ΔcT(HIm)(INu˙0)1¯V˙11 ΔcT(HIm)T^'+||ΔcT(HIm)|| (INU˙0M)1¯

where U˙0M is the upper band or maximum absolute value for u˙0. This value should be available beforehand. Now, we should only show that

ΔcT(HIm)T^'+||ΔcT(HIm)|| (INU˙0M)1¯=0


ΔcT(HIm)T^'=||ΔcT(HIm)|| (INU˙0M)1¯ΔcT(HIm)T^'=ΔcT(HIm) sign(ΔcT(HIm))(INU˙0M)1¯

where sign(ΔcT(HIm)) RNm×Nm is a diagonal matrix whose diagonal elements are the signs of each element in ΔcT(HIm)R1×Nm. Finally, since we have


the second term in T^˙=Δc+T^', is

T^'= sign(ΔcT(HIm))(INU˙0M)1¯

and recalling Eq. (36), the rate for the observed parameter is

T^˙=(HIm)T^+(Bu0)1¯  sign(ΔcT(HIm))(INU˙0M)1¯.

By using T^˙ from Eq. (50), we can have V1˙0, which in turn shows that the consensus error on observation (i.e. Δc) is stable in accordance to the Lyapunov stability theorem. It is obvious that the observed values for u0 (i.e. T^) at each agent are computed iteratively using the rate value proposed in Eq. (50).

The lumped format for rate of observer parameter in Eq. (50) can be presented for each agent as the following

T^˙i=Δci(r=1msign(yir)×u˙0Mr)yi=j=1NHijΔcj=[yi1,yi2,,yim] , U˙0M=[u˙0M1,u˙0M2,,u˙0Mm]

where Δci is defined as in Eq. (35).

4.4. Adaptive law design for unknown nonlinear terms in each agent dynamics

In this subsection, the objective is to estimate the values of unknown nonlinear terms in each agent dynamics (i.e. G in Eq. (30)). Since, there is not any data available on exact values of G, the estimation error for adaptation process is not available. Hence, the adaptation should be handled using the output error which in this problem is the consensus error (i.e. E in Eq. (21)).

Considering the consensus error in Eq. (21) and the agent dynamics according to Eq. (22), the derivative for consensus error is


where G here is the exact value for nonlinear terms. If we put the designed cooperative control protocol (from Eq. (30))

(HD)U= (P+(INC))E(BDu0)1¯(HD1)G^ 

with G^ is the adapted value for the unknown nonlinear terms, into Eq. (52), we have

E˙=PE+(HD1)G˜ , G˜=GG^ 

Using the following positive definite Lyapunov function


where ΓRNn×Nn is a positive definite matrix, we have


where the first term in the last equation is the negative definite. To show V2˙<0, we have




which in turn leads to this adaptive law

G^˙=G˜˙=+Γ(HTD1T)EΓ=diag{γ1,γ2,,γN} , γi=diag{γi1,γi2,,γit} , tn

Considering the Lyapunov stability theorem for the function in Eq. (55), if G^ is updated using the rate value proposed in Eq. (59) iteratively, G˜ converges to zeros asymptotically. It means that the adapted parameter G^ will converge to the actual value of the nonlinear terms in agent dynamics. One of the important issues of the proposed adaptive law in Eq. (59) is that it is not required to include any set of nonlinear basis functions as regressors in the adaptive law. It is only based on the consensus error of the network, which may have sufficient information to tune the adaptive parameter.

Since the adapted signals are always vulnerable for being distracted and diverged by unknown terms, two robusting methods are provided to make the designed adaptive law robust against the divergence [21].

  1. Parameter projection method

    G^˙={Γ(HTD1T)E ,    if G^TG^< M0TM0¯(IΓGGTGTΓG)Γ(HTD1T)E ,  otherwise
    M0¯=[M01¯,M02¯,,M0N¯]T , M0i¯=[M01,M02,,M0t]T , tn

    where M0i is chosen so that M0i|gi|. The value for M0 should be defined beforehand. The algorithm is named as parameter projection in the literature [21].

  2. σ-modification or leakage method;

    G^˙=+Γ((HTD1T)EρG^) , ρ>0R

Hence, the complete robust adaptive control for estimating the nonlinear terms in each agent’s dynamics is presented as the following

G^˙={Γ(HTD1T)EρΓG^ , if G^TG^< M0TM0¯(IΓGGTGTΓG)(Γ(HTD1T)EρΓG^) ,   otherwise
M0¯=[M01¯,M02¯,,M0N¯] , M0i¯=[M01,M02,,M0t] , tn 

The lumped format for the rate of adaptive parameter in Eq. (60) can be presented for agent i as the following

G^˙i={γi(j=1NQijejρG^i) , if G^iTG^i<M0TM0¯(InγiGiGiTGiTγiGi)γi(j=1NQijejρG^i), otherwise
Q=(HTD1T) , MRNt×NnQij=Q(k*,r*) , k*=[((i1)×t+1):(i×t)] , r*=[((j1)×n+1):(j×n)]

5. Application: wheeled mobile robot

In this section, application of the proposed cooperative control protocol on a team including three nonholonomic wheeled mobile robots (WMRs) is presented. The robots are moving on a smooth planar surface with a constraint on the speed (Figure 1). They can only move in the direction of their attitudes and speed in the perpendicular direction is zero. This is a nonholonomic constraint. Few number of researches can be found in literatures, which deal with the cooperative control of the multi-agent of WMRs taking account of each agent’s WMR dynamics [22, 23].


Figure 1.

A diagram for kinematics of a nonholonomic planar wheeled robot.

5.1. Problem definition

Here, the kinematics and dynamics for motion of ith WMR are considered as the following

x˙i=υicosθi , y˙i=υisinθi , θ˙i=ωiυ˙i=1mFi , ω˙i=1JTi

where xi and yi represent the position of a single WMR in the inertial coordinate system, θi is the orientation of the WMR, υi is the translational speed in the WMR’s pose direction and ωi is the angular speed of WMR about the Z axis. Also, m and J are the mass and moment of inertia for WMR. Moreover, Fi and Ti are the force and torque generated by the electric motors disclosed in each wheel of WMR. The last parameters are the control parameters for motion of each WMR. By transforming the kinematics of WMR to a local coordinate system fixed to the WMR, [24]


Then by considering xi4=υi and xi5=ωi, we have

x˙i1=xi4+xi5xi2 , x˙i2=xi5xi1x˙i3=xi5 , x˙i4=ui1 , x˙i5=ui2

where ui1=1mFi and ui2=1JTi . The state-space system can be represented in matrix form similar to Eq. (16), as the following

X˙i=CXi+Dui+D1GiXi=[xi1,xi2,xi3,xi4,xi5]T, ui=[ui1,ui2]T, Gi=[xi5xi2,xi5xi1]TC=[0001000000000000001000000] , D=[0000010001] , D1=[1001000000] 

As can be seen, D is not full rank. According to assumption 2, we need a change of variables to have D in the full-rank form. Recalling the idea of the back-stepping method [25] we have

δi1=υisi1 , δi2=ωisi2

Applying the back-stepping method

si3=ui1s˙i1 , si4=ui2s˙i2

we have

x˙i1=δi1+δi2xi2+si1+xi2si2x˙i2=δi2xi1xi1si2x˙i3=δi2+si2 , δ˙i1=si3 , δ˙i2=si4

Then, the state-space representation of a single WMR can be represented in following format

X¯˙i=C¯ X¯i+D¯ u¯i+D1¯ Gi¯X¯i=[xi1,xi2,xi3,δi1,δi2]T , u¯i=[si1,si2,si3,si4]TG¯i=[(δi2xi2+qi1(xi2)) ,(δi2xi1+qi2(xi1))]TC¯=C , D¯=[11000100000100010001] , D¯1=D1 

which has a full rank D¯ matrix. Hence, assumption 2 is satisfied and the proposed cooperative controller can be implemented. Hence, we have five state variables, four control parameters and two nonlinear terms for each WMR. At each agent within the network, the nonlinear terms will be adapted using Eq. (63) and the control parameters of the leader will be observed using Eq. (51).

Here, the desired formation is a rectangle with four agents and four equal edges. The length of each edge is equal and is r. The virtual leader is positioned at the centroid of the geometry (Figure 2). Moreover, the communication graph for this network is shown in Figure 2. The leader information is only available to agent 1. Hence, the adjacency matrices are defined as the following


Figure 2.

(Left) A diagram for the desired positions of four agents in a network; (right) the communication graph for a network of four agents and a leader.

A=[0100101000100110] , DL=[1000020000002001] , B=[1000000000000000]

There is a well-known reference trajectory for this problem in the literature [20], which is presented as the following,

x0=υrωrsinθ0 , y0=υrωrcosθ0 , θ0=ωrt

where υr and ωr can be any known time-varying functions. Usually, these functions are considered as constant values. In Eq. (73), t is time.

5.2. Simulation results

The simulation for the problem defined in Section 5.1 is performed by MATLAB/Simulink. The constant values for running the simulation are presented in Table 1.

Mass of each agent (M)1 kg
Inertia of each agent (J)1 kg/m2
Relative position of agents in the network (r)4 m
Reference velocity (υr)5 m/s2
Reference angular velocity (ωr)0.25 rad/s
The adaptation rates (γ1, γ2)0.01 & 0.1
The leakage factor (ρ)100
The maximum value for rate of u0 (U˙0M)ones (4,1)
The maximum value for adapted signal (M0¯)10 × ones (2, 1)

Table 1.

The constant parameters for simulation of a network of WMRs.

Moreover, the values of Pi as the gain values for cooperative control protocol at each agent (see Eq. (33)) are as follows

P1=diag{10,10,100,10,10}, P2=diag{10,10,12,10,10}P3=diag{10,10,30,10,10}, P4=diag{10,10,55,10,10}

The values in Pi are determined in a way to ensure that the whole matrix P is positive definite and the sufficient transient performance of the whole network is achieved.

The simulation results for this problem are presented in the following figures. The position of all agents in the X-Y plane is shown in Figure 3. The consensus on both reference trajectory and the desired formation can be seen. Actually, the desired formation is achieved gradually. In addition, the position of the centroid of all agents is compared with the reference trajectory in Figure 4. Moreover, the signals for translational and angular speeds of agent 4 are presented in Figure 5. Finally, the observed data for control parameters of the leader and also the adapted nonlinear terms at agent 4 are shown in Figures 6 and 7. Appropriate performance of proposed algorithms can be inferred by these figures.


Figure 3.

The reference trajectory (red) and position of agents in the desired formation (agent #1: blue, agent #2: green, agent #3: black and agent #4: yellow).


Figure 4.

The reference trajectory and position of the centroid of the agents in the desired formation.


Figure 5.

Translational and angular speed of agent #4.


Figure 6.

Observed data for control parameters of the leader at agent #4.


Figure 7.

Adapted nonlinear terms at agent #4.

6. Conclusion

This chapter is dedicated to the design procedure of a cooperative control protocol for any network consisting of agents with non-affine nonlinear dynamics and multi-input multi-output structure. The main goal is to satisfy a tracking problem for the whole network while maintaining a predefined formation topology in the state space of the agents’ dynamics. The proposed design procedure is including an adaptive law incorporated with a robustification method to estimate the unknown nonlinear terms in the agents’ dynamics. In addition, an observer is designed using the consensus-type error for estimating the leader’s control parameters at each agent. Since there are no complete information links between the leader and all agents, the observed control parameters of the leader are required at each agent to construct the cooperative control protocol. The entire design procedure is analysed successfully for the stability using Lyapunov stability theorem. The presented simulation results for a team of wheeled mobile robots show the appropriate performance of the proposed method.


This chapter is supported by the Fundamental Research Grant Scheme (FRGS) under Grant No. (FRGS-203/PELECT/6071290), awarded by Ministry of Education Malaysia. Besides, this chapter is under a USM-TWAS Postgraduate Fellowship.


1 - Mahyuddin MN, Herrmann G, Lewis FL. Finite-time adaptive distributed control for double-integrator leader-agent synchronization. In: 2012 IEEE International Symposium on Intelligent Control (ISIC); Dubrovnik, Croatia
2 - Mahyuddin MN, Herrmann G, Lewis FL. Distributed adaptive leader-following control for multi-agent multi-degree manipulators with finite-time guarantees. In: 52nd IEEE Conference on Decision and Control; Florence, Italy
3 - Wang Q, Wang Y, Zhang H. The formation control of multi-agent systems on a circle. IEEE/CAA Journal of Automatica Sinica. 2016;(99): pp. 1–7
4 - Fathian K, Rachinskii DI, Spong MW, Gans NR. Globally asymptotically stable distributed control for distance and bearing based multi-agent formations. In: 2016 American Control Conference (ACC); Boston, MA. 2016. pp. 4642–4648
5 - Han T, Zheng R, Lin Z, Fu M. A barycentric coordinate based approach to formation control of multi-agent systems under directed and switching topologies. In: 2015 54th IEEE Conference on Decision and Control (CDC); Osaka. 2015. pp. 6263–6268
6 - Yang Y, Dong Y, Jie D, Deming Y. Distributed control of uncertain nonlinear multi-agent systems in non-affine pure-feedback form using DSC technique. In: 2015 34th Chinese Control Conference (CCC); Hangzhou. 2015. pp. 7380–7385
7 - Das A, Lewis FL. Cooperative adaptive control for synchronization of second-order systems with unknown nonlinearities. International Journal of Robust and Nonlinear Control. 2011;21(13):1509–1524
8 - Zhang HW, Lewis FL. Adaptive cooperative tracking control of higher-order nonlinear systems with unknown dynamics. Automatica. 2012;48(7):1432–1439
9 - Peng ZH, Wang D, Sun G, Wang H. Distributed cooperative stabilisation of continuous time uncertain nonlinear multi-agent systems. International Journal of Systems Science. 2014;45(10):2031–2041
10 - Wang W, Wang D, Peng ZH. Cooperative fuzzy adaptive output feedback control for synchronisation of nonlinear multi-agent systems under directed graphs. International Journal of Systems Science. 2014:1–14. DOI: 10.1080/00207721.2014.886135 [ahead-of-print]
11 - Zhao Y, Chen G. Distributed adaptive tracking control of non-affine nonlinear multi-agent systems. In: 2016 Chinese Control and Decision Conference (CCDC); Yinchuan, China; 28-30 May 2016; pp. 1518–1523
12 - Meng WC, Yang QM, Jagannathan S, Sun YX. Adaptive neural control of high-order uncertain nonaffine systems: A transformation to affine systems approach. Automatica. 2014;50:1473–1480
13 - Hou ZG, Cheng L, Tan M. Decentralized robust adaptive control for the multi-agent system consensus problem using neural networks. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics. 2009;39(3):636–647
14 - Hovakimyan N, Calise AJ, Kim N. Adaptive output feedback control of a class of multi-input multi-output systems using neural networks. International Journal of Control. 2004;77(15):1318–1329
15 - Marsden J, Weinstein A. Calculus Unlimited. Menlo Park, CA: Benjamin/Cummings Publishing Company Inc.; 1981
16 - Li Z, Duan Z. Cooperative Control of Multi-Agent Systems. Boca Raton, FL: CRC Press, Taylor & Francis Group; 2015
17 - Boyd S, El Ghaoui L, Feron E, Balakrishnan V. Linear Matrix Inequalities in System and Control Theory. Philadelphia, PA: SIAM; 1994
18 - Lewis FL, Zhang H, Hengster-Movric K, Das A. Cooperative Control of Multi-Agent Systems. London: Springer-Verlag; 2014
19 - Wu L, Qin X, Zhang D. Cooperative adaptive fuzzy control for a class of uncertain non-linear multi-agent systems with time delays. Journal of Control and Decision. 2016;4(3): 131–152
20 - Dong W. Tracking control of multiple-wheeled mobile robots with limited information of a desired trajectory. IEEE Transactions on Robotics. 2012;28(1): 262–268
21 - Ioannou P, Fidan B. Adaptive Control Tutorial. Philadelphia: SIAM; 2006
22 - Peng Z, Yang S, Wen G, Rahmani A. Distributed consensus-based robust adaptive formation control for nonholonomic mobile robots with partial known dynamics. Mathematical Problems in Engineering. 2014;2014:Article ID 670497
23 - Koh KC, Cho HS. A smooth path tracking algorithm for wheeled mobile robots with dynamics constraints. Journal of Intelligent and Robotic Systems. 1999;24:367–385
24 - Fierro R, Lewis FL. Control of a nonholonomic mobile robot: Backstepping kinematics into dynamics. In: Proceedings of the IEEE 34th Conference on Decision & Control; New Orleans, LA., USA; 13-15 December 1995; pp. 3805-3810
25 - Khalil HK. Nonlinear Systems. 3rd ed. Prentice Hall, Inc.; New Jersey, USA; 2002