System Terminology.

## 1. Introduction

Markovian jump systems consists of two components; i.e., the state (differential equation) and the mode (Markov process). The Markovian jump system changes abruptly from one mode to another mode caused by some phenomenon such as environmental disturbances, changing subsystem interconnections and fast variations in the operating point of the system plant, etc. The switching between modes is governed by a Markov process with the discrete and finite state space. Over the past few decades, the Markovian jump systems have been extensively studied by many researchers; see (Kushner, 1967; Dynkin, 1965; Wonham, 1968; Feng et al., 1992; Souza & Fragoso, 1993; Boukas & Liu, 2001 ; Boukas & Yang, 1999; Rami & Ghaoui, 1995; Shi & Boukas, 1997; Benjelloun et al., 1997; Boukas et al., 2001 ; Dragan et al., 1999). This is due to the fact that jumping systems have been a subject of the great practical importance. For the past three decades, singularly perturbed systems have been intensively studied by many researchers; see (Dragan et al., 1999; Pan & Basar, 1993; Pan & Basar, 1994; Fridman, 2001; Shi & Dragan, 1999; Kokotovic et al., 1986).

Multiple time-scale dynamic systems also known as singularly perturbed systems normally occur due to the presence of small “parasitic” parameters, typically small time constants, masses, etc. In state space, such systems are commonly modelled using the mathematical framework of singular perturbations, with a small parameter, say ε, determining the degree of separation between the “slow” and “fast” modes of the system. However, it is necessary to note that it is possible to solve the singularly perturbed systems without separating between slow and fast mode subsystems. But the requirement is that the “parasitic” parameters must be large enough. In the case of having very small “parasitic” parameters which normally occur in the description of various physical phenomena, a popular approach adopted to handle these systems is based on the so-called reduction technique. According to this technique the fast variables are replaced by their steady states obtained with “frozen” slow variables and controls, and the slow dynamics is approximated by the corresponding reduced order system. This time-scale is asymptotic, that is, exact in the limit, as the ratio of the speeds of the slow versus the fast dynamics tends to zero.

In the last few years, the research on singularly perturbed systems in the H_{∞} sense has been highly recognized in control area due to the great practical importance. H_{∞} optimal control of singularly perturbed linear systems under either perfect state measurements or imperfect state measurements has been investigated via differential game theoretic approach. Although many researchers have studied the H_{∞} control design of linear singularly perturbed systems for many years, the H_{∞} control design of nonlinear singularly perturbed systems remains as an open research area. This is due to, in general, nonlinear singularly perturbed systems can not be decomposed into slow and fast subsystems.

Recently, a great amount of effort has been made on the design of fuzzy H_{∞} for a class of nonlinear systems which can be represented by a Takagi-Sugeno (TS) fuzzy model; see (Nguang & Shi, 2001; Han & Feng, 1998; Chen et al., 2000; Tanaka et al., 1996). Recent studies (Nguang & Shi, 2001; Han & Feng, 1998; Chen et al., 2000; Tanaka et al., 1996; Wang et al., 1996) show that a fuzzy model can be used to approximate global behaviors of a highly complex nonlinear system. In this fuzzy model, local dynamics in different state space regions are represented by local linear systems. The overall model of the system is obtained by “blending” of these linear models through nonlinear fuzzy membership functions. Unlike conventional modelling which uses a single model to describe the global behavior of a system, fuzzy modelling is essentially a multi-model approach in which simple submodels (linear models) are combined to describe the global behavior of the system. Employing the existing fuzzy results (Nguang & Shi, 2001; Han & Feng, 1998; Chen et al., 2000; Tanaka et al., 1996; Wang et al., 1996) on the singularly perturbed system, one ends up with a family of ill-conditioned linear matrix inequalities resulting from the interaction of slow and fast dynamic modes. In general, ill-conditioned linear matrix inequalities are very difficult to solve.

What we intend to do in this chapter is to design a robust H_{∞} fuzzy controller for a class of uncertain nonlinear two time-scale dynamic systems with Markovian jumps. First, we approximate this class of uncertain nonlinear two time-scale dynamic systems with Markovian jumps by a Takagi-Sugeno fuzzy model with Markovian jumps. Then based on an LMI approach, we develop a technique for designing a robust H_{∞} fuzzy controller such that the _{2}-gain of the mapping from the exogenous input noise to the regulated output is less than a prescribed value. To alleviate the ill-conditioned linear matrix inequalities resulting from the interaction of slow and fast dynamic modes, these ill-conditioned LMIs are decomposed into * ε*-independent LMIs and

*-dependent LMIs. The*ε

*-independent LMIs are not ill-conditioned and the*ε

*-dependent LMIs tend to zero when*ε

*approaches to zero. If*ε

*is sufficiently small, the original ill-conditioned LMIs are solvable if and only if the*ε

*-independent LMIs are solvable. The proposed approach does not involve the separation of states into slow and fast ones, and it can be applied not only to standard, but also to nonstandard singularly perturbed systems.*ε

This chapter is organized as follows. In Section 2, system descriptions and definition are presented. In Section 3, based on an LMI approach, we develop a technique for designing a robust H_{∞} fuzzy controller such that the _{2}-gain of the mapping from the exogenous input noise to the regulated output is less than a prescribed value for the system described in Section 2. The validity of this approach is demonstrated by an example from a literature in Section 4. Finally, conclusions are given in Section 5.

## 2. System Descriptions and Definitions

The class of uncertain nonlinear two time-scale dynamic systems with Markovian jumps under consideration is described by the following TS fuzzy model with Markovian jumps:

where * ϑ* is the number of fuzzy sets,

L

_{2}[0

*),*,∞

*= {1,2, , s} with transition probability matrix*S

where Δ * >* 0, and

For the convenience of notations, we let

and

where * ρ*(

*) such that the following inequality holds:*η

We recall the following definition.

* Definition 1:* Suppose

*is a given positive number. A system of the form (1) is said to have the*γ

L

_{2}-gain less than or equal to

*if*γ

where * T* and all

_{f}

*(*w

*)*t

∈ L

_{2}[0

*.*, T

_{f}]

Note that for the symmetric block matrices, we use (*) as an ellipsis for terms that are induced by symmetry.

## 3. Robust H_{∞} Fuzzy Control Design

This section provides the LMI-based solutions to the problem of designing a robust H_{∞} fuzzy controller that guarantees the _{2}-gain of the mapping from the exogenous input noise to the regulated output to be less than some prescribed value.

First, we consider the following * H∞* fuzzy state feedback which is inferred as the weighted average of the local models of the form:

Then, we describe the problem under our study as follows.

* Problem Formulation:* Given a prescribed H

_{∞}performance

*0, design a robust H*γ >

_{∞}fuzzy state-feedback controller of the form (6) such that the inequality (5) holds.

Before presenting our first main result, the following lemma is needed.

* Lemma 1:* Consider the system (1). Given a prescribed H

_{∞}performance

*0, for*γ >

*= 1*ι

*2*,

*, if there exist matrices*, , s

*(*δ

*) and matrices*ι

*(*Y

_{j}

*),*ι

*= 1*j

*2*,

*such that the following*, , r

*-dependent linear matrix inequalities hold:*ε

where

with

then the inequality (5) holds. Furthermore, a suitable choice of the fuzzy controller is

where

* Proof:* The closed-loop state space form of the fuzzy system model (1) with the controller (16) is given by

or in a more compact form

where

Consider a Lyapunov functional candidate as follows:

Note that * Q*(

_{ε}

*) is constant for each*ι

*For this choice, we have*ι.

*(0*V

, ι

_{0}

*) = 0 and*, ε

*(*V

*(*x

*)*t

*)*,ι,ε

*only when ||*→∞

*(*x

*)||*t

*.* → ∞

Now let consider the weak infinitesimal operator

Adding and subtracting

Now let us consider the following terms:

and

where

where

Substituting (27) into (24), we have

where

Using the fact

we can rewrite (28) as follows:

where

Pre and post multiplying (30) by

with

Note that (31) is the Schur complement of Ψ*
*(

_{ij}

*) defined in (10). Using (8)-(9), we learn that*ι, ε

Following from (29), (32) and (33), we know that

Applying the operator

From the Dynkin’s formula [2], it follows that

Substitute (36) into (35) yields

Using (34) and the fact that we have

Hence, the inequality (5) holds. This completes the proof of Lemma 1.

* Remark 1:* The linear matrix inequalities given in Lemma 1 becomes ill-conditioned when

*is sufficiently small, which is always the case for the uncertain nonlinear two time-scale dynamic systems. In general, these ill-conditioned linear matrix inequalities are very difficult to solve. Thus, to alleviate these ill-conditioned linear matrix inequalities, we have the following theorem which does not depend on*ε

*.*ε

Now we are in the position to present our first result.

* Theorem 1:* Consider the system (1). Given a prescribed H

_{∞}performance

*0, for*γ >

*= 1*ι

*2*,

*, if there exist matrices*, , s

*(*P

*), positive constants*ι

*(*δ

*) and matrices*ι

*(*Y

_{j}

*),*ι

*= 1*j

*2*,

*such that the following*, , r

*-independent linear matrix inequalities hold:*ε

where

with

then there exists a sufficiently small

where

* Proof:* Suppose there exists a matrix

*(*P

*) such that the inequality (38) holds, then*ι

*(*P

*) is of the following form:*ι

with

with

Substituting (50) and (52) into (51), we have

Clearly,

Using the matrix inversion lemma, we learn that

where

where the * ε*-independent linear matrix Ψ

*(*

_{ij}

*) is defined in (41) and the*ι

*-dependent linear matrix is*ε

with * ε*- dependent linear matrix tends to zero when

*approaches zero.*ε

Employing (38)-(40) and knowing the fact that for any given negative definite matrix * W*, there exists an

*0 such that*ε >

*+*W

*0, one can show that there exists a sufficiently small*εI <

## 4. Illustrative Example

Consider a modified series dc motor model based on (Mehta & Chiasson, 1998) as shown in Figure 1 which is governed by the following difference equations:

where* J* is the moment of inertia,

*is the torque/back emf constant,*K

_{m}

*is the viscous friction coefficient, and*D

Giving

where ε = L represents a small parasitic parameter. Assume that, the system is aggregated into 3 modes as shown in Table 1:

Mode | Moment of Inertia | J ( ) ± ∆ J ( )(kg· m ^{2} ) |

1 | Small | 0.0005 ± 10% |

2 | Normal | 0.005 ± 10% |

3 | Large | 0.05 ± 10% |

The transition probability matrix that relates the three operation modes is given as follows:

The parameters for the system are given as R = 10 Ω, L_{f} = 0.005 H, D = 0.05 N m/rad/s and K_{m} = 1 N m/A. Substituting the parameters into (58), we get

where * u(t)* is the controlled input and

*is the controlled output.*z(t)

The control objective is to control the state variable * x* for the range

_{2}(t)

*[*x

_{2}(t) ∈

*1*N

*2]. For the sake of simplicity, we will use as few rules as possible.*N

Note that Figure 2 shows the plot of the membership function represented by

Knowing that * x* [

_{2}(t) ∈

*1*N

*2], the nonlinear system*N

(59) can be approximated by the following TS fuzzy model

where μ_{i} is the normalized time-varying fuzzy weighting functions for each rule, * i* = 1, 2,

x(t)

and

with ||* F(x(t),ι,t)*|| ≤ 1. Then we have

In this simulation, we select * N* = −3 and

_{1}

*= 3. Using the LMI optimization algorithm and Theorem1 with*N

_{2}

*= 0.005,*ε

*= 1 and*γ

*(1) =*δ

*(2) =*δ

*(3) = 1, we obtain the results given in Figure 3, Figure 4 and Figure 5*δ

Remark 2: Employing results given in (Nguang & Shi, 2001; Han & Feng, 1998; Chen et al., 2000; Tanaka et al., 1996; Wang et al., 1996) and Matlab LMI solver [28], it is easy to realize that when * ε*< 0.005 for the state-feedback control design, LMIs become ill-conditioned and Matlab LMI solver yields an error message, “Rank Deficient”. However, the state-feedback fuzzy controller proposed in this paper guarantee that the inequality (5) holds for the system (59). Figure 3 shows the result of the changing between modes during the simulation with the initial mode at mode 1 and

*= 0.005. The disturbance input signal,*ε

*, which was used during simulation is given in Figure 4. The ratio of the regulated output energy to the disturbance input noise energy obtained by using the H*w(t)

_{∞}fuzzy controller is depicted in Figure 5. The ratio of the regulated output energy to the disturbance input noise energy tends to a constant value which is about 0.0094. So

*, for different values of*γ

*.*ε

The performance index γ | |

ε | State-feedback control design |

0.005 | 0.0970 |

0.10 | 0.4796 |

0.30 | 0.8660 |

0.40 | 0.9945 |

0.41 | > 1 |

## 5. Conclusion

This chapter has investigated the problem of designing a robust H_{∞} controller for a class of uncertain nonlinear two time-scale dynamic systems with Markovian jumps that guarantees the * L*- gain from an exogenous input to a regulated output to be less or equal to a prescribed value. First, we approximate this class of uncertain nonlinear two time-scale dynamic systems with Markovian jumps by a class of uncertain Takagi-Sugeno fuzzy models with Markovian jumps. Then, based on an LMI approach, sufficient conditions for the uncertain nonlinear two time-scale dynamic systems with Markovian jumps to have an H

_{2}

_{∞}performance are derived. The proposed approach does not involve the separation of states into slow and fast ones and it can be applied not only to standard, but also to nonstandard uncertain nonlinear two time-scale dynamic systems. An illustrative example is used to illustrate the effectiveness of the proposed design techniques.

## References

- 1.
Assawinchaichote W. Nguang S. K. 2002 Fuzzy control design for singularly perturbed nonlinear systems: An LMI approach, ICAIET,146 151 , Kota Kinabalu, Malaysia. - 2.
Assawinchaichote W. Nguang S. K. 2002 Fuzzy observer-based controller design for singularly perturbed nonlinear systems: An LMI approach, Proc. IEEE Conf. Decision and Contr.,2165 2170 , Las Vegas. - 3.
Benjelloun K. Boukas E. K. Costa O. L. V. 1997 H_{∞}control for linear time delay with Markovian jumping parameters, J. of Opt. Theory and App.,105 page (73-95). - 4.
Boukas E. K. Liu Z. K. 2001 Suboptimal design of regulators for jump linear system with timemultiplied quadratic cost, IEEE Tran. Automat. Contr.,46 page (944-949). - 5.
Boukas E. K. Yang H. 1999 Exponential stabilizability of stochastic systems with Markovian jump parameters, Automatica,35 page (1437-1441). - 6.
Boukas E. K. Liu Z. K. Liu G. X. 2001 Delay dependent robust stability and H_{∞}control of jump linear systems with time-delay,” Int. J. of Contr. - 7.
Boyd S. El Ghaoui L. Feron E. Balakrishnan V. 1994 Linear Matrix Inequalities in Systems and Control Theory,15 SIAM, Philadelphia. - 8.
Chen B. S. Tseng C. S. He Y. Y. 2000 Mixed H_{∈ }/H_{∞}fuzzy output feedback control design for nonlinear dynamic systems: An LMI approach, IEEE Trans. Fuzzy Syst.,8 page (249-265). - 9.
Dragan V. Shi P. Boukas E. K. 1999 Control of singularly perturbed system with Markovian jump parameters: An H∞ approach, Automatica,35 page (1369-1378),. - 10.
Dynkin E. B. 1965 Markov Process, Springer-Verlag, Berlin. - 11.
Farias D. P. Geromel J. C. Val J. B. R. Costa O. L. V. 2000 Output feedback control of Markov jump linear systems in continuous-time, IEEE Trans. Automat. Contr.,45 page (944-949). - 12.
Feng X. Loparo K. A. Ji Y. Chizeck H. J. 1992 Stochastic stability properties of jump linear system, IEEE Tran. Automat. Contr.,37 page (38-53). - 13.
Fridman E. 2001 State-feedback H_{∞}control of nonlinear singularly perturbed systems, Int. J. Robust Nonlinear Contr.,6 page (25-45). - 14.
Gahinet P. Nemirovski A. Laub A. J. Chilali M. 1995 LMI Control Toolbox- For Use with MATLAB, The MathWorks, Inc., MA. - 15.
Han Z. X. Feng G. 1998 State-feedback H∞ controller design of fuzzy dynamic system using LMI techniques, Fuzzy-IEEE’98, page (538-544). - 16.
Ikeda K. T. Wang H. O. 1996 Robust stabilization of a class of uncertain nonlinear systems via fuzzy control: Quadratic stability, H_{∞}control theory, and linear matrix inequality, IEEE Trans. Fuzzy. Syst.,4 page (1-13). - 17.
Kokotovic P. V. Khalil H. K. O’Reilly J. 1986 Singular Perturbation Methods in Control: Analysis and Design, Academic Press, London. - 18.
Kushner H. J. 1967 Stochastic Stability and Control, Academic Press, New York. - 19.
Mehta S. Chiasson J. 1998 Nonlinear control of a series dc motor: Theory and experiment, IEEE Trans. Ind. Electron.,45 page (134-141). - 20.
Nguang S. K. Shi P. 2001 H_{∞}fuzzy output feedback control design for nonlinear systems: An LMI approach, Proc. IEEE Conf. Decision and Contr., pages (4352-4357). - 21.
Nguang S. K. Shi P. 2003 H_{∞}fuzzy output feedback control design for nonlinear systems: An LMI approach, IEEE Trans. Fuzzy Syst.,11 page (331-340). - 22.
Nguang S. K. 1996 Robust nonlinear H_{∞}output feedback control, IEEE Trans Automat. Contr.,41 page (1003-1008). - 23.
Pan Z. Basar T. 1993 H_{∞}-optimal control for singularly perturbed systems Part I: Perfect state measurements, Automatica,29 page (401-423). - 24.
Pan Z. Basar T. 1994 H_{∞}-optimal control for singularly perturbed systems Part II: Imperfect state measurements, IEEE Trans. Automat. Contr.,39 page(280-299). - 25.
Rami M. A. El Ghaoui L. 1995 H_{∞}statefeedback control of jump linear systems, Proc.Conf. Decision and Contr., page (951-952), - 26.
Shi P. Boukas E. K. 1997 H_{∞}control for Markovian jumping linear system with parametric uncertainty, J. of Opt. Theory and App.,95 page numbers (75-99),. - 27.
Shi P. Dragan V. 1999 Asymptotic H_{∞}control of singularly perturbed system with parametric uncertainties, IEEE Trans. Automat. Contr.,44 page (1738-1742). - 28.
Souza C. E. Fragoso M. D. 1993 H_{∞}control for linear systems with Markovian jumping parameters, Control-Theory and Advanced Tech.,9 page (457-466). - 29.
Wang H. Tanaka O. K. Griffin M. F. 1996 An approach to fuzzy control of nonlinear systems: Stability and design issues, IEEE Trans. Fuzzy Syst.,4 1 page (14-23). - 30.
Wonham W. M. 1968 On a matrix Riccati equation of stochastic control, SIAM J. Contr.,6 page (681-697).