Open access peer-reviewed chapter

# Optimal Control of Fuzzy Systems with Application to Rigid Body Attitude Control

By Yonmook Park

Submitted: July 31st 2018Reviewed: October 22nd 2018Published: November 26th 2018

DOI: 10.5772/intechopen.82181

## Abstract

In this chapter, the author presents a theoretical result on the optimal control of nonlinear dynamic systems. In this theoretical result, the author presents the optimal control problem for nonlinear dynamic systems and shows that this problem can be solved by utilizing the dynamic programming approach and the inverse optimal approach. The author employs the dynamic programming approach to derive the Hamilton-Jacobi-Bellman (H-J-B) equation associated with the optimal control problem for nonlinear dynamic systems. Then, the author presents an analytic way to solve the H-J-B equation with the help of the inverse optimal approach. Based on the theoretical result presented in this chapter, the author establishes an optimal control design for TS-type fuzzy systems that guarantees the global asymptotic stability of an equilibrium point and the optimality with respect to a cost function and provides good convergence rates of state trajectories to an equilibrium point. The author considers the three-axis attitude stabilization problem of a rigid body to illustrate the optimal control design method for TS-type fuzzy systems. The author designs the optimal three-axis attitude stabilizing control law for a rigid body based on this optimal control design method and analyzes its control performance by numerical simulations.

### Keywords

• intelligent system design
• nonlinear optimal control
• fuzzy systems
• rigid body motion
• rigid body attitude control

## 1. Introduction

Since Lotfi Aliasker Zadeh introduced the fuzzy set  and the fuzzy logic , these two concepts have been successfully applied to various kinds of fields existing in the earth (e.g., see references in ), and the usefulness of these two concepts have also been verified in many industries.

Fuzzy logic is basically a multi-valued logic that allows intermediate values to be defined between conventional evaluations like yes or no, true or false, and big or small. The main characteristic of fuzzy concept is that it can handle some complicated phenomena of systems with the help of the fuzzy and linguistic modeling. Thus, it is possible to design knowledge-oriented intelligent systems if we use the fuzzy logic in the design of systems. This is a very important characteristic of fuzzy logic.

Most physical systems are almost nonlinear dynamic systems. Conventional control design approaches use different approximation methods such as linear, piecewise linear, and lookup table approximations to handle their nonlinearities. The linear approximation method linearizes a nonlinear dynamic system about a single equilibrium point and provides a linearized design-model for it. Then, the controller is designed for the linearized design-model to satisfy a given control objective. The linear approximation method is relatively simple, but it tends to limit control performance. In addition, the controller designed by the linear approximation method is valid only under the assumption that the states of a nonlinear dynamic system operate closely around the considered equilibrium point, which is the basic limitation of the control design by the linear approximation method . The piecewise linear approximation method requires the design of several linear controllers. Thus, it works better than the linear approximation method, although it is tedious to implement. The lookup table approximation method can improve control performance, but it is difficult to debug and tune. Moreover, in complex systems where multiple inputs exist, the lookup table approximation method may be very costly to implement because large memories are required to store a lookup table.

In many applications, the fuzzy control, based on the fuzzy logic, provides better control performance than linear, piecewise linear, or lookup table approximation methods because it provides an efficient framework to incorporate linguistic fuzzy information from human experts. The so-called intelligent control has emerged to use the expert information in the control community. Some tools for implementing the intelligent control can be referred to artificial neural network, genetic algorithm, and fuzzy logic. Note that the artificial neural network is a learning-based device whose design is motivated by the function of human brains and components thereof. And, the genetic algorithm is inspired by Charles Robert Darwin’s theory of evolution and works by creating many stochastic selection parameters to a problem. Usually, the expert information is represented by fuzzy terms like small, large, fast, and so on. Therefore, the fuzzy control is more adequate to implement the intelligent control with the expert information than the artificial neural network and the genetic algorithm.

Fuzzy controllers can perform the nonlinear control actions because fuzzy logic systems are capable of uniformly approximating any nonlinear function over a compact set to any degree of accuracy . Thus, if the parameters of a fuzzy controller are carefully chosen, it is possible to design a fuzzy controller for nonlinear dynamic systems. Then, it is well known that fuzzy controllers are robust with respect to disturbances of systems because their operations are determined by fuzzy rules. Also, fuzzy controllers are customizable because it is easy to understand and modify their rules.

As the behaviors of dynamic systems become complex, the need of fuzzy scheme increases, and the linguistic analysis suggested by Zadeh  allows us to analyze the qualitative behaviors of systems with the fuzzy algorithms. As motivated by the study of , Mamdani and Assilian  proposed the configuration of a fuzzy system with fuzzifier and defuzzifier, and they applied the fuzzy logic to the control of a dynamic plant, and the fuzzy control has attracted a great deal of interest among researchers. Note that fuzzy system is a name for the system which has a direct relationship with fuzzy concepts (e.g., fuzzy sets and linguistic variables) and fuzzy logic . Also, note that the function of fuzzifier is to map crisp points to fuzzy sets, and the function of defuzzifier is to map fuzzy sets to crisp points .

Subsequently, many successful applications of the fuzzy control have increased the need of theoretical analysis concerning the stability and performance of fuzzy control systems. Most of all, the stability of fuzzy control systems has often been required to be verified with theoretical arguments, and there have been several significant studies for designing the stabilizing controllers for fuzzy systems with rigorous stability proofs [8, 9, 10, 11, 12, 13, 14], in which the so-called TS-type fuzzy model proposed by Takagi and Sugeno  has mainly been used to represent fuzzy systems. Specifically, in [8, 9, 10, 11, 12, 13, 14], the authors made TS-type fuzzy models of dynamic systems with the IF-THEN fuzzy implication and fuzzy inference and designed the stabilizing control laws for TS-type fuzzy models. Then they applied the stabilizing control laws for TS-type fuzzy models to dynamic systems. In the fuzzy control design, the knowledge of an expert can be applied to the control design for dynamic systems by a linguistic expression such as the IF-THEN fuzzy implication.

Concerning the performance of fuzzy control systems, the optimality has often been considered as an important issue in the design of fuzzy control systems, and the conventional linear optimal control method  has been used to design the optimal control law for TS-type fuzzy systems. On the optimality issue of fuzzy control systems, Wang  developed the optimal fuzzy controller for linear time-invariant systems by utilizing the Pontryagin minimum principal. However, the design method of  does not have much practical implications because it may not be a good choice to use the fuzzy controller designed for linear systems directly as the controller for nonlinear fuzzy systems. Based on the linear quadratic optimal control theory , Wu and Lin  presented a design method of the optimal controllers for both continuous- and discrete-time fuzzy systems. The main strategy of  is to seek the optimal controller that minimizes a given performance index by solving the matrix Riccati differential equations or the steady-state algebraic Riccati equations. Later, Wu and Lin  addressed a quadratic optimal control problem for continuous-time fuzzy systems, which were represented by the so-called linear-like synthetic matrix form and developed a design scheme of the optimal fuzzy controller under finite or infinite horizon by utilizing the calculus-of-variation method. The study of  is also based on solving a steady-state algebraic Riccati-like equation, but it utilizes an efficient algorithm to design the global optimal fuzzy controller. Park et al.  addressed the optimal control problem for continuous-time TS-type fuzzy systems. However, the design method of  has less redundancy in choice of feedback gains and requires undesirable high feedback gains, which are the main drawbacks of  in the design of the optimal controller for fuzzy systems. Kim and Rhee  presented a response surface methodology, and they applied this methodology to the design of an optimal fuzzy controller for a plant. Wu and Lin  proposed a way to design a global optimal discrete-time fuzzy controller to control and stabilize a nonlinear discrete-time TS-type fuzzy system with finite or infinite horizon time. Chen and Liu  studied the problem of guaranteed cost control for TS-type fuzzy systems with a time-varying delayed state. Mirzaei et al.  proposed an optimized fuzzy controller for antilock braking systems to improve vehicle control during sudden braking. Lin, Wang, and Lee  investigated a geometric property of time-optimal control problem in the TS-type fuzzy model via Lie algebra and found the time-optimal controller as the bang-bang type with a finite number of switching by applying the maximum principle. Mostefai et al.  presented a fuzzy observer-based optimal control design for the compensation of nonlinear friction in a robot joint structure based on a fuzzy local modeling technique. Zhu  studied a fuzzy optimal control problem for a multistage fuzzy system to optimize the expected value of a fuzzy objective function subject to a multistage fuzzy system. Esfahani and Sichani  studied the problem of optimal fuzzy H-tracking control design for nonlinear systems that are represented by using the TS fuzzy modeling scheme. Through these studies, the optimal control for fuzzy systems has quite been progressed.

Since TS-type fuzzy systems essentially have a nonlinear nature due to the IF-THEN fuzzy implication and fuzzy inference, we see that a nonlinear optimal control method is suitable for designing an optimal control law for TS-type fuzzy systems. In addition, when we design an optimal control law for TS-type fuzzy systems, it is often required that the control design should allow us to control the convergence rates of state trajectories to an equilibrium point. The decay rate of the closed-loop dynamics may be used to achieve this requirement in the control design. These observations motivate the author to study an optimal control of TS-type fuzzy systems that can provide good convergence rates of state trajectories to an equilibrium point in this chapter.

More specifically, in this chapter, the author presents a theoretical result on the optimal control of nonlinear dynamic systems. In this theoretical result, the author presents the optimal control problem for nonlinear dynamic systems and solves this problem by utilizing the dynamic programming approach  and the inverse optimal approach . Note that Kalman  first proposed the inverse optimal approach to establish some gain and phase margins of a linear quadratic regulator. Also, note that the conventional direct optimal approach is based on seeking a stabilizing controller that minimizes a given performance index. On the other hand, the inverse optimal approach avoids the task of solving the Hamilton-Jacobi- Bellman (H-J-B) equation numerically but finds a stabilizing controller first and then shows its optimality with respect to a posteriorly determined performance index. In this chapter, the author employs the dynamic programming approach to derive the H-J-B equation associated with the optimal control problem for nonlinear dynamic systems. Then, the author presents an analytic way to solve the H-J-B equation with the help of the inverse optimal approach, by which the author establishes a systematic approach for designing the optimal controller for nonlinear dynamic systems. The resulting optimal controller takes the form of state feedback LgVcontroller and has a relaxed control gain structure.

Then, based on the theoretical result presented in this chapter, the author establishes an optimal control design for TS-type fuzzy systems that guarantees the global asymptotic stability of an equilibrium point and the optimality with respect to a cost function, which incorporates a penalty on the state and control input vectors, and provides good convergence rates of state trajectories to an equilibrium point. The problem appearing in this optimal control design for TS-type fuzzy systems is given as a linear matrix inequality (LMI)-based problem. From the results, the optimal controller can be found by a simple controller design procedure, which is essentially given as LMIs. The control design involving LMIs is particularly useful in practice because LMIs can be efficiently solved by recently developed interior-point methods (e.g., [32, 33]). One of the algorithms belonging to the interior-point methods can be found in , and an implementation of the algorithm in  is included in the LMI Control Toolbox of MATLAB , which will be used as the solver for the LMI-based problem appearing in the optimal control design.

Note that the optimal controller for a nonlinear dynamic system is in general designed for a linearized design-model, which is obtained by conventional linear approximation techniques, because it is sometimes difficult to solve the nonlinear optimal control problem associated with a nonlinear dynamic system. Clearly, the optimal controller designed for a linearized design-model guarantees its optimality only at an equilibrium point used to design a linearized design-model. Compared with a design-model obtained by conventional linear approximation techniques, the TS-type fuzzy model can be seen as a good design-model for approximating a nonlinear dynamic system because it retains the essential features of a nonlinear dynamic system with a linguistic description in terms of fuzzy IF-THEN rules, by which the TS-type fuzzy system is valid over a range of operating points within fuzzy sets. Thus, when we design the optimal controller for a nonlinear dynamic system, it is adequate to approximate a nonlinear dynamic system with a TS-type fuzzy model and to use a TS-type fuzzy model rather than a linearized design-model. In addition, one can expect that the optimal controller designed for a TS-type fuzzy system has a wider range of optimality than the optimal controller designed for a linearized design-model because the former guarantees the optimality over a range of operating points within fuzzy sets.

As a control design example in this chapter, the three-axis attitude stabilization problem of a rigid body is considered to illustrate the optimal control design method for TS-type fuzzy systems presented in this chapter. The attitude motion of a rigid body is basically represented by a set of two Equations : (i) Euler’s dynamic equation, which describes the time derivative of the angular velocity vector and (ii) the kinematic equation, which relates the time derivatives of the orientation angles to the angular velocity vector. For representing the orientation angles of a rigid body, there exist several kinematic parameterizations such as Euler angles, Gibbs vector, Cayley-Rodrigues parameters, and modified Rodrigues parameters [37, 38], which are singular three-dimensional parameter representations, and quaternion (also called Euler parameters), which is a nonsingular four-dimensional parameter representation. Note that three-dimensional parameter representations exhibit singular orientations because the Jacobian matrix is singular for some orientations. On the other hand, the quaternion consists of four parameters subject to the unit length constraint and is a globally nonsingular parameter for describing the body orientation .

In this chapter, the equations of motion of a rigid body including dynamics and kinematics are considered. The kinematic equation of a rigid body considered in this chapter is described by the quaternion. The equations of motion of a rigid body considered in this chapter describe a system in cascade interconnection, and the backstepping method of  can be efficiently utilized to apply the optimal control design method presented in this chapter to the three-axis attitude stabilization problem of a rigid body.

The optimal attitude stabilization problem of a rigid body has been addressed by several researchers [40, 41, 42]. Also, there have been many studies which consider performance indices such as time and/or fuel in the formulation of the optimal attitude stabilization problem of a rigid body [43, 44, 45, 46, 47, 48, 49], in which the optimal regulation problems for angular velocity subsystem of a rigid body and for some quadratic performance indexes have mainly been addressed.

The optimal attitude control problem of the complete attitude motion of a rigid body, which includes dynamics as well as kinematics, has been investigated by many researchers: Carrington and Junkins  used a polynomial expansion approach to approximate the solution of H-J-B equation. Rotea et al.  showed that Lyapunov functions including a logarithmic term in the kinematic parameters result in linear controllers with a finite quadratic performance index. For the general quadratic performance index, they also presented sufficient conditions which guarantee the existence of a linear and suboptimal stabilizing controller. Tsiotras  derived a new class of globally asymptotically stabilizing feedback control laws as well as a family of exponentially stabilizing optimal control laws for the complete attitude motion of a nonsymmetric rigid body. Later, Tsiotras  presented a partial solution to the optimal regulation problem of a spinning rigid body by using the natural decomposition of the complete attitude motion into its kinematics and dynamics systems and the inherent passivity properties of these two systems. Bharadwaj et al.  presented a couple of new globally stabilizing attitude control laws based on minimal and exponential coordinates. Park and Tahk  have considered the problem of three-axis robust attitude stabilization of a rigid body with inertia uncertainties, and they have presented a class of new robust attitude control laws having relaxed feedback gain structures. Later, Park and Tahk  have extended their robust attitude control scheme of  to the optimal attitude control scheme by using the Hamilton-Jacobi theory of . Also, Park et al.  have first addressed a game-theoretic approach to robust and optimal attitude stabilization of a rigid body with external disturbances.

Note that, in the case of robot arm control, since the arms or hand fingers can be viewed as actuators which maneuver the attitude of the held object, the results on the attitude control of a rigid body can be applied to the attitude control of a rigid payload held by the robot arm . With this relation, there have been many studies concerning the attitude control problem of a rigid body, and some remarkable studies can be referred to [60, 61].

The rest of this chapter is composed as follows. In Section 2, the author presents a theoretical result on the optimal control of nonlinear dynamic systems. In Section 3, the author introduces TS-type fuzzy systems and presents an optimal control design for TS-type fuzzy systems. In Section 4, the author considers the three-axis attitude stabilization problem of a rigid body as a control design example and illustrates the effectiveness of the optimal control design for TS-type fuzzy systems. In Section 5, the author concludes this chapter with concluding remarks.

## 2. Nonlinear optimal control

Consider the nonlinear dynamic system given by

ẋt=fxt+gxtut,E1

where f:RnRnand g:RnRn×pare smooth, vector- and matrix-valued functions, respectively, and f0=0.Moreover, xtRnand utRpare the state and control input vectors, respectively. Throughout this chapter, we use the definitions of

LfVxtVxtxtfxtand
LgVxtVxtxtgxt,where

V:RnRis a scalar function .

In general, we can find the optimal control law for the nonlinear dynamic system in (1) by numerically solving the corresponding Hamilton-Jacobi-Bellman (H-J-B) equation. However, this is a difficult task, and, thus, we may need a simple and efficient method to find optimal control law for the nonlinear dynamic system in (1). In the following, the author presents a theory to provide the optimal control law for the nonlinear dynamic system in (1) by circumventing the task of numerically solving the H-J-B equation.

Proposition 1: For the nonlinear dynamic system in (1), suppose that there exists a radially unbounded and positive definite function Vxtthat has continuous, first, partial derivatives with respect to xtand the feedback control ut=αR1LgVxtT,where α1is a constant and R=RT>0is a positive definite matrix, achieves global asymptotic stability of the equilibrium point xt=0for the system in (1) such that:

V̇xtut=αR1LgVxtT=LfVxtαLgVxtR1LgVxtT<0E2

for all xt0.Then, the control law

ut=2αR1LgVxtTE3

is the optimal, globally asymptotically stabilizing control law for the system in (1) that minimizes the cost function

P=0lxt+utTRutdt,E4

where lxtis given by

lxt=4α2LfVxtαLgVxtR1LgVxtT+4α2α1LgVxtR1LgVxtT>0E5

for all xt0and α1.

Proof:First, the following condition holds by (2):

V̇xtut=ut=LfVxt+12LgVxtut+12LgVxtut=V̇xtut=αR1LgVxtαLgVxtR1LgVxtT<αLgVxtR1LgVxtT<0E6

for all xt0and α1.Since Vxtis a radially unbounded and positive definite function, the condition in (6) guarantees that the control law utin (3) is a globally asymptotically stabilizing control law for the system in (1) by the Lyapunov’s stability theorem .

Next, define Wxt4α2Vxtand consider the following H-J-B equation associated with the optimal control problem for the system in (1):

minutlxt+utTRut+LfWxt+LgWxtut=0,W0=0.E7

Substituting utin (3) and lxtin (5) into the H-J-B equation in (7) yields

minut=utlxt+utTRut+LfWxt+LgWxtut=minut=utLfWxt+14αLgWxtR1LgWxtT+α14α2LgWxtR1LgWxtT+14α2LgWxtR1LgWxtT+LfWxt12αLgWxtR1LgWxtT=0,W0=0,E8

which implies that utin (3) and in (5) are solutions of the H-J-B equation in (7). In addition, by (2) and the property of R=RT>0,lxtin (5) satisfies lxt>0for all xt0and α1.This completes the proof.

In proposition 1, we see that the globally asymptotically stabilizing control law in (3) for the nonlinear dynamic system in (1) can be found without the task of numerically solving the H-J-B equation in (7) and the control law in (3) is optimal with respect to the cost function in (4). The key point of this work is that we posteriorly determine the penalty on the state vector, which is lxt,rather than we priorly choose it. Sepulcher, Janković, and Kokotović  proposed this approach which is referred to as the inverse optimal approach.

It is remarkable that as shown in (4, 5), we can adjust the penalty on the control input vector, which is R,and the penalty on the state vector, which is lxt,with the weight matrix R.Indeed, we can decrease the penalty on the control input vector and increase the penalty on the state vector with a weight matrix Rhaving small values. In this condition, we can obtain a cheap optimal control law requiring a large control effort, and this cheap optimal control law makes the nonlinear dynamic system in (1) stable within a short period of time. Note that the term “cheap” refers to the fact that the control effort is viewed as being cheap. On the other hand, we can increase the penalty on the control input vector and decrease the penalty on the state vector with a weight matrix Rhaving large values. In this condition, we can obtain an expensive optimal control law requiring a small control effort, and this expensive optimal control law makes the nonlinear dynamic system in (1) stable within a long period of time. Note that the term “expensive” refers to the fact that the control effort is viewed as being expensive.

As shown in (3), since the constant αof the optimal control law utin (3) plays the role of a feedback gain for uteven though the weight matrix Ris predetermined to impose the penalties on the control input and state vectors, it is also remarkable that the optimal control law utin (3) has a relaxed feedback gain structure.

Now, if we consider a practical application, we know that any control law for dynamic systems must provide good convergence rates of state trajectories to an equilibrium point. For achieving this requirement in the design of a control law, the decay rate can be used as a design factor to dominate convergence rates of state trajectories to an equilibrium point. Note that the decay rate of a system is defined to be the largest constant γ>0such that limteγtxt2=0holds for all trajectories of a system, where xt2denotes the Euclidean norm of xt.From the definition of decay rate, the convergence rate of the system trajectory to the equilibrium point can be controlled. Also, note that stability of dynamic systems corresponds to a positive decay rate. In the following, the author presents a theory about the decay rate.

Proposition 2 : If there exist a positive definite function Vxtand a constant β>0such that

V̇xt<2βVxtE9

for all trajectories of a system, then the decay rate of a system is at least β.

Proof:If there exist a positive definite function Vxtand a constant β>0such that V̇xt<2βVxtfor all trajectories of a system, then we obtain Vxt<Vx0e2βt.With a positive definite function VxtxtTX1xt,where X=XT>0is a positive definite matrix, Vxt<Vx0e2βtcan be represented by X12xt22<X12 eβtx022.Then, by Rayleigh-Ritz theorem , we can derive the following:

xt22X12xt22λminX1<X12 eβtx022λminX1X1222λminX1eβtx022=λmaxX1λminX1x022e2βt,

where λminX1and λmaxX1denote the minimum and maximum eigenvalues of X1,respectively. Thus, we obtain xt2<λmaxX1/λminX1x02eβt,and therefore the decay rate of the system is at least β.This completes the proof.

## 3. Optimal control of fuzzy systems

### 3.1. Fuzzy systems

The TS-type fuzzy model and the TS-type fuzzy control law for a system are given by the following IF-THEN fuzzy implications, respectively :

• Plant rule i for a system:

IF x1tis Mi1and · · · and xntis Min,THEN

ẋt=Aixt+Biut,i=1,,r.E10
• Control law rule i for a system:

IF x1tis Mi1and · · · and xntis Min,THEN

ut=Kixt,i=1,,r.E11

In (10, 11), xit,i=1,,nand Mij,i=1,,r,j=1,,nare state variables and fuzzy sets, respectively, and ris the number of IF-THEN rules. Moreover, AiRn×n,BiRn×p,and KiRp×n.

If we follow the usual fuzzy inference method, we can represent the state equations of the TS-type fuzzy model and the TS-type fuzzy control law for a system as follows, respectively :

ẋt=i=1rhixtAixt+i=1rhixtBiutE12

and

ut=i=1rhixtKixt,E13

where hi,i=1,,rare the normalized weight functions given by

hixtj=1nMijxjti=1rMijxjt,i=1,,rE14

and Mijxjtdenotes the grade of membership of xjtin the fuzzy set Mij.Here,hi,i=1,,rin (14) satisfy hixt0,i=1,,rand i=1rhixt=1for all xtRn.

### 3.2. Problem definition

The author defines two kinds of problems considered in this section. The first problem is to design a control law for the TS-type fuzzy system in (12) that achieves the global asymptotic stability of the equilibrium point xt=0and minimizes the cost function

P=0lxt+utTRutdt,

where lxt>0for all xt0and R=RT>0is a positive definite matrix. The second problem is that the decay rate of the closed-loop dynamics for the TS-type fuzzy system in (12) should be at least β, where β>0is a constant.

### 3.3. Optimal control design

We can use the results of propositions 1 and 2 to solve the problems defined in Section 3.2. Specifically, we define fxti=1rhixtAixtand gxti=1rhixtBifor the TS-type fuzzy system in (12). Then, if there exists a radially unbounded and positive definite function Vxtsuch that the conditions in (2) and (9) hold, then an optimal control law in the form of (3) for the TS-type fuzzy system in (12) can be found. Thus, we have to construct Vxtwhose time derivative satisfies the conditions in (2, 9). The author uses a quadratic Lyapunov function Vxt=xtTX1xt,where X=XT>0is a positive definite matrix, as the candidate of such a Vxt, and presents the following theory:

Theorem 1 : For the TS-type fuzzy system in (12), suppose that there exists a function Vxt=xtTX1xtwith XRn×nsuch that

X=XT>0,E15
AiX+XAiT4αBiR1BiT<0,i=1,,r,12AiX+XAiT+AjX+XAjT2αBiR1BjT+BjR1BiT<0,1i<jr,E16

and

AiX+XAiT8αBiR1BiT+2βX<0,i=1,,r,12AiX+XAiT+AjX+XAjT4αBiR1BjT+BjR1BiT+2βX<0,1i<jr,E17

where R=RT>0is a positive definite matrix and α1and β>0are constants. Then the control law

ut=i=1rhixtKixt,E18

where Ki4αR1BiTX1,i=1,,ris the optimal, globally asymptotically stabilizing control law for the TS-type fuzzy system in (12) that minimizes the cost function

P=0lxt+utTRutdt,E19

where lxtis given by

lxt=4α2xtTi=1rhi2xtGiiTX1+X1Gii+ 2i<jrhixthjxtGij+Gji2TX1+X1Gij+Gji2xt+ 4α2α1xtT4i=1r j=1rhixthjxtX1BiR1BjTX1xt>0E20

for all xt0and α1,where GijAi2αBiR1BjTX1,and the decay rate of the closed-loop dynamics for the TS-type fuzzy system in (12) with the control law utin (18) is at least β,where β>0is a constant.

Proof:Suppose that Vxt=xtTX1xt,where X=XT>0is a positive definite matrix. Then, from proposition 1, the control law utin (3) with gxti=1rhixtBiand Vxt=xtTX1xtbecomes

ut=2αR1LgVxtT=2αR12xtTX1i=1rhixtBiT=i=1rhixt4αR1BiTX1xti=1rhixtKixt,E21

where Ki4αR1BiTX1,i=1,,rand α1is a constant.

Now, from propositions 1 and 2, assume that there exists a positive definite matrix X=XT>0such that

V̇xtut=12 ut=LfVxt+12LgVxtut=xtTi=1rhixt2GiiTX1+X1Gii+ 2i<jrhixthjxtGij+Gji2TX1+X1Gij+Gji2xt<0E22

for all xt0,where GijAi12Bi4αR1BjTX1=Ai12BiKj,and

V̇xtut=ut=LfVxt+LgVxtut=xtTi=1rhi2xtQiiTX1+X1Qii+ 2i<jrhixthjxtQij+Qji2TX1+X1Qij+Qji2xt<2βxtTX1xtE23

for all xt,where QijAiBi4αR1BjTX1=AiBiKjand β>0is a constant. Since the normalized weight functions hi,i=1,,rin (22) and (23) satisfy hixthjxt0,i=1,,r,j=1,,rand i=1rj=1rhixthjxt=1(i.e., i=1rj=1rhixthjxt=i=1rhi2xt+2i<jrhixthjxt=1) for all xtRn,sufficient conditions for satisfying (22) and (23) are

GiiTX1+X1Gii<0,i=1,,r,Gij+Gji2TX1+X1Gij+Gji2<0,1i<jrE24

and

QiiTX1+X1Qii+2βX1<0,i=1,,r,Qij+Qji2TX1+X1Qij+Qji2+2βX1<0,1i<jr,E25

respectively. If all sets of inequalities in (24, 25) are pre- and post-multiplied by a positive definite matrix X=XT>0,then we can transform the nonlinear conditions in (24, 25) into the linear conditions in (16, 17), respectively. Thus, by the results of propositions 1 and 2, we see that the control law utin (21) with a positive definite matrix X=XT>0satisfying the conditions in (16, 17) becomes the optimal, globally asymptotically stabilizing control law for the TS-type fuzzy system in (12) that minimizes the cost function in (19), where lxtin (20) comes from (5) and satisfies lxt>0for all xt0and α1by (22) and the property of R=RT>0,and the decay rate of the closed-loop dynamics for the TS-type fuzzy system in (12) with the control law utin (21) becomes at least β>0.This completes the proof.

Now, consider the TS-type fuzzy system with a common input matrix, which is described by

ẋt=i=1rhixtAixt+But.E26

Then, the author presents the following theory:

Theorem 2 : For the TS-type fuzzy system in (26), suppose that there exists a function Vxt=xtTX1xtwith XRn×nsuch that

X=XT>0,E27
AiX+XAiT4αBR1BT<0,i=1,,r,E28

and

AiX+XAiT8αBR1BT+2βX<0,i=1,,r,E29

where R=RT>0is a positive definite matrix and α1and β>0are constants. Then the control law:

ut=Kxt,E30

where K4αR1BTX1is the optimal, globally asymptotically stabilizing control law for the TS-type fuzzy system in (26) that minimizes the cost function

P=0lxt+utTRutdt,E31

where lxtis given by

lxt=4α2xtTi=1rhixtAiTX1+X1Ai4αX1BR1BTX1xt+4α2α1xtT4X1BR1BTX1xt>0E32

for all xt0and α1,and the decay rate of the closed-loop dynamics for the TS-type fuzzy system in (26) with the control law utin (30) is at least β,where β>0is a constant.

Proof:Suppose that Vxt=xtTX1xt,where X=XT>0is a positive definite matrix. Then, from proposition 1, the control law utin (3) with gxtBand Vxt=xtTX1xtbecomes

ut=2αR1LgVxtT=2αR12xtTX1BT=4αR1BTX1xtKxt,E33

where K4αR1BTX1and α1is a constant.

Now, from propositions 1 and 2, assume that there exists a positive definite matrix X=XT>0such that

V̇xtut=12 ut=LfVxt+12LgVxtut=xtTi=1rhixtAiTX1+X1Ai4αX1BR1BTX1xt<0E34

for all xt0and

V̇xtut=ut=LfVxt+LgVxtut=xtTi=1rhixtAiTX1+X1Ai8αX1BR1BTX1xt<2βxtTX1xtE35

for all xt,where β>0is a constant. Since the normalized weight functions hi,i=1,,rin (34, 35) satisfy hixt0,i=1,,rand i=1rhixt=1for all xtRn,sufficient conditions for satisfying (34, 35) are

AiTX1+X1Ai4αX1BR1BTX1<0,i=1,,rE36

and

AiTX1+X1Ai8αX1BR1BTX1+2βX1<0,i=1,,r,E37

respectively. If all sets of inequalities in (36, 37) are pre- and post-multiplied by a positive definite matrix X=XT>0,then we can transform the nonlinear conditions in (36, 37) into the linear conditions in (28, 29), respectively. Therefore, by the results of propositions 1 and 2, we see that the control law utin (33) with a positive definite matrix X=XT>0satisfying the conditions in (28, 29) becomes the optimal, globally asymptotically stabilizing control law for the TS-type fuzzy system in (26) that minimizes the cost function in (31), where lxtin (32) comes from (5) and satisfies lxt>0for all xt0and α1by (34) and the property of R=RT>0,and the decay rate of the closed-loop dynamics for the TS-type fuzzy system in (26) with the control law utin (33) becomes at least β>0.This completes the proof.

Note that the problem appearing in Theorems 1 and 2 is to find a matrix XRn×nsubject to some linear constraints in the form of linear matrix inequality (LMI). Therefore, this problem is an LMI-based problem , and we can efficiently solve the LMI-based problem by the LMI Control Toolbox of MATLAB . In this chapter, the author uses the LMI Control Toolbox of MATLAB  as the solver for the LMI-based problem in the optimal control design.

## 4. A control design example

As a control design example, the author considers the three-axis attitude stabilization problem of a rigid body and illustrates the effectiveness of the optimal control design for TS-type fuzzy systems presented in Section 3.

### 4.1. Rigid body model

First, the dynamic equation of the rotational motion of a rigid body is described as follows :

ω̇t=J1Ωωtt+J1ut,E38

where ωt=ω1tω2tω3tTR3is the angular velocity vector of the body in the body-fixed frame, ut=u1tu2tu3tTR3is the control torque vector of the body, and JR3×3is the inertia matrix of the body and satisfies J=JT>0.And ΩωtR3×3denotes a skew-symmetric matrix defined by

Ωωt0ω3tω2tω3t0ω1tω2tω1t0

and has the property of

ΩωtTωt0,ωtR3.E39

Second, the kinematic equation of rotational motion of a rigid body described in terms of the quaternion is given as follows :

q̇t=12Fqtωt,E40

where qt=q1tq2tq3tq4tTq1tqvtTTR4is the quaternion and Fqt:R4R4×3denotes the kinematics Jacobian matrix defined as

FqtqvtTq1tI3×3+ΩqvtT,E41

where I3×3denotes the 3×3identity matrix.

With the notations of the Euler axis êR3and Euler angle ϕR, we define the quaternion by q1tcosϕ/2and qvtêsinϕ/2.The quaternion qtis subject to the unit length constraint of qt2=1for all t0and is a kinematic parameter set that can represent the orientation of a body and . From the definition of the quaternion, we see that q1tsatisfies q1t0for all πradϕπrad,which describes all eigenaxis rotations . Thus, we can write q1tas q1t=1qvt22for all πradϕπrad..

### 4.2. Optimal control design

First, it is observed that two state equations given by (38) and (41) represent a system in cascade interconnection. That is, the angular velocity vector indirectly controls the kinematics system in (41). Thus, the angular velocity vector can be regarded as a virtual control input of the kinematics system in (41) to stabilize the kinematics system in (41). This observation gives the following theorem: Theorem 3 : Consider the kinematics system in (41) with ωtto be the control input, and let the control law for the kinematics system in (41) be

ωvt=k1qvt,E42

where k1>0is a constant. Then, ωvtin (43) is the global asymptotic stabilizing control law for the kinematics system in (41).

Proof:With the control law ωvtin (43), the closed-loop system of the kinematics system in (41) becomes

q̇t=12k1Fqtqvt=12k1qvtq1tI3×3+ΩqvtTqvt.E43

Now, consider the Lyapunov function candidate Vqt=q1t12+qvt22. Taking the time derivative of Vqtalong a nonzero trajectory of the closed-loop system in (44) and using the property of Ωqvtqvt0for all qvtR3,then the following condition holds:

V̇qt=2q1t1q̇1t+2qvtTq̇vt=2q1t12k1qvtTqvt212k1qvtTqvt+2qvtT12k1q1tqvt+12k1Ωqvtqvt=k1qvtTqvt<0

for all qvt0and all k1>0.Then, global asymptotic stability of the closed-loop dynamics in (44) follows from the Barbashin-Krasovskii theorem . This completes the proof.

Next, we have to stabilize the dynamics system in (38) with making ωtin (38) follow ωvtin (43), and this is a backstepping problem . For solving this problem, the author defines the new variable δtas δtωtωvt=ωt+k1qvt.For convenience of notation, the author defines x1tδ1t,x2tδ2t,x3tδ3t,x4tq2t,x5tq3t,x6tq4t,xδtx1tx2tx3tT,and xqvtx4tx5tx6tT.Then, with xtxδtTxqvtTTand q1t=1xqvt22for all πradϕπrad,the author represents the state equation for xtby

ẋt=Axtxt+But,E44

where AxtR6×6and BR6×3are defined in (46) and (47), respectively. In (47), 03×3denotes the 3×3zero matrix:

Axt{J1Ωxδtk1xqvtJ+12k1ΩxqvtT+12k11xqvt22I3×3,{k1 J1Ωxδtk1xqvtJ12k12ΩxqvtT12k121xqvt22I3×312ΩxqvtT+12k11xqvt22I3×3,12k1ΩxqvtT12k11xqvt22I3×3.E45
BJ103×3.E46

As a numerical example, the author assumes that

J=diag101520kgm2,E47

where diag means the diagonal matrix, k1=0.2,and xδi,xqvi0.50.5,i=1,,3.If we do sampling Axtin (46) at nine operating points of xδixqvi=00,00.5,00.5,0.250,0.250.5,0.250,0.250.5,0.50.5,0.50.5,i=1,,3with the given k1=0.2and Jin (48), we can obtain the following TS-type fuzzy model for the system in (38):

• Plant rule i for the system in(45):

IF x1tis Mi1and · · · and x6tis Mi6,THEN

ẋt=Aixt+But,i=1,,9.E48

In (49), xtR6is the state vector, utR3is the control input vector, Mij,i=1,,9,j=1,,6are the fuzzy sets defined as in Figures 1 and 2, Ai,i=1,,9are obtained by sampling Axtin (46) at the given nine operating-points, and Bis given in (47). With the normalized weight functions hi,i=1,,9defined by

hixtj=16Mijxjti=19j=16Mijxjt,i=1,,9,

the TS-type fuzzy model in (49) can be transformed into the following TS-type fuzzy system:

ẋt=i=19hixtAixt+But.E49 Figure 1.Fuzzy setsMij,i=1,⋯,9,j=1,⋯,3used to design TS-type fuzzy model in(49)for system in(45). Figure 2.Fuzzy setsMij,i=1,⋯,9,j=4,⋯,6used to design TS-type fuzzy model in(49)for system in(45).

We can use the result of theorem 2 to design the optimal control law for the TS-type fuzzy system in (50) because the TS-type fuzzy system in (50) has the common input matrix B in (47). Then, we assume that α=2,β=0.1,and R=I3×3in (28) and (29). With these values, the authors solve the LMIs in (27), (28), and (29) by using the command of “feasp” provided by the LMI Control Toolbox of MATLAB . From the result, we obtain the following optimal control law for the TS-type fuzzy system in (43) that minimizes the cost function in (31):

uat=Kaxt,E50

where

Ka=110.062924.531847.246973.079828.612737.764916.3545139.984660.320117.002575.001139.450623.623545.2400185.67035.692318.664292.8441.

Since we can analyze the pure effect of the weight matrix Ron the control performance without any constraint, the author designs two other optimal control laws for the TS-type fuzzy system in (50) without considering the decay rate constraint, which is given by (29), to clearly analyze the influence of the weight matrix Rin (31) on the control performance. The author designs one by solving (27) and (28) for the TS-type fuzzy system in (50) with α=2and R=I3×3, and one is given by

ubt=Kbxt,E51

where

Kb=28.07082.50991.97443.58990.37470.14201.673333.79364.97271.34561.75200.35180.98723.729542.83191.47131.32020.2517.

The author designs the other by solving (27) and (28) for the TS-type fuzzy system in (50) with α=2and R=3×I3×3, and the other is given by

uct=Kcxt,E52

where

Kc=29.179818.427018.98740.68540.23221.505312.284640.016918.19002.35471.76621.30499.493713.642549.34112.49690.97704.9648.

### 4.3. Numerical simulation results

As the numerical simulation model, the author uses the equations of rotational motion of a rigid body given by (38) and (41), where the inertia matrix is given by (48). The author assumes that the initial conditions at the initial time t0=0sec for the Euler axis êand the Euler angle ϕare êt0=0.48960.20300.8480Tand ϕt0=2.4648rad, respectively, which give qt0=0.33200.46180.19150.7999T.Note that the given ϕt0represents an almost upside-down initial orientation of a rigid body. Also, the author assumes a rest-to-rest maneuver of a rigid body, and, thus, the author assumes that the initial condition for the angular velocity vector is ωt0=000Trad/sec.

With the optimal control laws uatof (51), ubtof (52), and uctof (53), the author illustrates the influences of the decay rate βin (29) and the weight matrix Rin (31) on the control performance. Then, in Figures 35, the author shows the numerical simulation results for a rigid body with each control law uat,ubt,and uct.In Figures 35, the red-solid, green-dashed, and blue-dotted lines represent the state trajectories of a rigid body with uat,ubt,and uct,respectively. Figure 3.Angular velocity responses of the rigid body given by(38)and(41)with control lawsuatof(51),ubtof(52), anductof (53) designed in this chapter at initial conditionsωt0=000Trad/sec andqt0=0.33200.46180.19150.7999T. Figure 4.Quaternion responses of the rigid body given by(38)and(41)with control lawsuatof(51),ubtof(52), anductof (53) designed in this chapter at initial conditionsωt0=000Trad/sec andqt0=0.33200.46180.19150.7999T. Figure 5.Control input responses of the rigid body given by(38)and(41)with control lawsuatof(51),ubtof(52), anductof (53) designed in this chapter at initial conditionsωt0=000Trad/sec andqt0=0.33200.46180.19150.7999T.

First, as shown in Figures 35, we see that uat,ubt,and uctguarantee the asymptotic stability of the equilibrium point. Second, in Figures 3 and 4, we observe that uatprovides more desirable control performance than ubtand uctbecause the design of uatincorporates with the decay rate constraint.

Finally, in Figures 3 and 4, we see that the state responses of a rigid body with ubtshow faster convergence rates to the equilibrium point than those with uct. And, in Figure 5, we see that the control efforts using ubtand uctare comparable. We can explain this result by the fact that the weight matrix Rwhose diagonal elements are small increases the penalty on the state vector and decreases the penalty on the control input vector, which makes the system stable within a short period of time and the weight matrix Rwhose diagonal elements are large decreases the penalty on the state vector and increases the penalty on the control input vector, which makes the system stable within a long period of time.

## 5. Conclusion

In this chapter, the author presented a theory on the optimal control of nonlinear dynamic systems by utilizing the dynamic programming approach and the inverse optimal approach. Specifically, the author employed the dynamic programming approach to derive the Hamilton-Jacobi-Bellman (H-J-B) equation associated with the optimal control problem for nonlinear dynamic systems and utilized the inverse optimal approach to avoid the task of solving the H-J-B equation numerically.

Then, the author established an optimal control design for TS-type fuzzy systems to achieve the global asymptotic stability of an equilibrium point, the optimality with respect to a cost function, and the good convergence rates of state trajectories to an equilibrium point. Based on this optimal control design, the author presented a systematic way for designing the optimal control law for TS-type fuzzy systems.

The author showed the usefulness of the optimal control design by considering the three-axis attitude stabilization problem of a rigid body. The optimal three-axis attitude stabilizing control law for a rigid body was designed, and its control performance was analyzed by numerical simulations. The numerical simulation results demonstrated that the optimal three-axis attitude stabilizing control law designed in this chapter provides desirable optimal control performance together with good convergence rates of state trajectories to an equilibrium point.

The author would like to suggest two further research topics: one is an extension of the study presented in this chapter toward the robust control design for TS-type fuzzy systems with system parametric uncertainties and external disturbances. The problem is to incorporate these robustness issues into the optimal control design approach, and the key to solve this problem may be found in many literatures addressing the robust control approaches such as loop-transfer-recovery approach, guaranteed-cost approach, stochastic approach, and state-estimation approach. However, the difficulty of combining these approaches with the optimal control design method comes from the fact that these approaches are mainly for linear systems. Therefore, the extension of these approaches to nonlinear dynamic systems may be requisite. The other is to develop the optimal control design of TS-type fuzzy systems for tracking problems. Tracking problems assume that the equilibrium point is not the zero state. In linear dynamic systems, tracking problems can be reduced to regulation problems under the assumption that the desired state is known or can be reduced to disturbance-rejection problems under the assumption that the disturbance signal is known. However, in many cases, the desired state or the disturbance signal is not known. Thus, in such cases, some alternatives such as minimax approach and proportional-integral control may be needed. The minimax approach is for the worst-case design such that the disturbance signal maximizes the same performance index that the control input minimizes. And the proportional-integral control can be used to reject the constant disturbances. In the sequel, the minimax approach and the proportional-integral control may provide the solution to the tracking problem of TS-type fuzzy systems.

chapter PDF
Citations in RIS format
Citations in bibtex format

## More

© 2018 The Author(s). Licensee IntechOpen. This chapter is distributed under the terms of the Creative Commons Attribution 3.0 License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

## How to cite and reference

### Cite this chapter Copy to clipboard

Yonmook Park (November 26th 2018). Optimal Control of Fuzzy Systems with Application to Rigid Body Attitude Control, Aerospace Engineering, George Dekoulis, IntechOpen, DOI: 10.5772/intechopen.82181. Available from:

### Related Content

#### Aerospace Engineering

Edited by George Dekoulis

Next chapter

#### Green Comparable Alternatives of Hydrazines-Based Monopropellant and Bipropellant Rocket Systems

By Dov Hasan, Dan Grinstein, Alexander Kuznetsov, Benveniste Natan, Zohar Schlagman, Avihay Habibi and Moti Elyashiv

First chapter

#### Introductory Chapter: Introduction to Roboethics: The Legal, Ethical and Social Impacts of Robotics

By George Dekoulis

We are IntechOpen, the world's leading publisher of Open Access books. Built by scientists, for scientists. Our readership spans scientists, professors, researchers, librarians, and students, as well as business professionals. We share our knowledge and peer-reveiwed research papers with libraries, scientific and engineering societies, and also work with corporate R&D departments and government entities.