Constraints on system inputs.

## Abstract

In control theory, the inverted pendulum is a class of dynamic systems widely used as a benchmarking for evaluating several control strategies. Such a system is characterized by an underactuated behavior. It is also nonlinear and presents open-loop unstable and integrating modes. These dynamic features make the control more difficult, mainly when the controller synthesis seeks to include constraints and the guarantee of stability of the closed-loop system. This chapter presents a stabilizing model predictive control (MPC) strategy for inverted pendulum-like behaved systems. It has an offset-free control law based on an only optimization problem (one-layer control formulation), and the Lyapunov stability of the closed-loop system is achieved by adopting an infinite prediction horizon. The controller feasibility is also assured by imposing a suitable set of slacked terminal constraints associated with the unstable and integrating states of the system. The effectiveness of the implementable and stabilizing MPC controller is experimentally demonstrated in a commercial-didactic rotary inverted pendulum prototype, considering both cases of stabilization of the pendulum in the upright position and the output tracking of the rotary arm angle.

### Keywords

- rotary inverted pendulum
- model predictive control
- nonlinear system
- Lyapunov stability
- feasible-optimization problem

## 1. Motivation

Dynamic inverted pendulum-featured apparatuses are widespread in systems and control theory. These represent a class of nonlinear and underactuated electromechanical systems, which, in turn, are composed of open-loop unstable and integrating modes. The scale-up of inverted pendulum-based conceptual sketches in practical mechanisms and real applications has been in progress, of which one can cite stabilization of rocket launch, robot balance, and segway-like means of transportation, among others [1, 2].

In control theory, inverted pendulum-type systems have enabled extensive studies concerning controller architectures ranging from proportional-integrative-derivative (PID)-like classical strategies to more advanced technique ones, such as optimal and adaptive strategies. In the middle of the advanced control strategies, the so-called class of model predictive control (MPC) strategies has been preferred by systematically handling system constraints. In fact, any MPC algorithm makes explicit use of a system model to predict its outputs and to obtain an optimal control law that minimizes the prediction error and control efforts [3, 4, 5]. Since it requires an online solution to its associated optimization problem, it first became popular in applications of slow dynamic systems, such as those in petroleum refineries and petrochemical industries [6]. However, with advances in hardware development and optimization techniques, MPC applications have been extended to fast dynamic systems, including inverted pendulum-like mechatronic systems [7, 8, 9].

On the other hand, when one seeks to control open-loop unstable systems such as inverted pendulum-like behaved ones, the guarantee of stability associated with control laws plays a crucial role concerning practical implementation purposes. In particular, the synthesis of stabilizing MPC laws deals essentially with terminal state constraints. One of the most heavily studied stability approach is one based on a dual-mode framework, which is composed of two distinct control modes: in the first mode, a conventional MPC law forces the system states to converge to a certain invariant set at the end of the finite prediction horizon, while in the second control mode, a local state-feedback controller takes over and drives the state to the desired operating point within this set [10]. This approach, however, requires the computation of the invariant set parameters, which is obtained from an offline numerical procedure. Although this set can be obtained offline with standard algorithms, undesired convergence and numerical issues may appear as the system dimension increases. Furthermore, the control horizon should be large enough such that the system states at the end of this horizon lie in the invariant set; otherwise the resulting optimization problem becomes infeasible, thus compromising both feasibility and control performance.

Another way to guarantee the closed-loop system stability of MPC controllers is to adopt an infinite prediction horizon, the so-called infinite-horizon model predictive control (IHMPC). Since the infinite-horizon problems cannot be directly handled by an optimization algorithm, the realization of IHMPC controllers is obtained from the combination between a terminal cost term and terminal equality constraints [11]. The terminal cost, associated with open-loop stable modes of the system, is calculated through the solution of the Lyapunov equation, whereas the terminal constraints are necessary to limit the objective function when the system is composed of integrating and unstable modes. However, stability proof is only achieved if the constrained optimization problem is feasible. The feasibility is also a critical issue of this approach, particularly because the domain of attraction of the controller becomes quite reduced by virtue of the associated hard constraints. Although there is already a rich theory in this field, the applications are heavily limited to theoretical works [12]. Among the methods developed to circumvent this issue so far, the approach based on slacked terminal constraints seems to be more adequate for practical implementation purposes, with recent applications reported in the literature, one implementation in a crude oil distillation [13] and the other in an inverted pendulum mechatronic-like fast dynamic system, namely, customized engine control unit [14].

This class of controllers formulates optimization problems that are always feasible through the suitable inclusion of slack variables in the control laws, without compromising their convergence and stabilizing properties. Also, these IHMPC controllers make use of the customized state-space models, obtained from an analytical expression of the step response of the system. Because of this, their formulations have been gradually developed over time. Odloak [15] focused on systems with open-loop stable poles, his work being extended to contemplate simple integrating poles as well in [6], commonly found in systems of the process industry. Then, Santoro and Odloak [16] encompassed time delays to the formulation proposed in [6]. For open-loop stable and unstable time-delay processes, Martins and Odloak [12] synthesized their IHMPC controller. More recently, the master’s dissertation [17] included integrating poles in the last work formulation [12], such that its associated IHMPC controller can be directly applied to rotary inverted pendulum-behaved systems, the case understudy of this chapter. The implementation in a real system of the feasible-optimization problem-based stabilizing MPC controller proposed in [17] has not yet been documented in the literature. This gap will be filled in the present work.

## 2. System description

The objective of the MPC controller to be explored in this work is to stabilize the pendulum rod in the upright position while it leads the rotary arm angle to the desired positions. To this end, the rotary inverted pendulum used here will be a commercial-didactic prototype manufactured by Quanser. This prototype is installed in the Control Laboratory of the Center for Technological Training in Industrial Automation (CTAI) at the Federal University of Bahia (UFBA). Figure 1 illustrates the features of such a system [18].

The rotary inverted pendulum prototype consists of a servomotor system, whose voltage

The governing mathematical model of this system can be obtained by the Euler-Lagrange formalism, resulting in the following well-known equations [18]:

where

Since one of the control objectives aims to the stabilization of the pendulum in the upright position, it is quite adequate to assume that

This model representation of the system in terms of transfer functions is useful to obtain the state-space formulation to be used in the stabilizing MPC control law, as will be shown in the next section.

## 3. Stabilizing MPC formulation

The stabilizing MPC control law used in this work seeks to solve an infinite-horizon optimization problem, such that its objective function is composed of the following terms:

where

In the state-space model defined in the pair of Eqs. (4) and (5),

In the objective function, there are also

It should be kept in mind that the objective function defined in Eq. (3) can be rewritten as follows:

Then, with the aid of the state-space model used to carry out the prediction of the system, it is possible to demonstrate that the objective function becomes:

It is worth emphasizing that if constraints are not imposed at the end of the control horizon, the objective function value will increase unbounded. To this end, the following terminal constraints are imposed on the optimization control problem:

Furthermore, the term associated with stable modes of the system comprises a convergent series, giving rise to the so-called terminal cost, namely:

where

Therefore, the feasible-optimization problem-based stabilizing MPC control law is summarized as follows:

subject to Eqs. (8), (9), and (10), and

where

** Remark 1.** The slack variables play a remarkable role with respect to the feasibility of the control formulation, i.e., the control law of

**will always provide a feasible solution, either the nominal case (linear model) or plant-model mismatch, an object under study of this work.**Problem 1

** Remark 2.** The weighting matrices

** Remark 3.** From the stability point of view, the master’s dissertation [17] demonstrates the conditions necessary to prove that the objective function behaves as a Lyapunov function, thus assuring that the control actions obtained from the solution of

**drive the system asymptotically to the reference value (desired steady state), if it is reachable; otherwise, the system will converge to an equilibrium point (reachable steady state) lying at a minimum distance from the desired steady state.**Problem 1

## 4. Results and discussion

This section is devoted to present the implementation results of the feasible-optimization problem-based stabilizing MPC controller (** Problem 1**) in the rotary inverted pendulum prototype described in Section 2. The ultimate goal of the controller is to maintain the pendulum rod in the upright position after it has been swung up to this position by the energy-based swing-up control scheme embedded in the system. In addition, the IHMPC controller is simultaneously designed to track the desired positions to be configured for rotary arm angles. In Quanser apparatus, an unconstrained linear-quadratic regulator (LQR) controller makes up the control system, besides the swing-up control strategy. The existing LQR strategy will be replaced by the IHMPC controller, and this scheme is depicted in Figure 2.

The architecture used for this real-time implementation of the IHMPC controller is summarized in Figure 3. From this figure, it is possible to note the information exchange among software-hardware-equipment mechanisms of the prototype. The control law is solved at each sampling time on the computer i7-8550H with 1.80GHz processor and 16GB of RAM, using Matlab script and * Quarc real-time control* toolbox. The software-hardware interface is done via USB communication through the Q8-USB acquisition board. This acquisition system acts, in turn, as an interface between the digital part of the system (controller) and the analogic one that is composed of the amplifier (VoltPAQ-X1).

For the experimental results presented as follows, we consider a scenario of square wave-type tracking on the rotary arm, while the controller must maintain the pendulum rod around the upright vertical position, even in the existing unmeasured disturbance scenarios. The constraints associated with the control signal and control actions (decision variables) are those established in Table 1. Note that there is a strict condition of

Variables | Minimum value (V) | Maximum value (V) |
---|---|---|

Control signal | −12 | 12 |

Control actions | −1 | 1 |

The closed-loop system results are depicted in Figures 4 and 5. From Figure 4, one can see that after about 5.5 seconds, the time necessary that the swing-up control acted to lead the pendulum rod to its upright position, the IHMPC controller takes over and performs quite well both tasks associated with the rotary arm angle tracking and the stabilization of the pendulum rod within an acceptable range lying at about

Even though the stability of the IHMPC controller is only related to the nominal case (linear model), it proved to be very sufficient in a realistic plant-model mismatch scenario, including nonlinearities existing in the rotary inverted pendulum apparatus, such as dead zone, friction, backlash, hysteresis, and so on. This model uncertainty scenario was responsible for non-prohibitive oscillations, within a practical implementation purpose, on the constrained control signal (cf. Figure 5), which were reflected in the controlled outputs.

Furthermore, it is worth mentioning that fulfilling a tighter constraint (

On the other hand, in order to obtain a satisfactory performance as in the results presented earlier, an effort with respect to the controller tuning was necessary. This tuning task is easier in the stabilizing MPC controllers than the conventional finite-horizon MPC ones [13], as demonstrated in what follows. In this case, it was sufficient to handle only the control horizon. In inverted pendulum-like fast dynamic systems, when one applies a more aggressive control policy, i.e., small control horizon, it can cause undesired overshoots, while adopting large control horizons, it cannot have time sufficient to act with control action properly, thus bringing unnecessary oscillations or even causing the instability of the closed-loop system.

To work around this trade-off, we proceeded with sensitivity analysis on the control horizon, keeping the same remaining tuning parameters shown in the preceding experimental results. Figure 7 summarizes the aforementioned analysis. Note that as the control horizon increases, the oscillations decrease until the control horizon

## 5. Conclusions

In this chapter, we have investigated the application of an implementable and stabilizing model predictive control model strategy in a commercial-didactic rotary inverted pendulum apparatus, hitherto unexplored in the literature. Although the guarantee of stability of the controller is devoted to the nominal case (linear model), its formulation based on a feasible-optimization problem allows it to be used in any plant-model mismatch scenario in practice, such as one series of nonlinearities existing in the real system, namely, dead zone, friction, and backlash, among other unmodelled dynamics. The experimental results showed the effectiveness and robustness of the controller in the aforementioned plant-model mismatch setting by performing quite well its task in the rotary arm angle tracking and stabilization of the pendulum rod around the upright position as well as in the optimum use of energy associated with control efforts.

A simple tuning procedure was adopted by virtue of using a stabilizing MPC controller, which allowed us to handle only one tuning parameter through sensitivity analysis on the control horizon. The value found was quite adequate to attain the control objectives in terms of the trade-off existing between the performance on the controlled variables and the use of energy related to the control signal.

The future direction for this research is to further extend this controller to guarantee the stability of the nonlinear case, including the energy-based swing-up control schemes.

## Acknowledgments

The authors would like to thank the Brazilian research agencies CAPES, CNPq, and FAPESB for their financial support.

## References

- 1.
Ogata K. Modern Control Engineering. 5th ed. Upper Saddle River: Prentice Hall; 2010 - 2.
Nise NS. Linear Systems Theory. 7th ed. Hoboken: Wiley; 2015 - 3.
Rossiter JA. Model-Based Predictive Control: A Practical Approach. Boca Raton: CRC Press; 2003 - 4.
Camacho EF, Bordons C, Alba CB. Model Predictive Control. London: Springer; 2004 - 5.
Maciejowski JM. Predictive Control: With Constraints. Harlow: Pearson Education; 2002 - 6.
Carrapiço OL, Odloak D. A stable model predictive control for integrating processes. Computers and Chemical Engineering. 2005; 29 (5):1089-1099 - 7.
Askari M, Mohamed HAF, Moghavvemi M, Yang SS. Model predictive control of an inverted pendulum. In: International Conference for Technical Postgraduates, TECHPOS. 2009. DOI: 10.1109/TECHPOS.2009.5412069 - 8.
Mohamed HAF. Hard constraints explicit model predictive control of an inverted pendulum. 1st International Conference on Energy, Power and Control (EPC-IQ). 2010; 6 (1):28-32 - 9.
Peyrl H, Zanarini A, Besselmann T, Liu J, Boéchat M-A. Parallel implementations of the fast gradient method for high-speed mpc. Control Engineering Practice. 2014; 33 :22-34 - 10.
Mayne DQ, Rawlings JB, Rao CV, Scokaert POM. Constrained model predictive control: Stability and optimality. Automatica. 2000; 36 (6):789-814 - 11.
Rawlings JB, Muske KR. The stability of constrained receding horizon control. IEEE Transactions on Automatic Control. 1993; 38 (10):1512-1516 - 12.
Martins MAF, Odloak D. A robustly stabilizing model predictive control strategy of stable and unstable processes. Automatica. 2016; 67 (5):132-143 - 13.
Martin PA, Zanin AC, Odloak D. Integrating real-time optimization and model predictive control of a crude distillation unit. Brazilian Journal of Chemical Engineering. 2019; 36 (3):1205-1222 - 14.
Brugnolli MM, Angelico BA, Laganá AAM. Predictive adaptive cruise control using a customized ecu. IEEE Access. 2019; 7 :55305-55317 - 15.
Odloak D. Extended robust model predictive control. AIChE Journal. 2004; 50 (8):1824-1099 - 16.
Santoro BF, Odloak D. Closed-loop stable model predictive control of integrating systems with dead time. Journal of Process Control. 2012; 22 (7):1209-1218 - 17.
Abreu OSL. Stabilizing model predictive control applied to open-loop unstable and integrating systems (in Portuguese) [Master dissertation]. Federal University of Bahia; 2018 - 18.
Quanser. Inverted Pendulum Experiment for Matlab/Simulink Users; 2011 - 19.
Yamashita AS, Santoro BF, Martins MAF, Odloak D. Application of an infinite horizon mpc to a nonlinear open-loop unstable reactor system. In: 8th International Conference on Integrated Modeling and Analysis in Applied Control and Automation, IMAACA. 2015. pp. 22-28 - 20.
Qin SJ, Badgwell TA. A survey of industrial model predictive control technology. Control Engineering Practice. 2003; 11 (7):733-764 - 21.
Muske KR, Rawlings JB. Model predictive control with linear models. AIChE Journal. 1993; 39 (2):262-287. ISSN 0001-1541