1. Introduction
This chapter presents a novel family of intelligent controllers. These controllers are based on semiphysical (or gray-box) modeling. This technique is intended to combine the best of two worlds: knowledge-based modeling and black-box modeling.
A knowledge-based (white-box) model is a mathematical description of the phenomena that occur in a process, based on the equations of physics and chemistry (or biology, sociology, etc.); typically, the equations involved in the model may be transport equations, equations of thermodynamics, mass conservation equations, etc. They contain parameters that have a physical meaning (e.g., activation energies, diffusion coefficients, etc.), and they may also contain a small number of parameters that are determined through regression from measurements.
Conversely, a black-box model is a parameterized description of the process based on statistical learning theory. All parameters of the model are estimated from measurements performed on the process; it does not take into account any prior knowledge on the process (or a very limited one). Very often, the devices and algorithms that can learn from data are characterized as intelligent. The human mental faculties of learning, generalizing, memorizing and predicting should be the foundation of any intelligent artificial device or smart system (Er & Zhou, 2009). Even if we are still far away from achieving anything similar to human intelligence, many products incorporating Neural Networks (NNs), Support Vector Machines (SVMs) and Fuzzy Logic Models (FLMs) already exhibit these properties. Among the smart controller’s intelligence is its ability to cope with a large amount of noisy data coming simultaneously from different sensors and its capacity to plan under large uncertainties (Kecman, 2001).
A semiphysical (or gray-box) model may be regarded as a tradeoff between a knowledge-based model and a black-box model. It may embody the entire engineer’s knowledge on the process (or a part thereof), and, in addition, it relies on parameterized functions, whose parameters are determined from measurements. This combination makes it possible to take into account all the phenomena that are not modeled with the required accuracy through prior knowledge (Dreyfus, 2005).
A controller based on gray-box modeling technique is very valuable whenever a knowledge-based model exists, but is not fully satisfactory and cannot be improved by further analysis, or can only be improved at a very large computational cost (Maouche & Attari, 2008a; 2008b). Physical systems are inherently nonlinear and are generally governed by complex equations with partial derivatives. A dynamic model of such a system, to be used in control design, is by nature an approximate model. Thus, the modeling error introduced by this approximation influences the performance of the control. Choosing an adaptive control based on neural network, allows dealing with modeling errors and makes it possible to compensate, until a certain level, physical phenomena such as friction, whose representation is difficult to achieve (Maouche & Attari, 2007).
We will consider as an application to this type of control, a robot manipulator with flexible arms. Flexible manipulators are a good example of complex nonlinear systems difficult to model and to control.
In this Chapter we describe a hybrid approach, based on semiphysical modelling, to the problem of controlling flexible link manipulators for both structured and unstructured uncertainties conditions (Maouche & Attari, 2008a; 2008b). First, a neural network controller based on the robot’s dynamic equation of motion is elaborated. It aims to produce a fast and stable control of the joint position and velocity, and to damp the vibration of each arm. Then, an adaptive neural controller is added to compensate the unknown nonlinearities and unmodeled dynamics, thus enhancing the accuracy of the control. The robustness of the adaptive neural controller is tested under disturbances and compared to a classical nonlinear controller. Simulation results show the effectiveness of the proposed control strategy.
2. Lightweight flexible manipulators
The demand for increased productivity in industry has led to the use of lighter robots with faster response and lower energy consumption. Flexible manipulator systems have relatively smaller actuators, higher payload to weight ratio and, generally, less overall cost. The drawbacks are a reduction in the stiffness of the robot structure which results in an increase in robot deflection and poor performance due to the effect of mechanical vibration in the links.
The modeling and control of non-rigid link manipulator motion has attracted researchers attentions for almost three decades. A non-rigid link in a manipulator bears a resemblance to a flexible (cantilever) beam that is often used as a starting point in modeling the dynamics of a non-rigid link (Book, 1990). Well-known approaches such as Euler-Lagrange’s equation and Hamilton’s principle are commonly used in modeling the motion of rigid-link manipulators and to derive the general equation of motion for flexible link manipulators. The infinite-dimensional manipulator system is commonly approximated by a finite-dimensional model for controller design. The finite element method is used in the derivation of the dynamical model leading to a computationally attractive form for the displacement bending.
The motion control of a flexible manipulator consists of tracking the desired trajectory of the rigid variables which are the angular position and velocity. But due to the elasticity of the arms, it has also to damp the elastic variables which are, in our case, deflection and elastic rotation of section of the tip. The main difficulty in controlling such a system is that unlike a rigid manipulator, a flexible manipulator is a system with more outputs to be controlled (rigid and elastic variables) then inputs (applied torques), that involves the presence of dynamic coupling equations between rigid and elastic variables.
Moreover, the dynamic effect of the payload is much larger in the lightweight flexible manipulator than in the conventional one.
However, most of the control techniques for non-rigid manipulators are inspired by classical controls. A multi-step control strategy is used in (Book et al., 1975; Hillsley & Yurkovitch, 1991; Ushiyama & Konno, 1991; Lin & Lee, 1992; Khorrami et al., 1995; Azad et al., 2003; Mohamed et al., 2005) that consists of superimposing to the control of the rigid body, the techniques of shaping or correction of the elastic effects. Other algorithms use the technique of decoupling (De Shutter et al., 1988; Chedmail & Khalil, 1989), others are based on the method of the singular perturbation approach (Siciliano & Book, 1988; Spong, 1995; Park et al., 2002), use noncollocated feedback (Ryu et al., 2004) or use model-based predictive control for vibration suppression (Hassan et al., 2007).
Neural network-based controllers were also used as they reduce the complexity and allow a faster computation of the command (Kuo & Lee, 2001; Cheng & Patel, 2003; Tian & Collins, 2004; Tang et al., 2006).
With recent developments in sensor/actuator technologies, researchers have concentrated on control methods for suppressing vibration of flexible structures using smart materials such as Shape Memory Alloys (SMA) (Elahinia & Ashrafiuon, 2001), Magnetorheological (MR) materials (Giurgiutiu et al., 2001), Electrorheological (ER) materials (Leng & Asundi, 1999), Piezoelectric transducers (PZT) (Shin & Choi, 2001; Sun et al., 2004; Shan et al., 2005), and others.
The use of knowledge-based modeling, whereby mathematical equations are derived in order to describe a process, based on a physical analysis, is important to elaborate effective controllers. However, this may lead to a complex controller design if the model of the system to be controlled is more complex and time consuming.
Therefore, we propose a controller based on artificial neural networks that approximate the dynamic model of the robot. The use of artificial neural networks, replacing nonlinear modeling, may simplify the structure of the controller and, reduce its computation time and enhance its reactivity without a loss in the accuracy of the tracking control (Maouche & Attari, 2008a; 2008b). This is important when real time control is needed.
The main advantage of neural networks control techniques among others is that they use nonlinear regression algorithms that can model high-dimensional systems with extreme flexibility due to their learning ability.
Using dynamic equations of the system to train the neural network presents many advantages. Data (inputs/outputs set) are easily and rapidly obtained via simulation, as they are not tainted with noise, and they can be generated in sufficient number that gives a good approximation of the model. Moreover, it is possible to generate data that have better representation of the model of the system.
To reduce the modeling error between the actual system and its representation, we propose to add an adaptive neural controller. Here, the neural network is trained online, to compensate for errors due to structured and unstructured uncertainties, increasing the accuracy of the overall control.
The control law presented here has several distinguished advantages. It is easy to compute since it is based on artificial neural network. This robust controller design method maximizes the control performance and assures a good accuracy when regulating the tip position of the flexible manipulator in the presence of a time-varying payload and parameter uncertainties.
3. Dynamic modeling
The system considered here consists of two links connected with a revolute joint moving in a horizontal plane as shown in Figure 1. The first and the second link are composed of a flexible beam cantilevered onto a rigid rotating joint. It is assumed that the links can be bent freely in the horizontal plane but are stiff in the vertical bending and torsion. Thus, the Euler-Bernoulli beam theory is sufficient to describe the flexural motion of the links. Lagrange’s equation and model expansion method can be utilized to develop the dynamic modeling of the robot.
As shown in Figure 1,
The motion of each arm of the manipulator is described by one rigid and two elastic variables:
where
The torques applied to the manipulator joints are given by:
Let consider an arbitrary point
where
Now, the total kinetic energy
where
The potential energy
with
The term on the right-hand side in (5) describes the potential energy due to elastic deformation of the links. Note that the term relative to the gravity is not present here as the manipulator moves on a horizontal plane.
The dynamic motion equation of the flexible manipulator can be derived in terms of Lagrange-Euler formulation:
where
Substituting (4) and (5) into (6a) and (6b) yields to:
where
If we suppose known the length of the two links, we define (Pham et al., 1991):
where
4. Nonlinear control
This control is a generalization of the classically known 'computed torque' used to control rigid manipulator (Slotine & Li, 1987). It consists of a proportional and derived (PD) part completed by a reduced model which contains only the rigid part of the whole nonlinear dynamic model of the flexible manipulator (Pham, 1992). Let:
Then, the model can be reduced to:
or even:
we deduce from (11) that:
we can then use the following control law:
where,
If we consider the ideal case where no errors are made while evaluating the dynamic parameters X, a Lyapunov stability analysis of this control law is presented on Appendix A.
5. Adaptive neural control
The control system structure proposed in this paper is a combination of two controllers. The construction of the first controller is based on the approximation of the nonlinear functions in (12) by neural network to reduce the computation burden. The second controller is based on adaptive neural network. Here the network is trained online, to compensate for errors due to structured and unstructured uncertainty, increasing the precision of the overall controller.
5.1. Reducing the computation burden using Neural Network
The nonlinear law presented in (12) has some major advantages as it uses information extracted from the dynamic motion equation of the system to control the manipulator. Physical characteristics like the passivity of the system can then be used to elaborate a stable controller (Kurfess, 2005).
The drawback is that, using dynamic motion equation of the system in the construction of the controller can lead to a complex controller. Computing such a controller can be time consuming. This is mainly the case with flexible manipulators as they are governed by complex equations which lead generally to a huge model. Using such a model can be incompatible with real time control.
To avoid this problem we propose to approximate the part of the model which is used in the controller with neural networks. The main feature that makes neural network ideal technology for controller systems is that they are nonlinear regression algorithms that can model high-dimensional systems and have the extreme flexibility due to their learning ability. In addition their computation is very fast.
The functions
In the neural network design scheme of
The back-propagation algorithm is adopted to perform supervised learning (Gupta et al., 2003). The two distinct phases to the operation of back-propagation learning include the forward phase and the backward phase.
In the forward phase the input signal propagate through the network layer by layer, producing the response
where
In this paper, the function
The actual responses of
In the backward phase, the delta rule learning makes the output error between the output value and the desired output value change weights and reduce error.
The training is made off line so that it does not disturb the real time control. The free parameters of the network are adjusted so as to minimize the following error function:
where
The connect weight
where
The connect weight
Delta rule learning for the units in the output layer is given by:
Delta rule learning for the units in the hidden layer is given by:
Neural networks corresponding to
The error in the training set tends to decrease with iteration when the neural network has enough degrees of freedom to represent the input/output map. However, the system may be remembering the training patterns (overfitting or overtraining) instead of finding the underlying mapping rule. To overcome this problem we have used the ‘Cross Validation’ method.
To avoid overtraining, the performance in a validation set (data set from trajectories that the system never saw before) must be checked regularly during training. Here, we performed once every 50 passes over the training set. The training should be stopped when the performance in the validation set starts to decrease, despite the fact that the performance in the training set continues to increase.
5.2 Construction of the adaptive neural controller
Let us consider now the case where the estimated parameters
In addition to the structured uncertainties, there are also unstructured uncertainties due to unmodeled phenomena like frictions, perturbations etc. A more general equation of motion of the horizontal plane flexible robot is given by:
where
We will then add a second controller to the system based on adaptive neural network in order to compensate the errors induced by the structured and unstructured uncertainties.
The basic concept of the adaptive neural network used in the second controller is to produce an output that forms a part of the overall control torque that is used to drive manipulator joints to track the desired trajectory.
The errors between the joint’s desired and actual position/velocity values are then used to train online the neural controller.
In the adaptive neural network design scheme there are also three layers. Sigmoid and linear functions are used in the hidden and the output layer respectively.
The input signals of the input layer are angular position and velocity:
Training is made online and the parameters of the network are adjusted to minimize the following error function:
where
As the training of the adaptive neural controller is made online, we must minimize its computational time. The learning rate is designed relating the network learning, local minimum, and weight changes which can be overly large or too small in the neural network learning. A momentum factor is then used to help the network learning (Krose & Smagt, 1996).
The formulation of the weight change is then given by:
where
When no momentum term is used, it takes a long time before the minimum has been reached with a low learning rate, whereas for the high learning rates the minimum is never reached because of the oscillations. When adding the momentum term, the minimum will be reached faster. This will drive the adaptive neural controller to produce a faster response. A better control can then be achieved.
The overall robotic manipulator control system proposed is shown in Figure. 2. It can be written:
where
6. Simulation results
Performance of the control strategy proposed is tested using a dynamic trajectory having 'Bang-Bang' acceleration, with a zero initial and final velocity:
with
To avoid the destabilization of the control induced by fast dynamics, we choose T = 30 sec. The maximum angular velocity is reached for t = T/4 and for t = 3T/4 and its absolute value is 4
The gain matrices are adjusted as follows:
Let us suppose now that the actual values of the parameters of the robot are such as specified in Table 1. To test the robustness of the proposed control strategy, we consider the extreme case where the estimation error on the dynamic parameters
then, we use these values (
Our goal here is to simulate an important error due to a bad estimation of the dynamic parameters (or ignorance of some of them). We can suppose that if the hybrid controller can handle this important error, it can a fortiori handle a small one.
For simplicity on the simulation tests, dynamic parameters are equally bad estimated in (26). Even if it is not always the case on practice, this will not affect the adaptive neural controller, which is in charge of compensating these errors, because the adaptive neural controller considers the global error (the resultant of the sum of all errors).
In order to better appreciate the effectiveness of the overall adaptive neural controller we compare its results with the nonlinear controller given in (12).
Figures 3 to 12 illustrate the results obtained with the adaptive neural controller applied to the two-link flexible manipulator. They describe the evolution of: angular position, error on position, deflection, angular velocity and error on the angular velocity, for the joints 1 and 2, respectively.
Results of the nonlinear control are reported in dashed line for comparison. The desired trajectory (target) is reported on Figures 3, 6, 8 and 11 in dotted line.
Table 2 and Table 3 presents the maximum error and the Root Mean Square error (RMS) of the angular position and velocity obtained with the two types of control strategy used.
The desired trajectory imposes a fast change of acceleration on moment t = T/4 = 7.5 sec and t = 3T/4 = 22.5 sec. This radical change from a positive to a negative acceleration for the first moment and from a negative to positive acceleration for the second one stresses the control. We can see its impact on the control of the angular velocity in Figure 6 and Figure 11.
However, the trajectory following obtained with the adaptive neural control is good and the error induced is acceptable. Whereas, the nonlinear control strongly deviates from the target.
We can see from Table 2 and Table 3 that the error on velocity, obtained with the conventional nonlinear control, reaches 0.19 rad/sec (10.9 deg/sec) for the first joint and 0.13 rad/sec (7.7 deg/sec) for the second one. With the adaptive neural control, results are significantly better with an velocity error lower than 0.01 rad/sec (lower than 0.5 deg/sec) for the two joints.
For the position control (see Figures 3 and 8), we notice that the angular trajectory obtained with the adaptive neural controller matches perfectly the target, with an error of no more than 0.003 rad, (0.2 deg) for the first and the second links, whereas it exceeds 0.34 rad (20 deg) with the nonlinear controller for the two links (see Table 2 and Table 3).
The hybrid controller proposed deals well with the flexibility of the link as the deflection is lessened (see Figure 5 and Figure 10). However, results obtained with the nonlinear control alone are slightly better.
The deflection of the first flexible link, shown in Figure 5, is within ± 0.055 m with the hybrid control where as it is lower than 0.036 m with the nonlinear control. For the second flexible link and as shown in Figure 10, the deflection reaches 0.017 m with the hybrid control where as it is lower than 0.011 m with the nonlinear control
We notice also from Figure 5 and Figure 10, the appearance of vibrations with the hybrid control. However, their amplitude is lessened.
Therefore, we can make the following conclusion. On the one hand, the use of the nonlinear model based controller (
Combining these two control technique schemes gives a good compromise between stability and precision. Simulation results show the effectiveness of the control strategy proposed.
Table 1.
Manipulator characteristics
7. Conclusion
Our goal is to search for intelligent control techniques that improve the performance of the controller and reduce the computation burden. The main idea here is to combine two control techniques, nonlinear control and neural network control.
The new adaptive neural control strategy presented is a combination of two controllers.
The first controller is based on the approximation with neural networks of the robot dynamic equation of the motion. Its aim is to provide a stable and fast control based on the dynamic model of the system. Using artificial neural network in the place of the nonlinear model allow to simplify the structure of the controller reducing its computation time and enhancing its reactivity.
The second controller is based on neural networks that are trained online. Its objective is to ensure that the actual trajectory matches the desired one by compensating errors due to structured and unstructured uncertainty, increasing the precision of the control.
Simulation results on a robot manipulator with two flexible arms have shown the robustness in performance of this control design scheme against adverse effects such as model parameter variations.
In summary, this article provides a novel control structure, to overcome the robotic manipulator control difficulties faced by conventional control schemes when uncertainties (e.g., friction, changing payload, time-varying friction, disturbances) cannot be ignored.
8. Appendix A: Stability analysis
By subtracting (12) from (11a), we obtain the error equation:
with,
Using (A.1) and (A.2), the global error equation becomes:
where the positive constant matrices
To study the stability of the global system, the following Lyapunov function is considered:
by differentiating V and using (A.3), and the fact that
The property of passivity of the flexible manipulator implies that
The Lyapunov second method provides that the asymptotic stability of the control is assured if the following conditions are met.
These conditions are always met if the desired angular velocities and accelerations are not too significant for a given tuning of











