Open access peer-reviewed chapter

Fault Residuals Based on Distributed Discrete-Time Linear Kalman Filtering

Written By

Dušan Krokavec and Anna Filasová

Submitted: 31 March 2018 Reviewed: 13 July 2018 Published: 05 November 2018

DOI: 10.5772/intechopen.80296

From the Edited Volume

Fault Detection and Diagnosis

Edited by Constantin Volosencu

Chapter metrics overview

1,056 Chapter Downloads

View Full Metrics


The chapter is concerned with the application of distributed discrete-time linear Kalman filtering with decentralized structure of sensors in fault residual generation. Two variants of distributed Kalman filtering algorithms are introduced, giving the incidence of equivalent functional realization structure of fault residual filters. The obtained solutions use Kalman filter innovations in a nonstandard way to generate residuals with significantly higher dynamic signal range. The obtained results, offering structures for fault detection filter realization, are illustrated with a numerical example to note the effectiveness of the approach.


  • linear noisy systems
  • Kalman filtering
  • innovation sequences
  • fault residual filters
  • distributed computing

1. Introduction

The castigatory principal aspect for designing a fault-tolerant control (FTC) structure is a functionality of diagnostic operations that solve the fault detection and isolation (FDI) tasks. These techniques most commonly use residuals generated by fault detection filters (FDF), followed by the residual signal evaluation within decision functions. Guarantying adequate sensitivity to faults, the accessory objective is to create residuals with minimal sensitivity to noises. Kalman filtering is an optimal state estimation process applied to a dynamic system that involves random noises, giving a linear, unbiased, and minimum error variance recursive algorithm to optimally estimate the unknown state of a dynamic system from noisy data taken from sensors [1, 2].

Practically, a bank of Kalman filters is used to achieve sensor and actuator fault detection applied to a steady-state system, while the statistical characteristics of the system are not required to be known after a fault has occurred [3, 4]. In these methods, the faults are assumed to be known, and the Kalman filters are designed for such kind of sensor or actuator faults. Another approach based on Kalman filtering is the analysis of the innovation sequence, since faults displace its zero mean and change its covariance matrix [5]. The associated problem is quick detection of changes in these parameters from their nominal values. Evidently, research in Kalman filter based-FDI is the subject of wide range of other publications (see, e.g., [6, 7, 8, 9] and the reference therein). Other applications can be found in [10].

The state estimation obtained by the Kalman filter prediction-correction equations at every time instant can be solved almost optimally and substantially faster by applying a distributed approach [11, 12, 13, 14]. With this setup can be exploited the fact that the correction error can be decaying exponentially with time instant sequence to reach the optimal values [15, 16, 17, 18].

The chapter exploits a variant of distributed methods to apply the distributed correction stage filtering equations on each sensor level as well as an approach based on quasi-parallel central computation. Benefiting from the distributed Kalman filtering algorithm, two residually equivalent signal structures are presented for the discrete-time linear noisy systems.

The outline of this chapter is as follows: Section 1 delineates the problem and draws the basic starting points of solutions. Dealing with the discrete-time noisy systems description, the equations describing Kalman filters for uncorrelated measurement and system noises are traced out in Section 2, to delineate distributed approaches in Kalman filter design, suitable for supporting the fault residual generation, presented in Section 3. Section 4 gives a numerical example, illustrating the properties of the proposed method, and Section 5 presents some concluding remarks.

Throughout the chapter, the notations are narrowly standard in such a way that xT and XT denote the transpose of vector x and matrix X, respectively, and diag denotes a block diagonal matrix—for a square matrix X>0 means that X is a symmetric positive definite matrix. The symbol In indicates the nth order unit matrix; IR denotes the set of real numbers; IRn and IRn×r refer to the set of all n-dimensional real vectors and n×r real matrices, respectively; and Z+ is the set of all positive integers.


2. Discrete-time linear Kalman filter

In this section, one version of the Kalman filtering concept is applied for the discrete-time linear multi inputs and multi outputs (MIMO) plants with the system and output noises of the form


where qiIRn, uiIRr, and yiIRm are vectors of the system state, input and measurement output variables, respectively; viIRn and oiIRm are vectors of the system and measurement noise; and FIRn×n, GIRn×r, and CIRm×n are conditioned by 1m,rn. Kalman filter is used only for diagnostic purposes. Zero-mean Gaussian white noise processes are considered such that


where E is the a statistical averaging operator,


is the Kronecker delta-function and the covariance matrices QIRn×n and RIRm×m are symmetric positive definite matrices.

It is assumed that the deterministic system initial state q0=q0 is independent of vi and oi in the sense that


and that the system and measurement noises are uncorrelated, i.e., S=0.

Determining the optimal system state vector estimate, qeii1 denotes the predicted estimation of the system state vector qi at the time instant i in the dependency on all noisy output measurement vector sequence yjj=01i1 up to time instant i1; qeii is the corrected estimation of the system state vector qi at the time instant i in the dependency on all noisy output measurement sequence yjj=01i up to time instant i; and eii1=qiqeii1 and eii=qiqeii are prediction and correction errors.

Definition 1. [19] If the Kalman filter, associated with the plant (1), (2) with uncorrelated system and measurement noises, is defined by the set of equations


then with qe00=q0, P00=Q, where QIRn×n is a positive definite matrix, yielding




are the covariance matrices of prediction and correction errors and JiIRn×m is the Kalman filter gain matrix, all at time instant i.

The discrete-time Kalman filter equations can be algebraically manipulated into a variety of forms [6, 16, 20]. From the point of view of distributed filtration, it is necessary to achieve such form of the equation for calculating the Kalman gain Ji that yields the matrix C from the matrix inversion operation (see (11)). If the system and measurement noises are uncorrelated, then for the Kalman filter gain, one can propose the following:

Lemma 1. If the system and measurement noises are uncorrelated, then the Kalman filter gain and the correction error covariance matrix can be computed using (12) and


Proof. Substituting (11) into (13), one can obtain that


Exploiting the Sherman-Morrison-Woodbury formula of the form [21].


where square invertible matrices A, D, and a matrix B of appropriate dimensions are such that A+BDBT is invertible, with


yields, since the covariance matrices are positive definite,




Then, evidently,


and (31) implies (17).

Premultiplying the left side by P1ii and postmultiplying the right side by P1ii1, (13) gives


and comparing (17) and (24), it can be seen that


Thus, (25) implies (16). This concludes the proof.

Note, since CTR1C is at least a positive semi-definite matrix, it is evident from (17) that Pii is never larger than Pii1. Moreover, the result is an unbiased filter with the estimates of minimum error variances. More details can be found in [12, 22].

Corollary 1. Considering that qeii1 is known and qeii is the best estimate of qi that minimizes the cost criterion


Then, evaluating (26) it follows, with the optimal setting of a state vector estimate qi=qii, that the minimum expected cost is given by


which implies

P1ii1+CTR1Cqeii=P1ii1qeii1+CTR1yi =P1ii1+CTR1Cqeii1 +CTR1yiCqeii1.E28

Therefore, using the above relations, at the ith step Eq. (28) gives

qeii=qeii1+P1ii1+CTR1C1CTR1yiCqeii1 =qeii1+Pii×CTR1yiCqeii1.E29

Pre-multiplying the left side by Pii and post-multiplying the right side by Pii1 then it follows from (17)


which can be proved recursively as follows


Comparing (29) with the covariance matrix of the filtering error given by (13), it is evident that


which is identical to (16).

On the other side, substituting (11) into (13), one can write


and using the Sherman-Morrison-Woodbury formula, Eq. (27), it follows


and so, evidently, (34) gives (17).


3. Fault residual generation using distributed Kalman filtering

The obtained equations, Eqs. (16) and (17), allow the use of the open form of the Kalman filter equations if


Writing separately,


then, (7)(11), (16), and (27) imply


It is evident from the above given formulation that the relation of (40) gives the possibility to compute corrections from the data obtained at all sensor nodes.

Theorem 1. Defining the residual vector as






while the filter gain matrices, as well as recurrences of the covariance matrices are given by (43)(45).

Proof. Considering that there are components of the system state vector estimate that are dependent on the control signal as well as ones that are not dependent on the control signals, since the correction step does not depend on the control inputs, (40) can be rewritten as


Prescribing that


Eqs. (52) and (53) can be separated as


and using (47), (54) gives (50), and (55) implies (51).

Substituting (53) in (39) yields


and, evidently, (56) implies (48) and (49). This concludes the proof. □

Remark 1. If Eqs. (46)(51) are analyzed from a computational point of view, it is clear that their structures support autonomous parallel calculations only with a single interaction defined by Eq. (47). However, the cost for this parallelism is additional computation at each step, but the directional properties of the components of the residual vector are advantageous in the case of single sensor faults. The directional sensor residual property derives indirectly from relationship (44). Since every component zhi carries with it the measurement noise ohi if qedii1 is used for LQG control, it will be no noise at the state control law input.

In principle, it is possible to define the residue generation by results of the local system state correction at Kalman filtration at the time instant i.

Theorem 2. Defining the residual vector as






while the predicted system state at the time instant i is computed centrally and the filtered full system state is covered by the equations


at the time instants iZ+.

Proof. The correction step for the Kalman filter in Eq. (51) can be prescribed locally for the jth node as




Substituting (66), rearranging and postmultiplying the left side by Ph1ii, (65) implies


respectively. Since (69) gives


with a simple elimination after inserting (72), (71) gives


Combining (49) and (51) results in


which can be written as


Pre-multiplying the left side of (44) by Pii leads to


and considering (76), relation (75) takes the form


Thus, the substitution of (73) into (77) gives


and with the notation


(78) implies (62). This concludes the proof.

Remark 2. It is clear that each of Eqs. (59)(62) is only bound to the jth node and therefore such correction can be done locally for each sensor. Conversely, the system state prediction and the residual vector must be computed globally by Eqs. (39), (53), (57), (58), (63), and (64), respectively.

Remark 3. Obviously, under the above conditions, the distributed realization of the Kalman filter correction step is optimal in the sense of criterion (26), and therefore the structure of the fault residual generator based on distributed Kalman filtration is optimal.


4. Illustrative examples

4.1. Example 1

To eliminate specific system dependencies, the Schur discrete-time linear strictly positive system [23] is used for demonstration of the Kalman filtering technique in residual signals construction. The considered system can be put in the system class (1)(4), with the sampling period ts=0.8s, with uncorrelated system and measurement Gaussian noise and the noise covariance matrices


while the system matrix parameters are


Since the discrete-time stochastic linear strictly positive system is stable, the system control law in simulations is defined for the forced mode control as ui=Wwo, where


and the initial conditions for the Kalman filter are


Using the given initial conditions, Figures 1 and 2 display the residuals obtained by the residual filter generated by the distributed Kalman filter defined in (46)(51), reflecting single actuator and sensor faults, starting at the time instant t=50s. The time scale is discrete with the sampling period T=0.8s.

Figure 1.

Residual responses to single faults: (a) the first actuator and (b) the second actuator.

Figure 2.

Residual responses to single faults: (a) the first sensor and (b) the second sensor.

Evidently, the residual trajectories indicate that the proposed residual filter generates directional signals in the event of single sensor faults, and has a significantly higher dynamic signal range in the event of single faults of the actuators, as compared to the residual presented using the standard Kalman filter.

4.2. Example 2

To produce another example that demonstrates achievable performances of the presented design method, the sign-indefinite Schur discrete-time linear system is used, where [24]


ts=0.05s, and the Gaussian noise covariance matrices are R=diag0.0030.04 and Q=0.002I4. To force the desired system output values, it is prescribed


Figures 3 and 4 present the residual responses of the residual filter based on distributed Kalman filtering, from which it is clear that the used principle, especially when compared to the achievable responses with the alternative system presented in Example 1, is operational. Evidently, the residual filter behavior is also acceptable for the system parameters in this example and the system noise environment. The step-like single faults start and continue from the time instant t=25s, the time scale is discrete with the sampling period T=0.05s.

Figure 3.

Residual responses to single faults: (a) the first actuator and (b) the second actuator.

Figure 4.

Residual responses to single faults: (a) the first sensor and (b) the second sensor.

4.3. Example 3

Following the above-mentioned procedures, Example 3 verifies their effectiveness for the linear discrete-time system with the parameters


where F is a left-stochastic matrix [25], ts=0.05s, and the Gaussian noise covariance matrices are R=0.003 and Q=0.002I4. The behavior of the system is changed by the state-feedback control




which provides Schur matrix Fc as follows


Note, the steady states of Fc are absorbing states.

The single fault effects in residuals, when using the proposed algorithm of distributed Kalman filtering (46)(51) with setting F=Fc, qe00=0 and P00=I4 are shown in Figure 5. The time scale is discrete with the time sample interval T = 0.1s.

Figure 5.

Residual responses to single faults: (a) the actuator and (b) the sensor.

From the figures, we find that the fault responses are satisfactory by using the proposed method also for this system and noise environment.

Analyzing all examples, exactly the same responses are reached using the same parameters as before and assuming the same fault patterns if the residuals are evaluated exploiting formulas (57)(64) or (46)(51). It is given by the equivalent principles of distributed computing that are bound by the equivalent relationships (44) and (62), respectively. As a result, in this particular point of view, the proposed distributed algorithm has only one common matrix component, P1ii1, which has to be transmitted to every separated sensor before carrying out the state correction filtering step at every time instant. Since the correction step at time instant i is done in dependency on the measured value at the same time instant yi, it is clear that the shorter the computation at the correction step, the smaller the time-delay introduced into the fault detection system responses.


5. Concluding remarks

Realization forms for fault detection residual structures, based on distributed Kalman filtering destined for noisy discrete-time linear systems, were derived in this chapter. The main idea deals with introducing a distributed sensor measurement noise corrector step of a Kalman filter, applied in such a way to be locally uncorrelated with other sensor measurements. Two different algorithmic supports, a parallel decentralized Kalman filter and a locally distributed Kalman filter, are constructed to generate fault residuals. Both solutions are discussed in detail to demonstrate the condition of their equivalency. The problem accomplishes the manipulation in the manner giving guaranty of asymptotic stability of a local fault residual detection filter. Simulated example is included to illustrate the applicability of the proposed methods, encouraging the results that are obtained. Note, since the Kalman filter is based on the nominal system parameters G and C, it cannot estimate system states and outputs starting for faulty regimes with modified matrices Gf and Cf, respectively.

From the point of cloud-based distributed systems, to combine appropriately the network and computational resources, a locally distributed Kalman filter seems to be naturally adaptable, also with cross-correlated sensor noises. Of course, no theoretical justification for this affirmation is presented in the chapter. This is seen as an area for future research by the authors.



The work presented in this chapter was supported by VEGA, the Grant Agency of the Ministry of Education and the Academy of Science of Slovak Republic, under Grant No. 1/0608/17. This support is very gratefully acknowledged.


  1. 1. Hassan MF, Salut G, Singh MG, Titli A. A decentralized computational algorithm for the global Kalman filter. IEEE Transactions on Automatic Control. 1978;23(2):262-268
  2. 2. Song E, Zhu Y, Zhou J, You Z. Optimal Kalman filtering fusion with cross-correlated sensor noises. Automatica. 2007;43(8):1450-1456
  3. 3. Hajiyev C, Caliskan F. Sensor/actuator fault diagnosis based on statistical analysis of innovation sequence and robust Kalman filtering. Aerospace Science and Technology. 2000;4(6):415-422
  4. 4. Hu J, Xiao L. Multi-sensor fault diagnosis of aircraft engine based on Kalman filter group. In: Proceedings of 2016 Chinese Intelligent Systems Conference, Vol. 1; 22–23 October 2016; Xiamen, China; Lecture Notes in Electrical Engineering 404. Singapore: Springer Science + Business Media; 2016. pp. 363-379
  5. 5. Mehra RK, Peschon J. An innovations approach to fault detection and diagnosis in dynamic systems. Automatica. 1971;7(512):637-640
  6. 6. Petersen IE, Savkin AV. Robust Kalman Filtering for Signals and Systems with Large Uncertainties. Boston: Birkhäuser; 1999. 207 p
  7. 7. Kobayashi T, Simon DL. Evaluation of an enhanced bank of Kalman filters for in-flight aircraft engine sensor fault diagnostics. Transactions of the ASME. 2005;127(3):497-502
  8. 8. Xue W, Guo YQ. Application of Kalman filters for the fault diagnoses of aircraft engine. In: Kordic V, editor. Kalman Filter. In Tech: Rijeka; 2010. pp. 349-362
  9. 9. Liu X, Xue N, Yuan Y. Aircraft engine sensor fault diagnostics using an on-line OBEM update method. PLoS One. 2017;12(2):1-23
  10. 10. Zhu Y, Zhou J, Shen X, Song E, Luo Y. Networked Multisensor Decision and Estimation Fusion Based on Advanced Mathematical Methods. Boca Raton: CRC Press; 2013. 437 p
  11. 11. Duda Z. State estimation in a decentralized discrete time LQG control for a multisensor system. Archives of Control Sciences. 2017;27(1):29-39
  12. 12. Filasová A, Krokavec D. On distributed discrete-time Kalman filtering in large linear time-invariant systems. In: Proceedings of the 21st International Conference on Process Control PC; 6–9 June 2017; Štrbské Pleso, Slovakia. 2017. pp. 291-296
  13. 13. Mahmoud MS. Decentralized Control and Filtering in Interconnected Dynamical Systems. Boca Raton: CRC Press; 2017. 612 p
  14. 14. Govaers F. Distributed Kalman filter. In: Serra GL, editor. Kalman Filters. Theory for Advanced Applications. London: IntechOpen; 2018. 314 p
  15. 15. Speyer JL. Computation and transmission requirements for a decentralized Linear-Quadratic-Gaussian control problem. IEEE Transactions on Automatic Control. 1979;24(2):266-269
  16. 16. Berg TM, Durrant-Whyte HF. General decentralized Kalman filters. In: Proceedings of the American Control Conference, Vol. 2; 29 June–1 July 1994; Baltimore, USA. 1994. pp. 2273-2274
  17. 17. Zhu Y. Multisensor Decision and Estimation Fusion. New York: Kluwer Academic Publishers; 2003. 236 p
  18. 18. Marelli D, Zamani M, Fu M, Ninness B. Distributed Kalman filter in a network of linear systems. Systems & Control Letters. 2018;119:71-77
  19. 19. Chui CK, Chen G. Kalman Filtering with Real-Time Applications. Berlin: Springer-Verlag; 2009. 230 p
  20. 20. Krokavec D. Decentralized optimal filtering of the large-scale system state. In: Proceedings of the 2nd IFAC Workshop New Trends in Design of Control Systems; Smolenice, Slovakia, 7–10 September 1997; Volumes 30(21). 1997. pp. 445-450
  21. 21. Horn RA, Johnson CR. Matrix Analysis. New York: Cambridge University Press; 2013. 644 p
  22. 22. Bryson AE, Ho YC. Applied Optimal Control. Optimization, Estimation, and Control. New York: Taylor & Francis; 1975. 482 p
  23. 23. Krokavec D, Filasová A. Stabilization of discrete-time LTI positive systems. Archives of Control Sciences. 2017;27(4):575-594
  24. 24. Xue D, Chen Y, Atherton DP. Linear Feedback Control. Analysis and Design with MATLAB. Philadelphia: Society for Industrial and Applied Mathematics; 2007. 370 p
  25. 25. Canto B, Canto R, Kostova S. Stabilization of positive linear discrete-time systems by using a Brauer’s theorem. The Scientific World Journal. 2014;2014:1-6

Written By

Dušan Krokavec and Anna Filasová

Submitted: 31 March 2018 Reviewed: 13 July 2018 Published: 05 November 2018