Performance comparison of the 2D CWT, WFT, and LFT methods, using the NMSE.

## Abstract

Optical metrology and interferometry are widely known disciplines that study and develop techniques to measure physical quantities such as dimensions, force, temperature, stress, etc. A key part of these disciplines is the processing of interferograms, also called fringe patterns. Owing that this kind of images contains the information of interest in a codified form, processing them is of main relevance and has been a widely studied topic for many years. Several mathematical tools have been used to analyze fringe patterns, from the classic Fourier analysis to regularization methods. Some methods based on wavelet theory have been proposed for this purpose in the last years and have evidenced virtues to consider them as a good alternative for fringe pattern analysis. In this chapter, we resume the theoretical basis of fringe pattern image formation and processing, and some of the most relevant applications of the 2D continuous wavelet transform (CWT) in fringe pattern analysis.

### Keywords

- 2-D wavelets
- fringe patterns
- optical measurement techniques

## 1. Introduction

Fringe pattern processing has been an interesting topic in optical metrology and interferometry; owing to its relevance nowadays, it is a widely studied discipline. Digital fringe pattern processing is used in optical measurement techniques such as optical testing [1, 2], electronic speckle pattern interferometry (ESPI), holographic interferometry, and moiré interferometry or profilometry [3, 4, 5]. They are quite popular for non-contact measurements in engineering and have been applied for measuring various physical quantities like displacement, strain, surface profile, refractive index, etc. In optical methods of measurement, the phase, which is related to the measured physical quantity, is encoded in an intensity distribution represented in an image which is, in general, the result of the interference phenomena. This phenomenon is used in classical interferometry, in holographic interferometry, and in electronic speckle pattern interferometry to convert the phase of a wave of interest into an intensity distribution. As the physical quantity to be measured is codified as the phase of a fringe pattern image, the main task of fringe pattern processing is to recover such phase.

The methods for phase recovery from fringe patterns can be classified mainly in three categories [2, 6]: (a) Phase-stepping or phase-shifting methods which require a series of fringe images to recover the phase information. (b) Spatial domain methods which can compute the phase from a single fringe pattern in the spatial domain. (c) Frequency domain methods which uses some kind of transformation to the frequency domain to compute the phase. In this category, the Fourier and Wavelet transforms are the most common mathematical tools to carry out the task.

Apart from the phase recovery, there are other important steps in fringe pattern processing. For example, many times the fringe patterns are corrupted by noise, such as the case of the electronic speckle pattern interferometry. Then, fringe image enhancement by means of low-pass filtering is usually required. Owing that most algorithms to retrieve the phase from a fringe pattern give the phase wrapped in the interval

In the fields of fringe pattern denoising and wrapped phase map denoising, there have been many proposals to realize these tasks. Some of the first contributions in this field were mainly based on convolution filters using different kinds of anisotropic filtering masks [8, 9, 10, 11, 12]. Other set of the main contributions in the last years is based on the variational calculus approach by solving partial differential equations [13, 14, 15, 16, 17, 18], and by means of the regularization theory [19, 20]. The use of the Fourier transform for fringe or phase map denoising has also been proposed in [21, 22] (Localized Fourier transform filter and windowed Fourier transform, respectively). There have been other proposals that used different methodologies such as coherence enhancing diffusion [23], image decomposition [24], and multivariate empirical mode decomposition [25]. The great disadvantage of already reported methods for fringe and phase map denoising is that they require the previous estimation of the so-called fringe orientation which, as it uses the computation of the image gradient, could be an inaccurate procedure in the presence of noise and low modulation of fringes. This is not the case for the Fourier-based methods [21, 22]; however, as in the case of the Windowed Fourier transform technique, several parameters have to be adjusted depending on the particular image and it may require a long processing time.

In the field of phase recovery from fringe images, there have been a lot of researches along the last decades. For the case of phase-shifting algorithms, outstanding summaries of them can be found in [2, 26]. For the case of spatial and frequency domain methods from a single pattern image, two of the most popular techniques are the well-known Fourier Transform method reported by Takeda et al. [27] and the Synchronous detection method [28]. Other methods that use the regularization theory were also proposed [29, 30]. However, although these methods are efficient and easy to implement, they are limited to be used in fringe images with frequency carrier, which just in few experimental situations these kinds of images can be obtained. In most cases, experimental conditions in optical measurement techniques yields fringe images without a dominant frequency (i.e., closed fringes) which becomes the phase recovery problem difficult, therefore more complicated algorithms must be used. One of the first proposals for phase demodulation from single closed fringe images was reported by Kreis using a Fourier based approach [31]. In the last decade of the twentieth century, it was a boom in the research of closed fringe images, specially using the regularization theory. The Regularized phase-tracking technique was reported by Servín et al. [32]. Marroquín et al. reported the regularized adaptive quadrature filters [33] and the regularization method that uses the local orientation of fringes [34]. At the beginning of this century, Larkin et al. proposed the spiral-phase quadrature transform [35] and Servín et al. reported the General n-dimensional quadrature transform [36]. Also, we proposed the orientational vector-field-regularized estimator to demodulate closed fringe images [37].

As will be shown, closed fringe and wrapped-phase images have certain characteristics that make them to be treated in a special manner. First, it is common that this kind of images present structures with high anisotropy at the same time that many frequencies are dispersed over the entire image. For these reasons, in most situations, the use of linear-translation-spatial (LTI) filters, which are spatially invariant and independent of image content, do not give proper results. Furthermore, owing that the Fourier transform is a global operation, this technique is not always suitable for accurately model the local characteristics of closed fringe images.

It is widely known that the wavelet transform is a powerful tool that provides local, sparse, and decorrelated multiresolution analysis of signals. In the last years, 2D wavelets have been used for image analysis as a proper alternative to the weakness of LTI filters and linear transforms as the Fourier one. In particular, it has been shown that 1-D and 2D continuous wavelet transform (CWT) using Gabor atoms is a natural choice for proper analyses of fringe images. This kind of analysis has been used for fringe pattern denoising and fringe pattern demodulation showing several advantages, for example in laser plasma interferometry [38], in shadow moiré [39, 40, 41], in profilometry [42, 43, 44], in speckle interferometry [45], in digital holography [46], and other optical measurement techniques [47, 48, 49, 50, 51, 52, 53, 54, 55].

In this chapter, the theoretical basis of fringe pattern image formation and processing is described. Also, in general, the theory and advantages of the 2D continuous wavelet transform (CWT) for fringe pattern processing is described. We also explain some of the main applications in fringe pattern processing, such as phase recovery and wrapped phase map denoising, showing some examples of applications in different optical measurement techniques.

## 2. Digital fringe patterns

### 2.1. Elements of digital fringe image processing systems

Often, a digital fringe image processing system is represented by a sequence of devices, which typically starts with an imaging system that observes the target, a digitizer system which samples and quantizes the analog information acquired by the imaging system, a digital storage device, a digital computer that process the information, and finally, a displaying system to visualize the acquired and processed information (Figure 1).

A typical imaging system is composed by an objective lens to form images in a photosensitive plane which is commonly a CCD (charge couple devices) array.

### 2.2. Fringe image formation

Fringe pattern images are present in several kinds of optical tests for the measurement of different physical quantities. Such tests are examples for the quality measurement of optical devices using optical interferometry, photoelasticity for stress analysis, or electronic speckle pattern interferometry (ESPI) for the measurement of mechanical properties of materials. The interference phenomena are usually used in many optical methods of measurement. We now describe a classical way to form a fringe pattern image using the two-wave interference.

Two-wave interference can be generated by means of several types of interferometers, and the interferograms or fringe patterns are produced by superimposing two wavefronts. An interferometer can accurately measure deformations of the wavefront of the order of the wavelength. Considering two mutually coherent monochromatic waves, as depicted in Figure 2,

where

The irradiance at a given plane perpendicular to

For simplicity, Eq. (2) is usually written in a general form as:

where

Equations (3) and (4) represent the mathematical expressions of fringe pattern images with and without fringe carrier frequency, respectively. Examples of these kinds of fringe images are shown in Figure 3.

## 3. Fringe pattern processing

### 3.1. Phase-shifting methods for phase recovery

One of the most popular methods for phase recovery is the well-known phase-shifting. This method requires a set of phase-shifted fringe patterns which are experimentally obtained in different ways depending on the optical measurement technique. For example, in interferometry the phase shifting is realized by moving some mirrors in the optical interferometer. The set of

The pointwise solution for

where

### 3.2. Phase recovery from single fringe patterns with carrier

As previously mentioned, processing fringe patterns with fringe carrier frequency may be simple to carry out. The key point in the demodulation of fringe patterns with carrier is that the total phase function

The analytic signal

where

Other technique to compute the phase from a carrier frequency fringe pattern is the synchronous detection technique [28], which is realized in the spatial domain. Using the complex notation, in this case, the analytic function

where

### 3.3. Phase recovery from single fringe patterns without carrier

As described in [34, 35, 36, 37], for the case in which

where

Also, the modulo-

where

and

### 3.4. Wrapped phase maps denoising

The unwrapping process can be, in many cases, a difficult task due to phase inconsistencies or noise. In order to understand the phase unwrapping problem of noisy phase maps, we define the wrapped and the unwrapped phase as

where

where

It can be deduced that the problem of the recovery of

If this condition is satisfied, the following relation can be established:

where

Note that

A simple way to compute the unwrapped phase

where

## 4. The 2D continuous wavelet transform for processing fringe patterns

It is clear that the phase demodulation of fringe images with carrier may be easily realized. Owing that, in this case, the fringe image may represent a quasi-stationary signal along the direction of the frequency carrier, the use of classical linear operators such as the Fourier transform may be adequate. It works well mainly for few components in the frequency domain (i.e., for narrow spectrums); however, this is not the case for many signals in the real world. This dependence is a serious weakness mainly in two aspects: the degree of automation and the accuracy of the method specially when fringes produce spread spectrums due to localized variations or phase transients. Additionally, in the case of closed fringes there may be a wide range of frequencies in all directions. Then, evidently standard Fourier analysis is inadequate for treating with this kind of images because it represents signals with a linear superposition of sine waves with “infinite” extension. For this reason, an image with closed fringes should be represented with localized components characterizing the frequency, shifting, and orientation. A powerful mathematical tool for signal description that has been developed in the last decades is the wavelet analysis. Fortunately, for our purposes, a key characteristic of this type of analysis is the finely detailed description of frequency or phase of signals. In consequence, it can have a good performance especially with fringes that produce spread spectrums. Additionally, one of the main advantages using wavelets compared with standard techniques is its high capability to deal with noise. In particular, the 2D continuous wavelet transform have recently been proposed for the processing of interferometric images. Advantages of denoising and demodulation of interferograms using the 2D CWT has been discussed in [44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55].

Considering an interferometric image (an interferogram or a wrapped-phase field)

In Eq. (23),

where

Figure 5 shows that the 2D CWT is performed along different directions and frequencies.

### 4.1. Phase recovery with the 2D CWT

Owing that fringe pattern images with closed fringes generally contain elements with high anisotropy and sparse frequency components, the phase recovery is a complex procedure. Compounding the problem, the presence of noise makes the process even more complicated because noise and fringes are mixed in the Fourier domain.

Also, it has been shown that a single fringe pattern without carrier frequency, is not easy to deal with. Owing to ambiguities in the image formation process, a main drawback analyzing them is that several solutions of the phase function can satisfy the original observed image. Therefore, it is necessary to restrict the solution space of

The following is a general description of the phase recovery method using the 2D CWT. First, it is necessary to consider a normalized version of the fringe pattern. The normalization procedure can be carried out using the method proposed in [56]. Consider we represent the normalized fringe pattern in complex form:

In this particular case, the 2D CWT of

Note that

Then, we can now rewrite Eq. (26) as

or, which is the same

The two terms in (29) contains Fourier transforms of complex periodic functions of frequencies

In this case,

To detect the analytic function and consequently compute the phase

Once detected the ridge

Figures 7 and 8 show examples of fringe pattern phase recovery using the 2D CWT method reported in [55]. It is important to remark that this method is highly robust against noise.

A big advantage of using the 2D CWT method to compute the phase from fringe patterns without carrier is that the sign ambiguity of

### 4.2. The 2D CWT for wrapped phase maps denoising

Other of the most relevant tasks in fringe pattern processing is the wrapped phase maps denoising. Owing that the phase unwrapping is a key step in fringe pattern processing for optical measurement techniques, the previous denoising of the wrapped phase is crucial for a proper measurement. Several optical measurement techniques, such as the electronic speckle pattern interferometry, use different phase recovery methods, inherently produces highly noisy wrapped phase maps. In these situations, the phase map denoising is a crucial pre-process for a successful phase unwrapping. Considering the problem of denoising wrapped phase maps, the drawback is that owing to

where

Following the same reasoning to obtain Eq. (30), for this case, we obtain:

The difference of this equation with the result shown in Eq. (30) is that at each

Figures 10 and 11 are examples of the results applying the 2D CWT in wrapped phase map denoising. Note the outstanding performance removing the structures due to the gratings in the experimentally obtained wrapped phase map with moire deflectometry (Figure 11).

The key step in the 2D CWT method for phase map denoising is the ridge detection. In this way, all the coefficients in the

2D-CWT | WFT | LFT |
---|---|---|

0.0692 | 0.0521 | 0.0747 |

## 5. Conclusions

It can be obviously deduced that often fringe patterns contain elements with high anisotropy, sparse frequency components, and noise, which makes the processing of this kind of images by means of classical LTI methods inadequate. Several authors have shown that the use of multiresolution analysis by means of the 2D CWT for processing fringe patterns has resulted a proper and interesting alternative for this task. The 2D CWT methods present some attractive advantages compared with other commonly used techniques. (1) The use of the Gabor mother wavelet for processing this kind of images is a natural choice to model them, as can be obviously deduced analyzing the physical theory of fringe image formation. (2) In most classical methods for processing fringe images, the previous estimation of the fringe direction or orientation is a must, especially for fringe patterns without a fringe carrier frequency. Owing that the multiresolution analysis using the 2D CWT methods models the image by means of the angle

## References

- 1.
Malacara D. Optical Shop Testing. Third ed. Hoboken: Wiley-Interscience; 2007 - 2.
Malacara D, Servín M, Malacara Z. Interferogram Analysis for Optical Testing. Second ed. Boca Raton: Taylor and Francis; 2005 - 3.
Cloud G. Optical Methods of Engineering Analysis. New York: Cambridge University Press; 1995 - 4.
Sirohi S. Optical Methods of Measurement, Wholefield Techniques. Second ed. Boca Raton: CRC Press; 2009 - 5.
Leach R. Optical Measurement of Surface Topography. Berlin, Heidelberg: Springer-Verlag, Springer; 2011 - 6.
Servín M, Quiroga JA, Padilla JM. Fringe Pattern Analysis for Optical Metrology. Weinheim: Wiley-VCH; 2014 - 7.
Ghiglia DC, Pritt MD. Two Dimensional Phase Unwrapping. New York: John Wiley & Sons, Wiley-Interscience; 1998 - 8.
Yu Q, Liu X, Andresen K. New spin filters for interferometric fringe patterns and grating patterns. Applied Optics. 1994; 33 :3705-3711 - 9.
Yu Q, Liu X, Sun X. Generalized spin filtering and improved derivative-sign binary image method for extraction of fringe skeletons. Applied Optics. 1998; 37 :4504-4509 - 10.
Yu Q, Sun X, Liu X, Qiu Z. Spin filtering with curve windows for interferometric fringe patterns. Applied Optics. 2002; 41 :2650-2654 - 11.
Villa J, Quiroga JA, de la Rosa I. Directional filters for fringe pattern denoising. SPIE Proceedings. 2009; 7499 :74990B - 12.
Tang C, Gao T, Yan S, Wang L, Wu J. The oriented spatial filter masks for electronic speckle pattern interferometry phase patterns. Optics Express. 2010; 18 :8942-8947 - 13.
Tang C, Zhang F, Yan H, Chen Z. Denoising in electronic speckle pattern interferometry fringes by the filtering method based on partial differential equations. Optics Communication. 2006; 260 :91-96 - 14.
Tang C, Han L, Ren H, Zhou D, Chang Y, Wang X, Cui X. Second-order oriented partial-differential equations for denoising in electronic-speckle-pattern interferometry fringes. Optics Letters. 2008; 33 :2179-2181 - 15.
Tang C, Han L, Ren H, Gao T, Wang Z, Tang K. The oriented-couple partial differential equations for filtering in wrapped phase patterns. Optics Express. 2009; 17 :5606-5617 - 16.
Cheng L, Tang C, Yan S, Chen X, Wang L, Wang B. New fourth-order partial differential equations for filtering in electronic speckle pattern interferometry fringes. Optics Communication. 2011; 284 :5549-5555 - 17.
Xu W, Tang C, Gu F, Cheng J. Combination of oriented partial differential equation and shearlet transform for denoising in electronic speckle pattern interferometry fringe patterns. Applied Optics. 2017; 56 :2843-2850 - 18.
Zhang F, Xiao Z, Wu J, Geng L, Li H, Xi J, Wang J. Anisotropic coupled diffusion filter and binarization for the electronic speckle pattern interferometry fringes. Optics Express. 2012; 20 :21905-21916 - 19.
Villa J, Quiroga JA, De la Rosa I. Regularized quadratic cost function for oriented fringe-pattern filtering. Optics Letters. 2009; 34 :1741-1743 - 20.
Villa J, Rodríguez-Vera R, Antonio Quiroga JA, De la Rosa I, González E. Anisotropic phase-map denoising using a regularized cost-function with complex-valued Markov-random-fields. Optics and Lasers in Engineering. 2010; 48 :650-656 - 21.
Li C, Tang C, Yan H, Wang L, Zhang H. Localized Fourier transform filter for noise removal in electronic speckle pattern interferometry wrapped phase patterns. Applied Optics. 2011; 50 :4903-4911 - 22.
Kemao Q. Two-dimensional windowed Fourier transform for fringe pattern analysis: Principles, applications and implementations. Optics and Lasers in Engineering. 2007; 45 :304-317 - 23.
Wang H, Kemao Q, Gao W, Lin F, Seah HS. Fringe pattern denoising using coherence enhancing diffusion. Optics Letters. 2009; 34 :1141-1143 - 24.
Fu S, Zhang C. Fringe pattern denoising via image decomposition. Optics Letters. 2012; 37 :422-425 - 25.
Zhou X, Yang T, Zou H, Zhao H. Multivariate empirical mode decomposition approach for adaptive denoising of fringe patterns. Optics Letters. 2012; 37 :1904-1906 - 26.
Servín M, Estrada JC, Quiroga JA. The general theory of phase shifting algorithms. Optics Express. 2009; 17 :21867-21881 - 27.
Takeda M, Ina H, Kobayashi S. Fourier-transform method of fringe-pattern analysis for computer-based topography and interferometry. Applied Optics. 1982; 72 :156-160 - 28.
Womack KH. Interferometric phase measurement using spatial synchronous detection. Optical Engineering. 1984; 23 :391-395 - 29.
Marroquin JL, Figueroa JE, Servín M. Robust quadrature filters. JOSA-A. 1997; 14 :779-701 - 30.
Villa J, Servín M, Castillo L. Profilometry for the measurement of 3-D object shapes based on regularized filters. Optics Communications. 1999; 161 :13-18 - 31.
Kreis T. Digital holographic interference-phase measurement using the Fourier-transform method. JOSA-A. 1986; 3 :847-855 - 32.
Servín M, Marroquín JL, Cuevas FJ. Demodulation of a single interferogram by use of a two-dimensional regularized phase-tracking technique. Applied Optics. 1997; 36 :4540-4548 - 33.
Marroquín JL, Servín M, Rodríguez-Vera R. Adaptive quadrature filters and the recovery of phase from fringe pattern images. JOSA-A. 1997; 14 :1742-1753 - 34.
Marroquín JL, Rodríquez-Vera R, Servín M. Local phase from local orientation by solution of a sequence of linear systems. JOSA-A. 1998; 15 :1536-1544 - 35.
Larkin KG, Bone DJ, Oldfield MA. â€˜Natural demodulation of two-dimensional fringe patterns. I. General background of the spiral phase quadrature transform. JOSA-A. 2001; 18 :1862-1870 - 36.
Servín M, Quiroga JA, Marroquín JL. General n-dimensional quadrature transform and its application to interferogram demodulation. JOSA-A. 2003; 20 :925-934 - 37.
Villa J, de la Rosa I, Miramontes G, Quiroga JA. Phase recovery from a single fringe pattern using an orientational vector-field-regularized estimator. JOSA-A. 2005; 22 :2766-2773 - 38.
Tomassini P, Giulietti A, Gizzi LA, Galimberti M, Giulietti D, Borghesi M, Willi O. Analyzing laser plasma interferograms with a continuous wavelet transform ridge extraction technique: The method. Applied Optics. 2001; 40 :6561-6568 - 39.
Liu H, Cartwright AN, Basaran C. Sensitivity improvement in phase-shifted moiré interferometry using 1-D continuous wavelet transform image processing. Optical Engineering. 2003; 42 :2646-2652 - 40.
Liu H, Cartwright AN, Basaran C. Moiré interferogram phase extraction: A ridge detection algorithm for continuous wavelet transforms. Applied Optics. 2004; 43 :850-857 - 41.
Tay CJ, Quan C, Fu Y, Huang Y. Instantaneous velocity displacement and contour measurement by use of shadow moiré and temporal wavelet analysis. Applied Optics. 2004; 43 :4164-4171 - 42.
Quan C, Fu Y, Tay CJ, Tan JM. Profiling of objects with height steps by wavelet analysis of shadow moiré fringes. Applied Optics. 2005; 44 :3284-3290 - 43.
Zhong J, Weng J. Phase retrieval of optical fringe patterns from the ridge of a wavelet transform. Optics Letters. 2005; 30 :2560-2562 - 44.
Gdeisat MA, Burton DR, Lalor MJ. Spatial carrier fringe pattern demodulation by use of a two-dimensional continuous wavelet transform. Applied Optics. 2006; 45 :8722-8732 - 45.
Niu H, Quan C, Tay C. Phase retrieval of speckle fringe pattern with carrier using 2D wavelet transform. Optics and Lasers in Engineering. 2009; 47 :1334-1339 - 46.
Weng J, Zhong J, Hu C. Phase reconstruction of digital holography with the peak of the two-dimensional Gabor wavelet transform. Applied Optics. 2009; 48 :3308-3316 - 47.
Li S, Su X, Chen W. Wavelet ridge techniques in optical fringe pattern analysis. JOSA-A. 2010; 27 :1245-1254 - 48.
Ma J, Wang Z, Pan B, Hoang T, Vo M, Lu L. Two-dimensional continuous wavelet transform for phase determination of complex interferograms. Applied Optics. 2011; 50 :2425-2430 - 49.
Ma J, Wang Z, Vo M. Hybrid two-dimensional continuous wavelet transform for analysis of phase-shifted interferograms. Optics Communication. 2012; 285 :3917-3920 - 50.
Wang Z, Ma J, Vo M. Recent progress in two-dimensional continuous wavelet transform technique for fringe pattern analysis. Optics and Lasers in Engineering. 2012; 50 :1052-1058 - 51.
Watkins LR. Review of fringe pattern phase recovery using the 1-D and 2-D continuous wavelet transforms. Optics and Lasers in Engineering. 2012; 50 :1015-1022 - 52.
Zhang Z, Jing Z, Wang Z, Kuang D. Comparison of Fourier transform, windowed Fourier transform, and wavelet transform methods for phase calculation at discontinuities in fringe projection profilometry. Optics and Lasers in Engineering. 2012; 50 :1152-1160 - 53.
Escalante N, Villa J, de la Rosa I, de la Rosa E, González-Ramirez E, Gutierrez O, Olvera C, Araiza M. 2-D continuous wavelet transform for ESPI phase-maps denoising. Optics and Lasers in Engineering. 2013; 51 :1060-1065 - 54.
Ma J, Wang Z, Pan B. Two-dimensional continuous wavelet transform algorithm for phase extraction of two-step arbitrarily phase-shifted interferograms. Optics and Lasers in Engineering. 2014; 55 :205-211 - 55.
Villa J, de la Rosa I, Ivanov R, Alaniz D, González E. Demodulation of single interferograms using a sliding 2-D continuous wavelet transform method. Journal of Modern Optics. 2015; 62 :633-637 - 56.
Quiroga JA, Gómez-Pedrero JA, García-Botella A. Algorithm for fringe pattern normalization. Optics Communication. 2001; 197 :43-51