In this study, a new inversion method is presented for performing two-dimensional (2D) Fourier transform. The discretization of the continuous Fourier spectra is given by a series expansion with the scaled Hermite functions as square-integrable set of basis functions. The expansion coefficients are determined by solving an overdetermined inverse problem. In order to define a quick algorithm in calculating the Jacobian matrix of the problem, the special feature that the Hermite functions are eigenfunctions of the Fourier transformation is used. In the field of inverse problem theory, there are numerous procedures for noise rejection, so if the Fourier transformation is formulated as an inverse problem, these tools can be used to reduce the noise sensitivity. It was demonstrated in many case studies that the use of Cauchy-Steiner weights could increase the noise rejection capability of geophysical inversion methods. Following this idea, the two-dimensional Fourier transform is formulated as an iteratively reweighted least squares (IRLS) problem using Cauchy-Steiner weights. The new procedure is numerically tested using synthetic data.
- noise rejection in Fourier transformation
- series expansion–based inversion
- robust Fourier transformation
- Hermite functions
- reduction to pole
In signal processing, the frequency spectrum of the time domain signals plays a very important role. In order to change over from the time domain to the frequency domain, the Fourier transform is applied most frequently. In the case of equidistantly sampled discrete time domain data sets, the so-called discrete Fourier transform (DFT) algorithm is used to determine the discrete frequency spectrum. In the numerically very efficient Fast Fourier Transform algorithm (FFT), the spectrum is determined by solving a complete set of inhomogeneous linear algebraic set of equations.
The measured data set always contains noise, which is linearly projected into the frequency domain during Fourier transformation, so the traditional FT algorithms are sensitive to noise, most significantly to non-Gaussian one. On the other hand, it is well-known that in the framework of inverse problem theory there are a collection of methods with excellent noise rejection capability. For this reason, it was proposed to handle the 1D Fourier Transform as an overdetermined inverse problem .
In inverse problem theory, it is known that the simple least squares (LSQ) method gives optimal solution in case of Gaussian data noises while it is very sensitive for outliers. To reduce the effect of outlying data various (robust) inversion methods have been developed. The least absolute deviation (LAD) is one of the most frequently applied robust inversion method, which can be numerically realized by linear programing or by using the so-called iteratively reweighted least squares (IRLS) procedure . In this case, the L1 norm of the deviation between the observed and predicted data is minimized. The IRLS procedure which iteratively recalculates the so-called Cauchy weights results in a very efficient robust inversion method . In applying Cauchy inversion, the scale parameter of the Cauchy weights should be
In previous papers by Szegedi and Dobróka , the 1D Fourier transformation was handled as robust inverse problem using IRLS algorithm with Cauchy-Steiner weights. It was shown that the noise sensitivity of the continuous Fourier transform (and its discrete variants DFT and FFT) was appropriately reduced by using robust inversion. Following a fruitful inversion strategy developed at the Geophysical Department of the University of Miskolc we used series expansion as a discretization tool. Series expansion–based inversion methods were successfully used in the interpretation of borehole geophysical data [10, 11] and also in processing induced polarization data . In this study, we further develop the previously published inversion-based 1D Fourier transform algorithm by extending it to 2D cases.
2. Theoretical background for 1D algorithm
The Fourier transform and its inverse allow establishing a connection between the time and frequency domain. For the one-dimensional case the Fourier transform is defined as
where denotes the time, is the angular frequency and is the imaginary unit, is the Fourier transform of a real-valued time function . Thus, the Fourier transform provides the frequency domain representation of a phenomenon investigated by the measurement of some quantity in the time domain. By means of the inverse Fourier transform
we can return from the frequency domain to the time domain.
A next step in formulating the Fourier transform as an inverse problem is the discretization of the frequency spectrum . In order to satisfy this requirement, let us assume that is approximated with sufficient accuracy by using a finite series expansion
where the parameter is a complex valued expansion coefficient and is a member of an accordingly chosen set of real valued basis functions.
Using the terminology of (discrete) inverse problem theory, the theoretical values of time domain data (forward problem) can be given by the inverse Fourier transform
where is the
Let us introduce the notation
where is an element of the so called Jacobian matrix of the size
The parameterization is always an important step in constructing an inversion algorithm. In Fourier transformation the frequency spectrum is defined over the interval (−∞,∞), so the set of basis functions should be defined in the same domain. In addition, the use of orthonormal functions for the series expansion is also proposed to the parameterization of the model. Because of these reasons we have chosen the set of scaled Hermite functions for discretization (their square-integrability ensures the existence of their Fourier transform).
If one tries to extend the concept of inversion-based Fourier transform for two-dimensional (2D) (or even multidimensional) case, a quick and simpler way of calculation can be advantageous. For this reason, consider the basic formulae of Hermite polynomials and Hermite functions.
The basic Hermite polynomials can be defined by the Rodriguez formula
and also can be generated by the recursive formula
where , . The Hermite polynomials fulfill the orthogonality condition
where denotes the Kronecker symbol. Based on this formula, the basic Hermite functions can be defined as
Afterward the function is not only a complete orthogonal but an orthonormal system
There is an important special feature of Hermite functions, namely that they are the eigenfunctions of the Fourier transform 
and for the inverse Fourier transform, respectively
As it was given in reference , the Hermite functions have to be modified by scaling because in geophysical applications the frequency covers wide ranges. The Rodriguez formula for modified Hermite polynomials takes the form
and can be also generated by the recursive formula
where is the scale factor and , . The normalizing equation is
Thus, the scaled Hermite functions can be defined as
In this case the normalizing equation is
Introducing the notation the modified Hermite polynomials can be traced back to the base polynomials. Substituting into Eq. (15) we obtain
Similarly, the modified Hermite function can also be traced back to the basic case (). According to Eq. (18), we get the following formula
Expanding the spectrum by means of the modified Hermite functions, in accordance with Eq. (6) the Jacobian matrix can be written as the inverse Fourier transform of the basis functions
Using Eq. (21) one finds
or taking the notations , and into account we have
Using the properties of the base Hermite functions from Eq. (14) Eq. (24) can be rewritten in the following form
This is a very important result in further developing the inversion-based Fourier transform method because the Jacobian matrix can be produced quickly, as the procedure do not require integration. This is especially important in case of 2D (or higher dimensional) Fourier transform.
In accordance with Eq. (7) the theoretical data can be obtained as a linear expression of the expansion coefficients using the easily calculated elements of the Jacobian matrix. The general element of the deviation vector can be given in the following form
In the framework of inverse problem theory, various methods are given for the minimization of appropriately chosen norm of the deviation vector resulting in an estimation of the expansion coefficients (). After this, the real and imaginary part of the estimated spectrum can be calculated at any frequency as
3. Theoretical background for 2D algorithm
For the two-dimensional case the Fourier transform is defined as
where denotes the spatial coordinates, are the (angular) spatial frequencies and is the imaginary unit. The frequency spectrum is the Fourier transform of a real valued function and it is generally a complex valued continuous function. In two dimensions the forward problem giving the theoretical values of the space domain data can be defined by the two-dimensional inverse Fourier transform
where denotes the 2D spatial frequency spectrum, which will be discretized using the scaled Hermite functions defined above
Using Eq. (29) the data calculated at the point
where , denote the sequence numbers of the measurement points along the
Similar to Eq. (21)
and the Jacobian takes the form
Using the notations
we can write
and applying the well-known Eq. (14), the Jacobian matrix can be written in its final form (without integration)
The programming of the algorithm is quite simple after using the transformation of the indices , . With these notations, the total number of the unknown expansion coefficient is and that of the measured data is . The theoretical data can be calculated as
and the general element of the deviation vector can be given in the following form
with . After this, the inverse problem can be formulated in a straightforward manner.
4. Inversion algorithms
If the measured data set contains Gaussian noise, the minimization of the L2 norm of the deviation vector is applied. This is the case of the least squares method when
is minimized resulting in the well-known set of the normal equations
By solving these normal equations, we can give an estimate for the complex expansion coefficients, and both the real and imaginary parts of the LSQ estimated Fourier transform (LSQ-FT) can be calculated at any frequency by using
As is well-known, the least squares method gives optimal results only when the data-noise follows Gaussian distribution. This distribution seldom occurs in practice so other norms of the deviation vector are introduced. In order to define a robust inversion algorithm, the minimization of the weighted norm
with the so-called Cauchy weights
is suggested (here is an accordingly chosen positive number). Using this norm for the solution of inverse problems provides reliable results even if the input data sets contain outliers .
There is a problem with inversion procedures involving Cauchy weights, namely the scale parameter should be
where the starting value in the 0th step is given as
The stop criterion can be defined on an experimental basis (for example, a fixed number of iterations). After this the Cauchy weights are modified by using the (Steiner’s) scale parameter (Cauchy-Steiner weights)
In the case of Cauchy-Steiner weights the misfit function given in Eq. (46) is nonquadratic (because contains the unknown expansion coefficients) and so the inverse problem is nonlinear which can be solved again by applying the method of the iteratively reweighted least squares . In the framework of this algorithm a 0th order solution is derived by using the (nonweighted) LSQ method and the weights are calculated as
with , where and the expansion coefficients are given by the LSQ method. In the first iteration the misfit function
is minimized resulting in the linear set of normal equations
of the (linear) weighted least squares method where the weighting matrix (independent of ) is of the diagonal form . Solving Eq. (53) one finds
The minimization of the new misfit function
gives which serves again for the calculation of . This procedure is repeated giving the typical
with the weighting matrix
(Here we note that each step of these iterations contain an internal loop for the determination of the Steiner’s scale parameter.) This iteration is repeated until a proper stop criterion is met.
5. Numerical investigations
In order to test our inversion-based Fourier transform we generated a 2D data set in a rectangular test area of the size [−1,1] units in both
To test the outlier sensitivity of the Fourier transformation algorithms, the noisy data set I was generated, in which random noise of Cauchy distribution (with 0 location and 0.02 scale parameters) were added to the noise-free data set shown in Figure 1. Data set I containing outliers is shown in Figure 3 and its DFT (amplitude) spectrum is shown in Figure 4. It can be seen that compared to Figure 2 the DFT spectrum is highly distorted proving a sufficient noise sensitivity to the traditional DFT.
For quantitative characterization of the results we introduce the RMS distance between two data sets (for example noisy and noiseless) as
in the space domain (are relevant numbers of data point in the 2D test area) and the model distance
in the spatial frequency domain (are relevant numbers of data points). The distance between the noisy and noiseless data sets is
If we apply our inversion based (IRLS-FT) method for the same noisy data set we get an estimated spectrum shown in Figure 5. Compared to the DFT spectrum (Figure 4) this figure represents sufficient improvement characterized by the model distance between the noiseless and the noisy (given by IRLS-FT) spectra:
It is well known that DFT and inverse DFT sequentially retrieve the noisy input data set exactly. In our inversion-based robust Fourier transform method we solve an overdetermined set of equations. In this case, it is important to see the space domain data set given by the inverse Fourier transform of the IRLS-FT spectrum. This is the so-called calculated data introduced previously in defining the IRLS-FT algorithm
The result is shown in Figure 6. Compared to the noisy data set, the new inversion-based Fourier transform method has appreciable noise rejection capability. This is characterized by the data distance between the noiseless data set and the space domain data calculated by the IRLS-FT method:
The Fourier transformation is widely used in solving scientific or technical problems. Here we present a geophysical application in the field of processing geomagnetic data set. It is well known that the magnetic field has generally dipolar nature. It means that a magnetic body (i.e., wall fragments buried with soil in an archeo-geophysical measurement) usually produces doubled anomaly (positive and negative) in the magnetic map depending on the geographical position of the measurement area. The only exceptions are the northern and the southern magnetic poles of the Earth and the magnetic equator. In order to simplify the interpretation of magnetic maps an elegant way was developed: the reduction to pole. This is a transformation resulting a magnetic data set that one would measure above the same magnetic body on the north (or southern) pole.
In order to apply our robust 2D IRLS-FT method a synthetic data set was generated. The measurement area was defined on the surface between (-100, 100) m in both of
where is the 2D Fourier transform of the magnetic data set, is the frequency domain operator of the pole reduction. The reduced data set in space domain can be found by inverse Fourier transformation of the data set. This is shown in Figure 8 using noise-free magnetic data and the traditional DFT in 2D Fourier transformation.
In order to simulate noisy data set the magnetic data were contaminated with random noise following Cauchy distribution. The noisy data set and the result of pole reduction (using again the traditional DFT) is shown in Figures 9 and 10. It can be seen, that the pole reduction is highly distorted, which is caused by the low noise reduction capability of the 2D DFT algorithm proved in the previous chapter.
In contrary, the result of reduction to pole with the use of our new inversion-based 2D Fourier transformation algorithm is presented in Figure 11. In this case, we used Hermite function with 900 unknown expansion coefficients (considering the number of data, the inverse problem is sufficiently overdetermined). Figure 11 demonstrates high noise reduction capacity (compared to Figure 10, where the traditional 2D DFT was used for Fourier transformation). It can be seen that the pole-reduced data set is close to that shown in Figure 8 (noise-free data), and the limits of magnetization data are [0,250] in both cases. The result proves the successful applicability of our inversion-based 2D IRLS-FT algorithm.
We presented a new algorithm for the 2D Fourier transform. Our purpose was to increase the noise rejection capacity of the Fourier transform. To do this, we applied the tools of inverse problem theory. In order to discretize the continuous function of the complex spectrum, series expansion was used. It was shown, that the Jacobian matrix of the inverse problem can be written as the inverse FT of the basis functions used in the discretization. Because of this reason Hermite functions were chosen as they are eigenfunctions of the Fourier transformation. This selection gave the possibility of very quick computation of the Jacobian even in 2D problems.
The unknown parameters (series expansion coefficients) are determined by solving an overdetermined inverse problem. For having a robust 2D FT method Cauchy-Steiner weights were applied in a robust iteratively reweighted least squares algorithm. In order to characterize the accuracy and the noise rejection capacity of the new Fourier Transform method we made numerical test using synthetic data sets containing random noise of Cauchy distribution and the characteristic distance between spectra calculated by means of noisy data as well as noise-free ones was calculated. It was shown that compared to the traditional DFT the characteristic distances were reduced by a factor of 6–7 so the noise reduction capability of the new inversion-based Fourier transform method (for abbreviation we used IRLS-FT) was clearly demonstrated.
Fourier transformation is widely used in science and techniques, so the new robust 2D Fourier transform method seems to be applicable on various fields of data processing dealing with noisy data sets, especially those containing outliers. As an example, we presented its application in reduction to pole, which is a frequently used operation in the interpretation of geomagnetic data sets. By our experience, the new method shows sufficient noise rejection capability compared to the traditional reduction to pole algorithm using the well-known DFT.
It was shown that considering the 2D Fourier transformation as an overdetermined inverse problem could result in a procedure with increased noise rejection capability. In order to find a robust method the iteratively reweighted least squares procedure using Cauchy-Steiner weights is proposed. In the framework of the new inversion-based FT method series expansion is used for discretization of the complex Fourier spectrum. The procedure is relatively quick, due to the appropriate choice of the set of basis function: the Hermite functions are involved, as they are eigenfunctions of the Fourier transformation.
The research was supported by the National Research Development and Innovation Office (project no. K109441) and by the GINOP-2.3.2-15-2016-00010 "Development of enhanced engineering methods with the aim at utilization of subterranean energy resources" project in the framework of the Széchenyi 2020 Plan, funded by the European Union, co-financed by the European Structural and Investment Funds.
Dobróka M, Szegedi H, Vass P, Turai E. Fourier transformation as inverse problem—an improved algorithm. Acta Geodaetica et Geophysica Hungarica. 2012; 47(2):185–196. DOI: 10.1556/AGeod.47.2012.2.7
Scales JA, Gersztenkorn A, Treitel S. Fast Lp solution of large, sparse, linear systems: application to seismic travel time tomography. Journal of Computational Physics. 1988; 75:314–333.
Amundsen L. Comparison of the least-squares criterion and the Cauchy criterion in frequency-wavenumber inversion. Geophysics. 1991; 56:2027–2038.
Steiner F. Most frequent value procedures (a short monograf). Geophysical Transactions. 1988; 34:139–260.
Steiner F. Optimum methods in statistics. Budapest: Academic Press; 1997.
Dobróka M, Gyulai A, Ormos T, Csókás J, Dresen L. Joint inversion of seismic and geoelectric data recorded in an under-ground coal mine. Geophysical Prospecting. 1991; 39:643–665.
Szűcs P, Civan F, Virág M. Applicability of the most frequent value method in groundwater modelling. Hydrogeology Journal. 2006; 14:31–43. DOI: 10.1007/s10040-004-0426-1
Dobróka M, Szegedi H. On the generalization of seismic tomography algorithms. American Journal of Computational Mathematics. 2014; 4(1):37–46. DOI: 10.4236/ajcm.2014.41004
Szegedi H, Dobróka M. On the use of Steiner’s weights in inversion-based Fourier transformation: robustification of a previously published algorithm. Acta Geophysica. 2014; 49(1):95–104. DOI: 10.1007/s40328-014-0041-0
Szabó NP. Shale volume estimation based on the factor analysis of well-logging data. Acta Geophysica. 2011; 59(5):935–953. DOI: 10.2478/s11600-011-0034-0
Szabó NP. Hydraulic conductivity explored by factor analysis of borehole geophysical data. Hydrogeology Journal. 2015; 23(5):869–882. DOI: 10.1007/s10040-015-1235-4
Turai E. Data processing method developments using TAU-transformation of time-domain IP data II. Interpretation results of field measured data. Acta Geodaetica et Geophysica Hungarica. 2011; 46:391–400.
Duoandikoetxea J. Fourier Analysis. Graduate studies in Mathematics. Rhode Island: American Mathematical Society 29. Providence; 1995.
Vass P. Random noise reduction capability of the hermit polynomial based least squares Fourier transform method. Acta Geodaetica et Geophysica Hungarica. 2012; 47:328–343.
Gröbner W, Hoffreiter N. Integraltafel. Zweiter Teil. Bestimmte Integrale. Wien und Innsbruck: Springer-Verlag; 1958.
Kunaratnam K. Simplified expressions for the magnetic anomalies due to vertical rectangular prisms. Geophysical Prospecting. 1981; 29:883–890.