Values at node points (a) linear spline, (b) quadratic B-spline, and (c) cubic B-spline.
In this Chapter, continuous Haar wavelet functions base and spline base have been discussed. Haar wavelet approximations are used for solving of differential equations (DEs). The numerical solutions of ordinary differential equations (ODEs) and fractional differential equations (FrDEs) using Haar wavelet base and spline base have been discussed. Also, Haar wavelet base and collocation techniques are used to approximate the solution of Lane-Emden equation of fractional-order showing that the applicability and efficacy of Haar wavelet method. The numerical results have clearly shown the advantage and the efficiency of the techniques in terms of accuracy and computational time. Wavelet transform studied as a mathematical approach and the applications of wavelet transform in signal processing field have been discussed. The frequency content extracted by wavelet transform (WT) has been effectively used in revealing important features of 1D and 2D signals. This property proved very useful in speech and image recognition. Wavelet transform has been used for signal and image compression.
- Haar wavelet
- continuous wavelet function
- wavelet transform
- B-cubic spline base
Wavelets are special mathematical functions which have advantages over traditional Fourier methods in analyzing physical situations where the signal contains discontinuities and sharp spikes. The fields of applied mathematics such as quantum physics, seismic geology and electrical engineering have used and developed independently wavelets during last twenty years ago which leads to new wavelet applications such as image compression, radar, and earthquake prediction. Haar wavelet was initiated and independently developed by some authors. Wavelets can be summarized as a family of functions constructed from transformation and dilation of a single function called mother wavelet. From various types of continuous and discrete wavelets, Haar wavelet is the discrete type of wavelet which was first proposed and the first orthonormal wavelet basis is the Haar basis. Differential equations (DEs) are most important tools in mathematical models for physical phenomena. Many basis used to approximate the solutions of DEs. Haar wavelet is simple basis used to approximate the solution of DEs.  established a simple numerical method based on Haar wavelet operational matrix of integration for solving two dimensional elliptic partial differential equations (PDEs) of the form ,  used Haar wavelet operational matrix for the numerical solutions of FrDEs,  used Haar wavelet-quasi linearization technique for FrDEs,  used Haar wavelet method for solving FrPDEs numerically,  applied Haar wavelet transform to solve integral equations (IEs) and DEs,  solved 2D and 3D Poisson equations and biharmonic equations by the Haar wavelet method while  presented a numerical method for inversion of Laplace transform using the method of Haar wavelet operational matrix. The implementations of FrDEs which are used as mathematical models in many physically significant fields and applied science. Recently, the approximated solutions of the FrDEs have been studied using Haar wavelet method which shows to be more suitable to approximate the solutions of them. Nowadays, Haar wavelets are most widely and simplest due to their simplicity, the Haar wavelets are effective tools for approximating solutions of DEs. When this type of problem arises, mainly approximated solutions come to be available. From the many approximated methods, Haar wavelet approach is one to find the solutions of DEs. If the approximated solution gives less error than other methods, then, the method be an efficient method. However, one of interesting applications of wavelets bases is the approximation of DEs. Also, Haar wavelet technique is used to approximate the solutions of DEs of fractional-order. Wavelet transform is a mathematical approach widely used for signal processing applications. It can decompose special patterns hidden in mass of data. Wavelet transform has the advantage to simultaneously display functions and manifest their local characteristics in time-frequency domain. Wavelet transforms have had tremendous impact on the fields of signal processing, signal coding, estimation, pattern recognition, applied sciences, process systems engineering, econometrics, and medicine. Wavelet transforms are mainly divided into two groups; continuous wavelet transform (CWT) and discrete wavelet transform (DWT). The discretization of a voice transform generated by a representation of the Blaschke group on the Hardy space of the unit disk leads to the construction of analytic rational orthogonal wavelets. In this chapter, we introduce the concept of continuous wavelet functions together to the approximations solutions of DEs with ordinary- or fractional-order using Haar wavelet functions. Also, a comparison between Haar wavelet base with cubic spline base has been introduced. Wavelet transform as a mathematical approach has been discussed together to the applications of wavelet transform in signal.
1.1 Objectives of chapter
This chapter aims at achieving the following objectives:
To introduce continuous wavelet functions.
To use Haar wavelet approximations in solving of differential equations (DEs).
To imply Haar wavelet functions to approximate the solutions of DEs of fractional-order.
To compare Haar wavelet base with cubic spline base.
To study wavelet transform as a mathematical approach.
To discuss the discrete wavelet transform (DWT).
To study the applications of wavelet transform in signal processing field.
1.2 Scope of study
This chapter entailed the studying of continuous wavelet functions and Haar wavelet approximations. Wavelet transform introduced as a mathematical approach with some of applications of wavelet transform which is widely used in signal processing field. The approximation of DEs using Haar wavelet base was implemented with comparing to B-cubic spline base.
In this section, we introduce the definitions of two types of continues Haar wavelet functions and linear, quadratic and cubic spline functions base.
2.1 Continues Haar wavelet functions
Haar functions have been introduced by Hungarian mathematician. The orthogonal set of Haar functions is defined as a square waves with magnitude of in some interval and zero elsewhere. The first curve is that during the whole interval . The second curve is the fundamental square wave, or mother wavelet which also spans the whole interval . All the other subsequent curve are generated from with two operation translation and dilation. Haar wavelet functions defined as follows on .
for and We say that is mother function and for In general, we have the following: where Note that:
To approximate using Haar functions consider .
All Haar wavelets are orthogonal to each other:
2.2 Spline functions
The spline is used to refer to a wide class of smooth functions that are used in applications requiring data interpolation [9, 10]. The data may be either one-dimensional or multi-dimensional. Spline functions for interpolation are normally determined as the minimizers of suitable measures of roughness (for example integral squared curvature) subject to the interpolation constraints. Smoothing splines may be viewed as generalizations of interpolation splines where the functions are determined to minimize a weighted combination of the average squared approximation error over observed data and the roughness measure. For a number of meaningful definitions of the roughness measure, the spline functions are found to be finite dimensional in nature, which is the primary reason for their utility in computations and representation. For the rest of this section, the focus is entirely on one-dimensional, polynomial splines and the use of the term spline in this restricted sense. The base is called spline base of order if the basis functions satisfy for First of all, we partition by choosing a positive integer and defining This produces the equally-spaced nodes , for each We then define the basis functions on the interval .
2.2.1 Linear spline
The simplest spline is a piecewise polynomial function, with each polynomial having a single variable. The spline S takes values from an interval and maps them to where Since S is piecewise defined, choose k subintervals to partition . The simplest choice of spline functions basis involves piecewise-linear polynomials. The first step is to form a partition of by choosing points . Letting , for each . We have defined the basis functions . Linear spline is linear polynomial which satisfies . To construct linear spline base in which it can satisfy the boundary conditions for . we have constructed the following component linear spline functions:
2.2.2 Quadratic B-spline
Quadratic B-spline is quadratic B-Spline polynomial which satisfy . To construct quadratic spline base in which satisfy the boundary conditions for we have constructed the following component quadratic spline functions (Figure 2):
3. Approximation of differential equations (DEs)
Mathematics has several tools to describe the problems in real life, engineering and science. ODEs and PDEs are significant tools in applied mathematics. They played significant rule in describing the mathematical models in applications of engineering, science and economics. High-order DE arises in some fields of engineering and science such as nonlinear optics and quantum mechanics. The approximated solutions of DEs should be studied when the ODEs and PDEs have no analytical solutions or it is very difficult to find the analytical solutions. The numerical or approximated solutions of DEs are very important in scientific computation, as they are widely used to model real life problems. In this section, we have studied the approximation solutions of DEs using spline and Haar wavelet bases (Table 2).
3.1 Approximation of ordinary differential equations (ODEs)
In this section, we have studied approximation solutions of ODEs using spline and Haar wavelet bases.
3.1.1 Approximation of DEs using spline functions
In this section, we have introduced the linear, quadratic and cubic B-spline base and their applications in solving ODEs. The operational matrices of the fractional-order integration of the B-spline base has been studied.
3.1.2 Rayleigh-Ritz Metod
Rayleigh-Ritz metod is variational technique for solving boundary value problems (BVPs) which is the first reformulated as a problem of choosing, from set of all sufficiently differentiable functions satisfying the boundary conditions, the function to minimize a certain integral. To describe the Rayleigh-Ritz method, we consider the approximation of the solution to a linear of two-boundary value problem from beam-stress analysis. This BVP is described by the following DE:
with boundary conditions
The DE describes the deflection of a beam of length 1 with variable cross section represented by The deflection is due to the added stresses and We have the following functional that is equivalent to Eq. (8).
for i = 1,2,3,…,n.
Lastly, we have obtained the linear system of equations where,
for . To impalement the Ritz method we consider the following problems.
subject to the initial condition is
with the exact solution
Let n = 5, then,
subject to the initial condition is
with the exact solution
Let n = 10, then,
for However, c = [1,1,2,3,1,1,1,1,1,1].
3.1.3 Analysis of collection method
Let the differential operator defined on the interval Define the collocation points for where and n is the number of partitions on I. Discretize the functions
Put the approximation of at the point in the DE, we get the function coefficient matrix and The matrix of coefficients has the dimension . Any function which is square integrable in the interval can be expressed as an infinite sum of Haar wavelet. The above series terminates at finite terms if is piecewise constant or can be approximated as piecewise constant during each subinterval.
3.2 The quadratic B-Spline Base
Consider the quadratic B-spline Base
Suppose The general ODE of first-order has the following form
subject to the initial condition is .
subject to the initial condition is
The coefficients are and .
Consider the quadratic B-spline base, then, the matrix of coefficients has the following formula:
for By solving the system of coefficients we will obtain the coefficients of approximation.
3.3 Approximation of DEs using Haar wavelet Functions Base
We introduce the Haar wavelet technique for solving general linear first-order ODEs .
3.3.1 First-order linear ODEs
Consider the following general linear first-order ODE:
Substituting in Eq. (15) which reduces to
We assume that
where for i = 1,2,…,k are Haar coefficients to be determined. Integrating Eq. (19) with respect to , we get the following
Put for in Eq. (21), we get linear system in which the matrix of coefficients has the following formula:
for By solving the linear system of coefficients we obtain the coefficients of approximated solution.
3.4 Approximation of fractional differential equations (FrDEs)
In this section, we have studied approximation of DEs using spline and Haar wavelet bases.
3.4.1 Operational matrix of the fractional order integration of the B-Spline Base
In this section, we have evaluated the operational matrices of the fractional-order integration of the linear, quadratic and cubic B-spline Base.
3.4.2 Linear spline
This subsection examines the cubic linear spline operational matrix of integration of the fractional order as follows:
3.4.3 Quadratic B-spline
This subsection introduced the quadratic B-spline operational matrix of integration of the fractional order as follows:
3.4.4 Cubic B-spline
This subsection introduced the cubic B-spline operational matrix FSof integration of the fractional order as follows:
3.5 Numerical Solutions of fractional differential equations
3.5.1 Numerical solutions of fractional differential equations using Haar base
We will introduce the Haar wavelet technique for solving FrDEs.
Consider the general fractional-order linear DE
subject to initial conditions for where and are given functions, are arbitrary constants and is a parameter describing the order of the fractional derivative. The general response expression contains a parameter describing the order of the fractional derivative that can be varied to obtain various responses.
Substituting in Eq. (25) which reduces to
We assume that
If integrating Eq. (28) once, we get
If , integrating Eq. (26) twice, we get
for By solving the linear system of coefficients we obtain the coefficients of approximated solution of Eq. (26).
3.5.2 Numerical solutions of fractional differential equations using B-spline base
We will introduce the B-spline technique for solving FrDE (26).
Consider the quadratic B-spline base
We assume that
If , integrating Eq. (34) once, we get
If , integrating Eq. (34) once, we get
for By solving the linear system of coefficients, we obtain the coefficients of approximated solution of Eq. (26).
3.5.3 Numerical solution of fractional Lane differential equation
We generalize the definition of Lane-Emden equations up to fractional order as following:
with the initial condition where and are constants and is a continuous real-valued function and The theory of singular boundary value problems has become an important area of investigation in the past three decades. One of the equations describing this type is the Lane-Emden equation. Lane-Emden type equations, first published by , and further explored in detail by , represents such phenomena and having significant applications, is a second-order ODE with an arbitrary index, known as the polytropic index, involved in one of its terms. The Lane-Emden equation describes a variety of phenomena in physics and astrophysics.  imposed the Lane-Emden DE of fractional order and the approximate solution is obtained by employing the method of power series and a numerical solution is established by the least squares method for these Eqs.  approximate the solution of DE by employing the method of power series and the numerical solution is established by collection method.
18.104.22.168 Analysis of numerical method of fractional Lane differential equation
 studied the solution of DEs based on Haar operational matrix,  studied the solution of DEs using Haar wavelet collocation method,  studied the numerical solution of DEs by using Haar wavelets,  used Haar wavelet approach to ODEs,  solved the fractional Riccati DEs using Haar wavelet while  studied the fractional DEs of Lane-Emden type numerically by method of collocation.  introduced an operational Haar wavelet method for solving fractional Volterra integral equations,  solved fractional integral equations by the Haar wavelet method,  used Haar wavelet-quasi linearization technique for fractional nonlinear DEs,  solved the fractional integral equations by the Haar wavelet method,  used Haar wavelet method for solving fractional PDEs numerically. In Eq. (41), consider , and .
If we consider and we solve the system of equations to obtain the coefficients .
3.6 Comparison study using numerical collection method
Collocation method for solving DEs is one of the most powerful approximated methods. This method has its basis upon approximate the solution of FrDEs by a series of complete sequence of functions, a sequence of linearly independent functions which has no non-zero function perpendicular to this sequence of functions. In general, is approximated by .
where for are an arbitrary constants to be evaluated and for are given set of functions. Therefore, the problem in Eq. (41) of evaluating is approximated by (42) then, is reduced to the problem of evaluating the coefficients for
Let is a partition to interval and and and See the comparison of absolute errors of the problem using numerical collection method with polynomial basis and Haar wavelet basis.
with the boundary conditions
The exact solution is
with the boundary conditions
The exact solution is .
with the boundary conditions
The exact solution is
4. Wavelet transform (WT)
Fourier transform (FT) of a time signal reveals the frequency content of the signal by decomposing the signal using complex sinusoids as follows:
However, FT cannot reveal the time information associated with a specific frequency. This drawback enhanced research in the time-frequency domain . One of the most important time-frequency distributions (TFD’s) is the wavelet transform (WT), which is a time-frequency representation of signals. While not all TFD’s are invertible, a big advantage of WT over many other TFD’s is invertibility. WT proved to be successful in revealing spectral features of signals. Instead of sustainable waves like sinusoidal waves as in the case of Fourier transform, WT is based on decomposing signals using decaying waves (small waves, or wavelets), all are shifted and dilated versions of a specific wavelet called mother wavelet. The continuous wavelet transform (CWT) of a signal using a mother wavelet is given by:
where is a representation of time inside the convolution integral, is the complex conjugate of the wavelet , and is called the “scale”, which we expect to be inversely related to the radian frequency for the above structure to be comparable to the structure of the sinusoidal waves used in the Fourier transform; the actual scale-frequency relationship is given by:
where ; ; ; is the sampling frequency used to discretize while computing via DFT. It is apparent that, for a fixed scale s, the wavelet transform is given by the convolution between the signal and the time-reversed wavelet as follows:
and refers to the 1D convolution process:
This fact gives another equivalent expression for using Fourier transforms of the signal and the wavelet as follows:
where . Hence, can be implemented via filtering the signal by a filter whose impulse response is . This will be the basis for implementing the discrete 1D and 2D wavelet transforms as explained below.
Generally speaking, Fourier transform decomposes the signal using the same sinusoidal wave at different values of frequency , while the wavelet transform decomposes the signal using the same mother wavelet at different values of scale s (hence, frequency, f) and time t; where both time and frequency information are revealed.
The WT is invertible, giving it a great advantage in applications:
where , which implies that , hence, must be oscillating. Also, to satisfy Parseval’s Theorem we should have The above continuous wavelet transform can be discretized to give the discrete wavelet transform (DWT), which can be implemented (as 1D DWT) by passing the signal through a low-pass filter followed by down-sampling with a factor of 2 (giving approximation coefficients), and a high-pass filter then down-sampling by a factor of 2 (giving detail coefficients). These filters differ according to the analyzing wavelet . The 2D DWT (for images) can be designed based on 1D DWT via tensor products, and it results into a decomposition of approximation coefficients at level k into four components: low-pass component that contains the approximation coefficients at level k + 1, and three high-pass components that contain the detail coefficients in three directions (horizontal, vertical, and diagonal). Note that approximation at level k = 0 is equivalent to the original 2D signal .
4.1 Some applications of the wavelet transform
The frequency content extracted by wavelet transform (WT) has been effectively used in revealing important features of 1D and 2D signals. This property proved very useful in speech and image recognition . Also, the orthogonality of WT paved the way for using WT in orthogonal frequency division multiplexing (OFDM), a pivotal technique for 4th and 5th generations of digital communication . In addition to that, WT proved to put high focus on the low-frequency part of the signal, in which most of the information resides, hence, WT has been used for signal and image compression . The compression process can be performed using hard-thresholding of the WT as follows:
where is the new WT coefficient value to replace the original coefficient x, and T is the threshold. Better compression results (in terms of signal size) can be obtained by increasing the threshold, however, larger deviation from the original signal (i.e., larger error) is obtained. Hence, choice of the threshold involves a trade-off between size and error. Original signal can be obtained from the compressed one via inverting the thresholded WT.
4.2 Noise removal using WT
An important application of the Wavelet Transform is noise removal from signals and images. As most of the information content of real-life signals is in the low-frequency regions, removal of high frequency regions in the WT of signals can help in removing the majority of noise. This can be done via thresholding WT coefficients or by removing the details coefficients of WT and considering only the approximation coefficients of WT. This property of separating low-frequency content from high-frequency content in the WT is mainly due to the filtering involved in the structure of WT as explained above. Noise removal using WT is more efficient for 1D signals corrupted by 1D noise process, where the 2D structure of WT in joint time-frequency domain can spread the 1D noise effect into a 2D plane, hence the noise power is greatly reduced. For noise removal, a soft-threshold can be used to cut out high-frequency coefficients as follows:
where is the new WT coefficient value to replace the original coefficient is the threshold, and is the signum function defined as follows:
5. Discussion and conclusion
The numerical solutions of differential equations using Haar wavelet technique have been studied. Haar wavelet technique is used to approximate the solutions of DEs. The results which obtained form numerical solutions of ordinary differential equations as well as fractional differential equations by Haar collection method are compared with spline base. The numerical results have clearly shown the advantage and the efficiency of the techniques in terms of accuracy and computational time. Special initial value problem of Lane-Emden equation has been solved to show the applicability and efficacy of the Haar wavelet method. Wavelet transform as a mathematical approach has been studied and the applications of wavelet transform in signal processing field have been introduced. The wavelet transform has been effectively used to reveal on the features signals and the compression of signal and image.
N. A. Ghani, “Numerical solution of eliiptic partial differential equations by haar wavelet operational matrix method,” Thesis, university Malaya, 2012.
F. A. Shah and R. Abbas, “Haar wavelet operational matrix method for the numerical solution of fractional order differential equations,” Nonlinear Engineering, vol. 4, no. 4, pp. 203–213, 2015.
U. Saeed and M. ur Rehman, “Haar wavelet–quasilinearization technique for fractional nonlinear differential equations,” Applied Mathematics and Computation,vol. 220, pp. 630–648, 2013.
L. Wang, Y. Ma, and Z. Meng, “Haar wavelet method for solving fractional partial differential equations numerically,” Applied Mathematics and Computation,vol. 227, pp. 66–76, 2014.
Ü. Lepik, “Application of the haar wavelet transform to solving integral and differential equations,” in Proceedings of the Estonian Academy of Sciences, Physics, Mathematics,vol. 56, no. 1, 2007.
Z. Shi and Y. Cao, “Application of haar wavelet method to eigenvalue problems of high order differential equations,” Applied Mathematical Modelling,vol. 36, no. 9, pp. 4020–4026, 2012.
S. M. Aznam, “A study of the hyperbolic heat conduction problem and laplace inversion using generalized haar wavelet operational matrix method,” Thesis, university Malaya,2012.
O. I. A.-S. . M. S. Mechee, “A study of haar wallet for solving differential equations with some applications,” Thesis, university of Kufa,2018.
M. S. Mechee, “Numerical and approxmited solutions of partial differential equations,” Thesis, university of Bagdad,1991.
D. Faires and Burden, Numerical Methods.Thomson Learning, 2003.
M. S. Mechee, O. I. Al-Shaher, and G. A. Al-Juaifri, “Haar wavelet technique for solving fractional differential equations with an application,” in AIP Conference Proceedings, vol. 2086, no. 1. AIP Publishing LLC, 2019, p. 030025.
J. Homer Lane, “On the theoretical temperature of the sun under the hypothesis of a gaseous mass maintaining its volume by internal heat and depending on the laws of gases known to terrestrial experiment,” Am. J. Sci., 2d Ser,vol. 50, pp. 57–74, 1870.
R. Emden, “Gaskugeln, bg teubner, leipzig and berlin,” Google Scholar,p. 448, 1907.
M. Mechee and N. Senu, “Numerical study of fractional differential equations of lane-emden type by method of collocation,” Applied Mathematics,vol. 3, no. 08, pp. 851–856, 2012.
N. Berwal, D. Panchal, and C. Parihar, “Solution of differential equations based on haar operational matrix,” Palestine journal of mathematics,vol. 3, no. 2, pp. 281–288, 2014.
B. Sahoo, “A study on solution of differential equations using haar wavelet collocation method,” Ph.D. dissertation, 2012.
Z. Shi, L.-Y. Deng, and Q.-J. Chen, “Numerical solution of differential equations by using haar wavelets,” in Wavelet Analysis and Pattern Recognition, 2007. ICWAPR’07. International Conference on,vol. 3. IEEE, 2007, pp. 1039–1044.
R. Chen, “Haar wavelet approach to ordinary differential equation,” Ph.D. dissertation, California State Polytechnic University, Pomona, 2016.
Y.-l. Li and L. Hu, “Solving fractional riccati differential equations using haar wavelet,” in Information and Computing (ICIC), 2010 Third International Conference on,vol. 1. IEEE, 2010, pp. 314–317.
H. Saeedi, N. Mollahasani, M. M. Moghadam, and G. N. Chuev, “An operational haar wavelet method for solving fractional volterra integral equations,” International Journal of Applied Mathematics and Computer Science,vol. 21, no. 3, pp. 535–547, 2011.
Ü. Lepik, “Solving fractional integral equations by the haar wavelet method,” Applied Mathematics and Computation,vol. 214, no. 2, pp. 468–478, 2009.
U. Saeed and M. Rehman, “Haar wavelet picard method for fractional nonlinear partial differential equations,” Applied Mathematics and Computation,vol. 264, pp. 310–322, 2015.
Z. M. Hussain and B. Boashash, “Design of time-frequency distributions for amplitude and if estimation of multicomponent signals,” in Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat. No. 01EX467),vol. 1. IEEE, 2001, pp. 339–342.
Y. Meyer and D. H. Salinger, “Wavelets and operators,” 1995.
M. P. Sampat, Z. Wang, S. Gupta, A. C. Bovik, and M. K. Markey, “Complex wavelet structural similarity: A new image similarity index,” IEEE transactions on image processing,vol. 18, no. 11, pp. 2385–2401, 2009.
K. Abdullah, A. Z. Sadik, and Z. M. Hussain, “On the dwt-and wpt-ofdm versus fft-ofdm,” in 2009 5th IEEE GCC Conference & Exhibition.IEEE, 2009, pp. 1–5.
N. Al-Hinai, K. Neville, A. Z. Sadik, and Z. M. Hussain, “Compressed image transmission over fft-ofdm: A comparative study,” in 2007 Australasian Telecommunication Networks and Applications Conference.IEEE, 2007, pp. 465–469.