Open access peer-reviewed chapter

Representation of Radar Micro-Dopplers Using Customized Dictionaries

Written By

Shobha Sundar Ram

Submitted: 05 June 2017 Reviewed: 13 October 2017 Published: 20 December 2017

DOI: 10.5772/intechopen.71675

From the Edited Volume

Topics in Radar Signal Processing

Edited by Graham Weinberg

Chapter metrics overview

1,312 Chapter Downloads

View Full Metrics

Abstract

Human motions give rise to frequency modulations, known as micro-Dopplers, to continuous wave radar signals. Micro-Doppler signals have been extensively researched for the classification of different types of human motions as well as to distinguish humans from other moving targets. However, there are two main scenarios where the performance of existing algorithms deteriorates significantly—one, when the channel consists of multiple moving targets resulting in distorted signatures, and two, when the systems conditions during the training stage deviate significantly from the conditions during the test stage. In this chapter, it is demonstrated that both of these limitations can be overcome by representing the radar data through customized dictionaries, fine-tuned to provide sparser representations of the data, than traditional data-independent dictionaries such as Fourier or wavelets. The performances of the algorithms are evaluated with both simulated and measured radar data gathered from moving humans in indoor line-of-sight conditions.

Keywords

  • micro-Doppler
  • dictionary learning
  • classification
  • detection

1. Introduction

Radar detection of humans has emerged as a topic of considerable research interest in the last two decades for varied applications such as security and law enforcement, through-wall surveillance, search and rescue operations, biomedical applications, and automobile radars. Two types of radars have been studied for these applications. The first type is the broadband impulse radars with high range resolution. These radars map the surroundings and moving targets (such as humans) are detected with the assistance of moving target detection algorithms [1, 2]. The second type of radars is the phase coherent continuous wave radars. These could be either broadband frequency-modulated continuous wave radars [3], such as those used in automobile radar applications. Alternately, narrowband (single tone) radars have been used for through-wall surveillance applications [4]. The latter are cheap to build with off-the-shelf components. In this chapter, human detection and classification by a monostatic continuous wave Doppler radar that transmits a sinusoidal signal of carrier frequency fc is discussed. The human body can be considered as an extended target with multiple point scatterers on different body parts. When the radar signal impinges on a non-rigid moving human body, the micro-motions of the arms, legs and torso introduce micro-Doppler shifts ( f D ) on the scattered radar signal at the radar receiver. Each of these shifts is proportional to the carrier frequency and the radial relative velocity ( v ) between the body part and radar— f D = 2 v f c c . Each of these body parts follows a unique trajectory giving rise to multiple micro-Doppler components that superpose. The scattered radar signal at the receiver is amplified and demodulated. There are several methods for representing the time-domain micro-Doppler returns, x t , of which, the most popular technique is to use joint time-frequency transforms such as the short-time Fourier transform (STFT) as shown below:

χ t f = x τ h t τ e j 2 πfτ E1

In the above equation, the short time window is given by h t . The STFT showcases the time-varying nature of the individual Doppler tracks from multiple body parts [5, 6]. For example, Figure 1 shows the micro-Doppler signature of a human walking toward a monostatic continuous wave radar at 7.5 GHz. The micro-Dopplers are mostly positive since the human is moving towards the radar. Dopplers from the right and left arms and legs alternate with each other due to the swinging motion of the limbs.

Figure 1.

Spectrogram of walking human at 7.5 GHz.

The highest Dopplers arise from the feet followed by the arms and then the torso. The torso, though, gives rise to the strongest signal due to the high radar cross-section.

Different periodic motions—such as running, crawling, and boxing—each give rise to unique micro-Doppler spectrograms. Hence, these STFT-based signatures have been extensively studied for classification of different human activities as well as to differentiate humans from other movers [7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23]. The main limitation of the STFT, however, is that the resolution along both the time and frequency domains are controlled by the choice of the dwell time or short time window used in the transform. Depending on the type of target, the dwell time parameters are often chosen heuristically, to realize the most informative signatures. Other representations include the use of signal processing techniques such as independent component analysis [24], Hilbert-Huang transforms [25, 26], etc. In all of these cases, the dictionaries or bases for representation of the radar data are independent of the data. While data-independent dictionaries are usually computationally simple to derive, they are not specifically fine-tuned to the underlying features of the data and are dependent on heuristic parameter selection. Hence, while they have had success in simple scenarios—such as target classification when the channel consists of only a single target or when the test and training conditions are identical—they are not suited for more complex realistic scenarios.

Over the last decade, dictionary learning has emerged under the aegis of machine learning. Here, customized dictionaries are derived directly from the data and hence are capable of abstracting the fundamental characteristics of the data. Dictionary learning has been used successfully in a variety of domains such as image processing and face recognition [27, 28] and energy disaggregation [29]. Due to the abstraction of the data bases, the hypothesis is that they will be useful for addressing detection and classification challenges under more complex scenarios. This chapter specifically addresses two such scenarios discussed in [30, 31].

In the first scenario in [30], the problem when the propagation channel consists of multiple simultaneously moving targets is considered. Whether the radar is deployed in indoor or outdoor environments, the presence of multiple simultaneous movers is highly likely. For instance, in indoor environments, multiple human movers are encountered along with dynamic clutter from moving fans, loud speakers, etc. Similarly, in outdoor environments, moving vehicles and animals along with pedestrians are encountered. When multiple targets move simultaneously in the propagation channel, their radar scattered returns superpose giving rise to distorted spectrograms. Therefore, the radar returns from these targets must be disaggregated before they can be fed into classifiers. In other words, the research problem focuses on single channel source separation or multiple target detection rather than single target classification. Specifically, unique dictionaries are learned directly from the raw time domain radar data from each of the single target categories. This means that no type of parameter selection operation is carried out. Then, these unique dictionaries are used to detect the presence of multiple targets in test data.

Next in [31], the scenario when the training and test conditions of radar data measurement deviate considerably is considered. Usually training data are gathered in tightly controlled laboratory conditions. But the test data are gathered in real world scenarios where the radar system deployment may encounter some challenges. For instance, presence of wireless interference sources or dispersion in the propagation channel (say through-wall scenario) may render some change in the carrier frequency inevitable. In such instances, a degree of reconfigurability in the radar hardware parameters and flexibility in the radar software is desirable. While the hardware reconfigurability can be realized by implementing the radar on software defined radio platforms, the flexibility in the software can only be realized if the processing algorithms can handle diversity in the training and test data. When data-driven dictionaries are derived from diverse radar data, collected across multiple carrier frequencies, the algorithms derive fundamental characteristics of the data that are common to specific motions across different carrier frequencies. In this manner, they are capable of recognizing that specific motion category even when the radar data are gathered at a new carrier frequency that is distinct from those used previously while training.

The chapter is organized as follows. Section 2 details the analytical framework for learning dictionaries from raw time domain data along with description of how these dictionaries can be utilized for both single channel source separation (or disaggregation) and for classification (when training and test data are gathered in different conditions). Sections 3 and 4 provide the experimental validation and results for both of these scenarios. Section 5 concludes with a discussion on the advantages and limitations of the dictionary learning algorithm in the context of radar.

Advertisement

2. Theory

Throughout the chapter, vectors are indicated with small bold letters, matrices with capital bold letters, and constants or variables with small letters. In this section, the concept of representing time-domain micro-Doppler data with uniquely customized dictionaries is introduced. These dictionaries are learnt from training data. In this chapter, we discuss the synthesis learning dictionary framework which is based on the idea that radar data, x, can be synthesized with unique data dependent bases functions, D, and their corresponding coefficients, z. In other words, x = Dz. An alternate framework that has also been investigated is called the analysis dictionary learning framework. Here, the data is analyzed by dictionaries to create sparse coefficient representations. This can be shown as Dx = z. The analysis dictionary framework is quicker to execute than the synthesis dictionary learning in the test stages, since it involves a multiplicative operation rather than matrix inversion. Interested readers may refer to [32] for further details on the analysis dictionary learning framework and its experimental validation.

2.1. Dictionary learning

Consider the case of I targets. Each target is assumed to be moving in isolation in the propagation environment. The radar data from the target, i, is represented as a vector x i which consist of N samples. The training data corresponding to target i consist of M such measurements and hence X i ϵ N × M . The objective is to represent X i as shown in Eq. (2):

X i = D i Z i E2

Here, D i ϵ N × P and Z i ϵ P × M are the dictionary and coefficient matrices corresponding to the target i. The distinction of this dictionary learning process from other data-independent transforms such as Fourier or DCT is that Z i must be a row-wise sparse coefficient matrix with a sparsity value of τ . Therefore, the objective of the dictionary learning algorithm is given as Eq. (3)

min D i , Z i X i D i Z i F 2 s . t Z i 0 < τ E3

It is well known that the l0—minimization problem stated above is NP-hard [33]. There are therefore, two approaches for solving Eq. (2). One is to implement the l0—minimization using computationally expensive greedy techniques. Alternately, the l0—minimization can be reduced to a l1—minimization technique as shown in Eq. (4)

min D i , Z i X i D i Z i F 2 + λ Z i 1 E4

Here, λ is the regularization parameter that trades off between the representational accuracy and the sparsity in the l1—minimization operation. An iterative alternative minimization approach is used to solve Eq. (4). First, D i is initialized using random columns selected from the training data X i . Then Z i is determined using Eq. (5) by implementing the iterative soft thresholding algorithm (ISTA) discussed in [34]

min Z i X i D i Z i F 2 + λ Z i 1 E5

Once Z i is determined, D i is estimated using the simple least squares minimization shown in Eq. (6). Each of the P columns of the dictionary has to be normalized to less than unity in order to prevent scale ambiguities

min D i X i D i Z i F 2 s . t d p 2 2 1 E6

Equations (5) and (6) are iterated until the representation error falls below a pre-defined threshold or when it converges. The process is repeated to learn unique dictionaries for every target. Then, all the dictionaries are concatenated to form an aggregate over-complete dictionary D = D 1 D 2 D I . The aggregate dictionary, D N × IP , is used for both single channel source separation and for classification of test micro-Dopplers. Both of these are discussed in the succeeding sections.

The dictionaries of multiple targets are learned individually in Eq. (4). An alternate mechanism would be to learn the multiple dictionaries together as suggested by [35]. Here, besides the sparsity penalty in Eq. (3), an additional penalty is introduced to increase the discrimination across multiple target categories. This step increases the computational complexity during the training stages. But since there was no discernible improvement in the performance of the disaggregation and classification algorithms, this scheme is not discussed in this chapter.

2.2. Single channel source separation of multiple radar micro-Dopplers

Now each single test measurement—a vector consisting of N samples, x ~ N × 1 is considered. In the test scenario, there may be single or multiple targets moving simultaneously in the propagation channel. Therefore, the test signal may be the aggregate of time-domain micro-Dopplers from multiple targets. Using the aggregate dictionary, the test coefficient vector z ~ 1 : I IP × 1 is derived using Eq. (7)

min z ~ 1 : I x i D z ~ 1 : I F 2 + λ 1 z ~ 1 : I E7

Note that the test coefficient vector, z ~ 1 : I , is distinct from the columns of the coefficient matrix, Z i , derived earlier from Eq. (5). In z ~ 1 : I , the coefficients ( z ~ i ) corresponding to each of the I categories of targets are obtained at once as opposed to Eq. (5), where the coefficients corresponding to just the training target category are realized. If one or more targets are present, then the hypothesis is that their corresponding coefficients ( z ~ i P × 1 ) extracted from the composite test coefficient vector ( z ~ 1 : I ) will be non-sparse, while the coefficients belonging to the absent targets will be close to zeros. The intuition here is that if the dictionaries are sufficiently discriminative, then they will be able to extract the corresponding target coefficients even when the radar data consists of superposition of returns from multiple targets. Therefore, a target i is determined to be present if the corresponding D i z ~ i is above a predefined threshold.

2.3. Classification of radar micro-Dopplers

In the previous section, single channel source separation of test data that comprises of radar returns from multiple targets was discussed. Now, the focus is on classification of radar data from an unknown test target category. It is important to note that while the previous problem focused on multiple target detection, the problem in this section focuses on single target classification. In both cases, the aggregate dictionary matrix, D, obtained from concatenation of the individual dictionaries learned from each of the target categories is utilized. For classification purposes, the training features for each target i are derived from the coefficient vector, Z ¨ 1 : I i , obtained using the training data, X i , and the aggregate dictionary using Eq. (8)

min Z ¨ 1 : I i X i D Z ¨ 1 : I i F 2 + λ 2 Z ¨ 1 : I i E8

Though the training data matrix is identical, the training feature, Z ¨ 1 : I i , is distinct from the previously derived Z i from Eq. (5) since Z ¨ 1 : I i is a composite matrix derived from the aggregate D rather than an individual dictionary D i . The the training feature shows the sparsity pattern corresponding to an ith target within the cluster of coefficients from multiple targets. Any well-established classifier, such as support vector machine or K-Nearest neighbor, etc., can now be trained with multiple columns of the training feature matrix. Each of the columns of Z ¨ 1 : I i is treated as a single training instance for the ith target and the classifier is similarly trained for all the target classes.

During the test stage, test features, z ¨ 1 : I , are extracted from each test measurement, x ¨ i (from a single target category) using Eq. (9)

min z ¨ 1 : I x ¨ i D z ¨ 1 : I F 2 + λ 2 z ¨ 1 : I E9

The test data are subsequently classified based on the similarity between z ¨ 1 : I and the columns of Z ¨ 1 : I i across all the I target categories. In this chapter, the support vector machine classifier is used. The data were tested on other popular classifiers such as KNN but did not result in any significant difference in the results.

Advertisement

3. Experimental data collection

The proposed dictionary learning methods are validated on experimental radar data gathered from moving humans. Both simulated radar data and measured data are considered. Both types of data offer some advantages and some limitations. The simulated radar data offer an opportunity to test the performance of the algorithms quickly and under a variety of radar operating conditions. In other words, the simulations offer a flexible mechanism to change radar parameters. The data are also highly sanitized due to the absence of noise and limitations of radar hardware. The measurement data collection is limited by radar system parameters such as the dynamic range of the radar receiver, the carrier frequency, sampling frequency, and antenna characteristics. On the other hand, current state-of-the-art simulation methodologies for human radar data do not capture the entire physics of the human scattering phenomena. The measurement data, therefore, are crucial for validating the proposed algorithms in real world scenarios. The second important limitation of the simulation data (unlike the measurement data) is that with the current techniques, the channel can consist of only a single target. Therefore, the simulation data are only used for the single target classification problem and not for the multiple target detection or disaggregation problem.

In the following two subsections, both the simulation and measurement methodologies are detailed.

3.1. Simulation data

Simulation of radar scatterings of still humans has been investigated with full wave electromagnetic techniques as well as the computationally cheaper ray tracing technique at frequencies below X band [36]. The results from the simulations of a uniformly dielectric human body showed that the ray tracing results were comparable to the results from full wave methods. However, both of these methods are computationally not feasible for simulating radar returns from dynamic humans since this requires modeling of multiple human poses. Alternately, the simple primitive-based modeling has proven to be reasonably accurate for modeling human motions [37, 38]. Here, the different body parts on the human are modeled as simple primitives such as the head as a sphere, the torso as a cylinder or ellipsoid, and so forth. The radar cross-sections of these simple shapes ( σ b ) are well characterized for different carrier frequencies ( f c ) and aspect angles. One or more point scatterers ( r b ) are identified for each body part. When the human moves, the time-varying positions of the point scatterers give rise to micro-Dopplers. Then, the radar returns of the human are obtained by the complex sum of the returns from each of the body parts as shown in Eq. (10)

x = b = 1 B σ b 1 r b 2 e j 2 π f c c 2 r b t E10

This simplistic model is easy to execute in real time. However, it does not capture the entire physics of the human scatterings. For instance, it does not capture the multiple scatterings of waves between the different body parts or their shadowing effects.

There are three methods that are currently used to describe human motions. The simplest method is to model the swinging motion of the two legs as a double pendulum. A more complete analytical model, known as the Boulic-Thalmann model, was proposed in [37]. This model provides analytical equations to describe different human body parts (arms, legs, hands, and feet) as a function of the human height and relative velocity with respect to height. However, the model is restricted only to a simple human walking motion. More complex and realistic motions, such as crawling, hopping, and running, can be obtained using computer animation data. The radar scattered returns from complex human motions can be therefore obtained by combining animation data with the primitive-based electromagnetic modeling [38]. However, the animation data are obtained through motion capture technologies of a live actor. Therefore, the model cannot be parameterized to obtain varied data for different humans (of different heights or gait patterns) through a single measurement.

In this study, the Thalmann model was used to model human walking motions for multiple human heights (1.5–1.8 m) and velocities (1.5–3.6 m/s). Due to the limitations of the model, a variety of human motions could not be simulated. Instead, just two types of motions were considered—when a human is walking towards the radar and when the human is walking away from the radar. The human moves in the line-of-sight of a monostatic continuous wave radar anywhere from a distance of 2–8 m. The duration of the human motion is 1 s and the sampling frequency of the simulation is 1 kHz. We imparted frequency diversity to the simulation data by varying the carrier frequency across five values—{2.5, 3, 3.5, 4, and 4.5 GHz}. Three hundred and sixty distinct walking motions are simulated both toward and away from radar at each of the carriers. Of these, 80% of the 1800 total simulations—corresponding to four of the five carrier frequencies—were used for training the classification algorithm; and the remaining 20%—from the fifth remaining carrier frequency—were used for testing purposes. The objective here is to test the capability of the dictionary learning algorithm to learn fundamental features from the human micro-Doppler data pertaining to a specific motion despite the variations of the carrier frequency. The dictionaries are learned directly from the raw data without any additional post processing. Therefore, at no stage were any parameters heuristically chosen.

A third category of indoor mover may give rise to significant dynamic clutter—a fan. Hence, a fan was modeled with three blades and multiple point scatterers on each blade. A lot of variety in the experimental data from the fan was generated by changing its speed of rotation (200–400 rpm), the length of the blades (0.2–0.4 m), width of the blades (0.14–0.17 m) and the orientation of the fan with respect to the monostatic radar. The fan micro-Dopplers at five carrier frequencies (1800 distinct simulations) were simulated of which data from four carriers were used for training and the data from the fifth carrier for testing purposes. The results and analyses for dictionary-based classification of simulated human radar data are presented in the following section.

3.2. Measurement data

Next, experimental data were collected in indoor line-of-sight conditions. A monostatic continuous wave radar was set up using a N9926A FieldFox vector network analyzer (VNA) and two linearly polarized broad band horn antennas (HF907). The VNA was configured to make narrowband measurements around a center carrier frequency (Figure 2).

Figure 2.

Measurement data collection in indoor line-of-sight conditions using a VNA and two horn antennas.

The transmitted power of the VNA was set at +3 dBm. The instrument is highly sensitive with a dynamic range of over 100 dB. The received signal is amplified, in-phase quadrature (IQ) demodulated and digitized inside the instrument and then directly processed in a 2.4GHz Intel Pentium processor. Two sets of experiments were carried out.

The first experiment was carried out to validate the multiple target detection algorithm based on dictionary learning. The center frequency of the VNA was set to 7.5 GHz. Then, human radar data were collected for two types of motions—when a human is walking towards the radar (FH) and when a human is walking away from the radar (BH). Each measurement trace is 2.7 s long with 1000 samples. The low sampling frequency is due to the system constraints of the VNA when it is configured in the narrowband mode. Measurement data were gathered for 40 humans of both genders and of varying heights and gait patterns. The humans move between 1 and 9 m away from the radar in line-of-sight conditions. The third motion class that was considered was of a table fan (TF) with three blades. The table fan was operated at three different rotation rates and was placed at different distances and orientations from the radar. Then, measurement data were gathered with multiple targets moving simultaneously. The cases are: FH + BH, FH + TF, BH + TF, and FH + BH + TF. The objective is to learn dictionaries using training data in the single-target scenario. Then these dictionaries are combined and used to detect targets in multiple target scenarios.

The next experiment that was conducted was again based on the same set up. However, this time only single-target scenarios were considered. Instead, the carrier frequency of the measurement data was varied across five values—{2.5, 3, 3.5, 4, and 4.5} GHz. A variety of human motions were considered—two humans walking simultaneously before the radar (TH), human standing still but boxing with his arms (HB) and a human walking while holding a stick (HHS). The last case that was considered was of the rotating table fan (TF). The challenge in this experiment is to learn dictionaries and training features from measurement data corresponding to four carrier frequencies, while testing the classifier with data from a fifth distinct carrier frequency. This experiment was specifically chosen since the human micro-Doppler shows a lot of variations due to the carrier frequency and the Dopplers are directly proportional to the frequency. The table fan was selected for both types of experiments, since it is one of the key contributors of dynamic clutter in indoor environment.

Advertisement

4. Results and analysis

In this section, the results of using the customized micro-Doppler dictionaries of the different types of motions for both multiple target detection as well as single target classification are discussed.

4.1. Results from multiple target detection using disaggregation of radar data

First, the measured data that are gathered for multiple target detection are considered. As mentioned in Section 3.2, three target classes—human walking toward the radar (FH), away from the radar (BH), and table fan (TF) are considered. The dictionaries are learned from single target data and use them to detect the presence of multiple simultaneous movers in three scenarios—single-target scenario, two-target scenario, and three-target scenario. The true detection and false alarm percentage for each of these cases is summarized in Table 1. The results show that for a single-target scenario, the true detection is very high (above 93%) in all the three cases. The true detection of the fan is slightly poorer than that of the humans because of greater probability of aliasing arising with the fan micro-Dopplers due to the limited sampling frequency of the radar measurements. This also gives rise to the slightly higher false alarm rate of the fan when compared to the humans. Next, three two-target scenarios are considered. In each of the scenarios, the algorithm correctly detects the presence of two targets in more than 80% of the cases by disaggregating their micro-Dopplers. The false alarm rate though is high especially from the table fan due to the aliasing. In the three-target scenario, the algorithm correctly detects the presence of all three targets in more than 90% of the cases. This sort of multiple target detection cannot be carried out using basic data independent transforms and this result demonstrates the usefulness of representing micro-Dopplers with unique data-dependent dictionaries.

Scenarios True detections False alarms
FH BH TF FH BH TF
Single target (FH) 100 NA NA NA 4 14
Single target (BH) NA 100 NA 12 NA 8
Single target (TF) NA NA 94 2 0 NA
Two targets (FH + BH) 87.5 80 NA NA NA 52.5
Two targets (FH + TF) 88 NA 94 NA 12 NA
Two targets (BH + TF) NA 94 96 28 NA NA
Three targets (FH + BH + TF) 95 90 90 NA NA NA
Mean 94 11

Table 1.

Disaggregation and detection results from measured human micro-Dopplers in multiple target scenario at 7.5 GHz from [29].

4.2. Results of single target classification using frequency diverse radar micro-Dopplers

Now the objective is to correctly classify that target class when the propagation channel consists of only one type of target class. The challenge here is to classify test data where system conditions (carrier frequency) during test deviate significantly from the training conditions. Therefore, during the training stage, the dictionaries for each target class are learned from diverse frequency data (from four carrier frequencies) and the test data consists of micro-Dopplers from a fifth carrier frequency that was previously not used for training.

The following five carrier frequencies—{2.5, 3, 3.5, 4, and 4.5} GHz are considered. In fold 1 through fold 5, the test frequencies are 2.5, 3,…,4.5 GHz, respectively, and the training data for each fold are obtained from the corresponding complimentary set from the total set of carrier frequencies. The performance of the algorithm for both simulation and measurement data are studied. In the simulation set up, three target classes are considered—a human walking towards the radar (FH), a human walking away from the radar (BH), and a fan (TF). The classification results obtained from the fivefold classification are presented in Table 2. The results show very high classification accuracy (close to 100%) for all the cases. This shows that the algorithm is capable of learning unique dictionaries corresponding to each human motion from frequency diverse training data. Again, this type of classification would not be possible with other data-independent transforms which rely on heuristic parameter selection.

Cases Fold 1 Fold 2 Fold 3 Fold 4 Fold 5 Mean
Human walking away from radar 100 100 100 100 100 100
Human walking towards radar 100 100 100 100 100 100
Ceiling Fan 100 98 100 100 97 99

Table 2.

Fivefold cross-validation of classification based on dictionary learning of simulated human micro-Dopplers at {2.5, 3, 3.5, 4.0, 4.5} GHz from [30].

Data from four carriers are used for training while data from the fifth carrier are used for testing.

The simulation data are highly sanitized, since they are not affected by real world conditions such as noise, interference, and radar system limitations. Therefore, in the next study, the performance of the algorithm on real world data is studied. Four types of motions—two humans walking simultaneously in the propagation channel (forming a single class of motion—TH), a single human standing still and boxing his arms (HB), a human walking with a stick (HHS), and a table fan are considered. Five-fold classification is performed on the target data and the results are presented in the following two tables. Table 3 shows the confusion matrix obtained for a single fold (fold 4). The column headers show the class labels that the classification algorithm assigns to the test data. The true class labels are shown as row headers. The results show that TH, HB, and TF are classified with 100% accuracy, while the HHS is confused with TH and HB. There are two reasons for this confusion. When two humans are walking together, there are times when the scattered signal from one human may be weaker than the other human (due to shadowing or due to different distances of the two humans from the radar). As a result, there are similarities at times between TH and HHS. Second, when the human is boxing, the micro-Dopplers occur at both positive and negative frequencies due to motions of the arms toward and away from the radar. This can be confused with the HHS, especially from the back swing of the legs, stick, and arms. The micro-Dopplers of both these motions could resemble each other especially across different carrier frequencies.

Cases TH HB HHS TF
Two humans (TH) 100 0 0 0
Human boxing (HB) 0 100 0 0
Human holding stick (HHS) 15 10 75 0
Table fan (TF) 0 0 0 100

Table 3.

Confusion matrix obtained while classifying human measured micro-Dopplers at 4 GHz.

The classifier was trained using measured data at {2.5, 3, 3.5, and 5} GHz from [30].

Table 4 shows the classification results across all the fivefolds. The results show a fairly good classification performance (above 85%) for all of the cases. The confusion of the table fan with the human motions can again be attributed to the limited sampling frequency of the measurement data.

Cases Fold 1 Fold 2 Fold 3 Fold 4 Fold 5 Average
TH 95 100 75 85 80 87
HB 85 100 85 100 100 94
HHS 85 75 85 80 100 85
TF 90 100 90 85 90 91

Table 4.

Fivefold cross-validation of classification based on dictionary learning of measured human micro-Dopplers at {2.5, 3, 3.5, 4.0, 4.5} GHz from [30].

Data from four carriers are used for training while data from the fifth carrier are used for testing.

Advertisement

5. Conclusion

In conclusion, the usefulness of representing human micro-Dopplers with unique data dependent dictionaries is investigated. These dictionaries are applied subsequently to two applications. The first application is for detecting multiple simultaneously moving targets in the propagation channel. Results demonstrated that weak targets are detected in the presence of stronger targets and strong targets are correctly identified even when their signatures are distorted by returns from the weaker targets. The second application that was discussed was classification when there is significant variation between the training and test conditions. Specifically, the carrier frequency—the fundamental parameter that controls the resolution, extent, and quality of micro-Doppler data—was varied. The algorithm learned dictionaries from diverse training data and was capable of correctly classifying completely different test data. While the dictionary learning techniques were examined in the context of micro-Doppler data, the encouraging results suggest that these techniques may be successfully extended to other radar scenarios especially the range-Doppler images of ISAR.

References

  1. 1. Nag S, Barnes MA, Payment T, Holladay G. Ultrawideband through-wall radar for detecting the motion of people in real time. In: AeroSense 2002. International Society for Optics and Photonics; 2002. pp. 48-57
  2. 2. Yarovoy A, Ligthart L, Matuzas J, Levitas B. UWB radar for human being detection. IEEE Aerospace and Electronic Systems Magazine. 2006;21(3):10-14
  3. 3. Maaref N, Millot P, Pichot C, Picon O. A study of UWB FM-CW radar for the detection of human beings in motion inside a building. IEEE Transactions on Geoscience and Remote Sensing. 2009;47(5):1297-1300
  4. 4. Ram SS, Li Y, Lin A, Ling H. Doppler-based detection and tracking of humans in indoor environments. Journal of The Franklin Institute. 2008;345(6):679-699
  5. 5. Ram SS, Ling H. Through-wall tracking of human movers using joint Doppler and array processing. IEEE Geoscience and Remote Sensing Letters. 2008;5(3):537-541
  6. 6. Chen VC, Li F, Ho S-S, Wechsler H. Analysis of micro-Doppler signatures. IEEE Proceedings - Radar, Sonar and Navigation. 2003;150(4):271-276
  7. 7. Chen VC, Li F, Ho SS, Wechsler H. Micro-Doppler effect in radar: Phenomenon, model, and simulation study. IEEE Transactions on Aerospace and Electronic Systems. 2006;42(1):2-21
  8. 8. Nicolas GLVJM. Micro-Doppler analysis of wheels and pedestrians in ISAR imaging. IET Signal Processing. 2008;1(1):29-34
  9. 9. Nanzer JA, Rogers RL. Bayesian classification of humans and vehicles using micro-Doppler signals from a scanning-beam radar. IEEE Microwave and Wireless Components Letters. 2009;19(5):338-340
  10. 10. Li Y, Du L, Liu H. Hierarchical classification of moving vehicles based on empirical mode decomposition of micro-Doppler signatures. IEEE Transactions on Geoscience and Remote Sensing. 2013;51(5):3001-3013
  11. 11. Du L, Li L, Wang B, Xiao J. Micro-Doppler feature extraction based on time-frequency spectrogram for ground moving targets classification with low-resolution radar. IEEE Sensors Journal. 2016;16(10):3756-3763
  12. 12. Nepal R, Cai J, Yan Z. Micro-Doppler radar signature identification within wind turbine clutter based on short-CPI airborne radar observations. IET Radar, Sonar and Navigation. 2015;9(9):1268-1275
  13. 13. Thayaparan T, Abrol S, Riseborough E, Stankovic L, Lamothe D, Duff G. Analysis of radar micro-Doppler signatures from experimental helicopter and human data. IET Radar, Sonar and Navigation. 2007;1(4):289-299
  14. 14. Bączyk MK, Samczyński P, Kulpa K, Misiurewicz J. Micro-Doppler signatures of helicopters in multistatic passive radars. IET Radar, Sonar and Navigation. 2015;9(9):1276-1283
  15. 15. Molchanov P, Egiazarian K, Astola J, Totsky A, Leshchenko S, Jarabo-Amores MP. Classification of aircraft using micro-Doppler bicoherence-based features. IEEE Transactions on Aerospace and Electronic Systems. 2014;50(2):1455-1467
  16. 16. Kim Y, Ling H. Human activity classification based on micro-Doppler signatures using a support vector machine. IEEE Transactions on Geoscience and Remote Sensing. 2009;47(5):1328-1337
  17. 17. Orović I, Stanković S, Amin MG. A new approach for classification of human gait based on time frequency feature representations. Signal Processing. 2011;91(6):1448-1456
  18. 18. Park J, Johnson JT, Majurec N, Frankford M, Stewart K, Smith GE, Westbrook L. Simulation and analysis of polarimetric radar signatures of human gaits. IEEE Transactions on Aerospace and Electronic Systems. 2014;50(3):2164-2175
  19. 19. Amin MG, Ahmad F, Zhang YD, Boashash B. Human gait recognition with cane assistive device using quadratic time–frequency distributions. IET Radar, Sonar and Navigation. 2015;9(9):1224-1230
  20. 20. Narayanan RM, Fairchild DP. Classification of human motions using empirical mode decomposition of human micro-Doppler signatures. IET Radar, Sonar and Navigation. 2014;8(5):425-434
  21. 21. Fioranelli F, Ritchie M, Griffiths H. Classification of unarmed/armed personnel using the NetRAD multistatic radar for micro-Doppler and singular value decomposition features. IEEE Geoscience and Remote Sensing Letters. 2015;12(9):1933-1937
  22. 22. Fioranelli F, Ritchie M, Griffiths H. Aspect angle dependence and multistatic data fusion for micro-Doppler classification of armed/unarmed personnel. IET Radar, Sonar and Navigation. 2015;9(9):1231-1239
  23. 23. Zabalza J, Clemente C, Di Caterina G, Ren J, Soraghan JJ, Marshall S. Robust PCA micro-Doppler classification using SVM on embedded systems. IEEE Transactions on Aerospace and Electronic Systems. 2014;50(3):2304-2312
  24. 24. Chen VC. Spatial and temporal independent component analysis of micro-Doppler features. In: IEEE Radar Conference; 2005. pp. 348-353
  25. 25. Lai C-P, Narayanan RM, Ruan Q, Davydov A. Hilbert-Huang transform analysis of human activities using through-wall noise and noise-like radar. IET Radar, Sonar and Navigation. 2008;2(4):244-255
  26. 26. Cai C, Liu W, Fu JS, Lu Y. Radar micro-Doppler signature analysis with HHT. IEEE Transactions on Aerospace and Electronic Systems. 2010;46(2):929-938
  27. 27. Wright J, Yang A, Ganesh A, Sastry S, Ma Y. Robust face recognition via sparse representation. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2009;31(2):210-227
  28. 28. Ramirez I, Sprechmann P, Sapiro G. Classification and clustering via dictionary learning with structured incoherence and shared features. In: IEEE Conference of Computer Vision and Pattern Recognition; 2010. pp. 3501-3508
  29. 29. Kolter JZ, Batra S, Andrew YN. Energy disaggregation via discriminative sparse coding. In: Advances in Neural Information Processing Systems. Vancouver Canada: ACM; 2010. pp. 1153-1161
  30. 30. Vishwakarma S, Ram SS. Detection of multiple movers based on single channel source separation of their micro-Dopplers. IEEE Transactions on Aerospace and Electronic Systems. 2017
  31. 31. Vishwakarma S, Ram SS. Dictionary learning for classification of indoor micro-Doppler signatures across multiple carriers. In: Radar Conference (RadarConf), 2017, IEEE. IEEE; 2017
  32. 32. Vishwakarma S, Ram SS. Dictionary learning for real time classification of human micro-Dopplers across multiple carrier frequencies. Signal Processing. 2017
  33. 33. Natarajan BK. Sparse approximate solutions to linear systems. SIAM Journal on Computing. 1995;24(2):227-234
  34. 34. Selesnick IW. Sparse Signal Restoration. 2010. Proceedings Available Online: http://cnx.Org/content/m32168/latest
  35. 35. Jiang Z, Lin Z, Davis LS. Label consistent k-svd: Learning a discriminative dictionary for recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2013;35(11):2651-2664
  36. 36. Dogaru T, Calvin L. Validation of Xpatch computer models for human body radar signature. Army Research Lab Adelphi MD Sensors and Electron Devices Directorate, 2008. No. ARL-TR-4403
  37. 37. Boulic R, Thalmann NM, Thalmann D. A global human walking model with real-time kinematic personification. The Visual Computer. 1990;6(6):344-358
  38. 38. Ram SS, Christianson C, Kim Y, Ling H. Simulation and analysis of human micro-dopplers in through-wall environments. IEEE Transactions on Geoscience and Remote Sensing. 2010;48(4):2015-2023

Written By

Shobha Sundar Ram

Submitted: 05 June 2017 Reviewed: 13 October 2017 Published: 20 December 2017