1. Emotion and attention recognition based on biological signals and images
This chapter will attempt to introduce the different approaches for recognition of emotional and attentional states, from a historical development, focusing particularly on the recent development of the field and its specialization within psychology, cognitive neuroscience, and engineering. The basic idea of this book is to present a common framework for the neuroscientists from diverse backgrounds in the cognitive neuroscience to illustrate their theoretical and applied research findings in emotion, stress, and attention.
Biological signal processing and medical image processing have helped greatly in understanding the below-mentioned cognitive processes. Up to now, researchers and neuroscientists have studied continuously to improve the performances of the emotion and attention recognition systems (e.g., [1–10]). In spite of all of these efforts, there is still an abundance of scope for the additional researches in emotion and attention recognition based on biological signals and images. In the meantime, interpreting and modeling the notions of the brain activity, especially emotion and attention, through soft computing approaches is a challenging problem.
Emotions and attentions have an important role in our daily lives . They definitely make life more challenging and interesting; however, they provide useful actions and functions that we seldom think about. Emotion and attention, due to its considerable influence on many brain activities, are important topics in the cognitive neurosciences, psychology, and biomedical engineering. These cognitive processes are core to human cognition and accessing it and being able to act have important applications ranging from basic science to applied science.
‘Emotion’ has many medical applications such as voice intonation, rehabilitation, autism, music therapy, and many engineering applications such as brain-computer interface (BCI), human-computer interaction (HCI), facial expression, body languages, neurofeedback, marketing, law, and robotics. In addition, ‘attention’ has many medical applications such as rehabilitation, autism, attention deficit disorder (ADD), attention deficit hyperactivity disorder (ADHD), attention-seeking personality disorder, and many engineering applications such as BCI, neurofeedback, decision-making, learning, and robotics.
Up to now, different definitions have been presented for the emotion and attention. According to most researchers, attention phenomenon and emotion phenomenon are not well-defined words. Kleinginna and her colleagues collected and analyzed 92 different definitions of emotion, then they made a decision that “
In different researches, suitable techniques are usually used according to invasive or noninvasive acquisition techniques. Invasive techniques often lead to efficient systems. However, they have inherent technical difficulties such as the risks associated with surgical implantation of electrodes, stricter ethical requirements, and the fact that in humans, this can only be done in patients undergoing surgery. Therefore, noninvasive techniques such as electroencephalography (EEG), magnetoencephalography (MEG), event-related potentials (ERPs), and functional magnetic resonance imaging (fMRI) are generally preferred.
S. Kesić and S. Z. Spasić, “Application of Higuchi’s fractal dimension from basic to clinical neurophysiology: A review,” Computer Methods and Programs in Biomedicine, vol. 133, pp. 55–70, 2016.
N. Sharma and T. Gedeon, “Objective measures, sensors and computational techniques for stress recognition and classification: A survey,” Computer Methods and Programs in Biomedicine, vol. 108, no. 3, pp. 1287–1301, 2012.
S. A. Hosseini, “Classification of brain activity in emotional states using HOS analysis,” International Journal of Image, Graphics and Signal Processing, vol. 4, no. 1, p. 21, 2012.
S. A. Hosseini, and M. A. Khalilzadeh, “Emotional stress recognition system for affective computing based on bio-signals,” Journal of Biological Systems, vol. 18, no. spec01, pp. 101–114, 2010.
S. A. Hosseini, M. B. Naghibi-Sistani, and M. R. Akbarzadeh-T, “A two-dimensional brain-computer interface based on visual selective attention by Magnetoencephalograph (MEG) signals,” Tabriz Journal of Electrical Engineering, vol. 45, no. 2, pp. 65–74, 2015.
J. Chen, B. Hu, P. Moore, X. Zhang, and X. Ma, “Electroencephalogram-based emotion assessment system using ontology and data mining techniques,” Applied Soft Computing, vol. 30, pp. 663–674, 2015.
S. A. Hosseini, M. A. Khalilzadeh, M. B. Naghibi-Sistani, and V. Niazmand, “Higher order spectra analysis of EEG signals in emotional stress states,” in IEEE Second International Conference on Information Technology and Computer Science( ITCS), 2010, pp. 60–63.
S. A. Hosseini, M. R. Akbarzadeh-T, and M. B. Naghibi-Sistani, “Hybrid approach in recognition of visual covert selective spatial attention based on MEG signals,” in IEEE International Conference on Fuzzy Systems( FUZZ), Istanbul, Turkey, 2015.
S. A. Hosseini, M. R. Akbarzadeh-T, and M. B. Naghibi-Sistani, “Evaluation of visual selective attention by event related potential analysis in brain activity,” Tabriz Journal of Electrical Engineering, vol. 45, no. 4, 2015.
S. A. Hosseini, M. A. Khalilzadeh, and M. Homam, “A cognitive and computational model of brain activity during emotional stress,” Advances in Cognitive Science, vol. 12, no. 2, pp. 1–14, 2010.
C. Peter and R. Beale, Affect and emotion in human- computer interaction: From theory to applications, vol. 4868. Springer-Verlag Berlin Heidelberg, 2008.
P. R. Kleinginna Jr and A. M. Kleinginna, “A categorized list of emotion definitions, with suggestions for a consensual definition,” Motivation and Emotion, vol. 5, no. 4, pp. 345–379, 1981.
R. L. Solso, “Cognitive Psychology,” Allyn and Bacon, Pearson Education (US), 1998.
M. S. Gazzaniga, R. B. Ivry, and G. R. Mangun, Cognitive neuroscience: The biology of the mind. Publisher: W. W. Norton & Company, 2013.