\r\n\tCell viability is defined as the number of healthy cells in a sample and proliferation of cells is a vital indicator for understanding the mechanisms inaction of certain genes, proteins, and pathways involved in cell survival or death after exposure to toxic agents. The methods used to determine viability are also common for the detection of cell proliferation. A cell viability assay is performed based on the ratio of live and dead cells. This assay is based on an analysis of cell viability in cell culture for evaluating in vitro drug effects in cell-mediated cytotoxicity assays for monitoring cell proliferation. Various methods are involved in performing a cell viability assay, including the dilution method, surface viable count, roll tube technique, nalidixic acid method, fluorogenic dye assay, and the Trypan Blue Cell Viability Assay. The cell viability assays can determine the effect of drug candidates on cells and be used to optimize the cell culture conditions. The parameters that define cell viability can be as diverse as the redox potential of the cell population, the integrity of cell membranes, or the activity of cellular enzymes. \r\n\tCytotoxicity is the degree to which a substance can cause damage to a cell. Cytotoxicity assays measure the ability of cytotoxic compounds to cause cell damage or cell death. Cytotoxicity assays are widely used in fundamental research and drug discovery to screen libraries for toxic compounds. The cell cytotoxicity and proliferation assays are mainly used for drug screening to detect whether the test molecules have effects on cell proliferation or display direct cytotoxic effects. In a cell-based assay, it is important to know how many viable cells are remaining at the end of the experiment. There are a variety of assay methods based on various cell functions such as enzyme activity, cell membrane permeability, cell adherence, ATP production, co-enzyme production, and nucleotide uptake activity. These methods could be classified in to different categories: (I) dye exclusion methods such as trypan blue dye exclusion assay, (II) methods based on metabolic activity, (III) ATP assay, (IV) sulforhodamine B assay, (V) protease viability marker assay, (VI) clonogenic cell survival assay, (VII) DNA synthesis cell proliferation assays and (V) Raman micro-spectroscopy. \r\n\tMedical devices have been widely used in various clinical disciplines and these devices have direct contact with the tissues and cells of the body, they should have good physical and chemical properties as well as good biocompatibility. Biocompatibility testing assesses the compatibility of medical devices with a biological system. It studies the interaction between the device and the various types of living tissues and cells exposed to the device when it comes into contact with patients.
\r\n
\r\n\t \r\n\tThe book will cover original studies, reviews, all aspects of Cell Viability and Cytotoxicity assays, methods, Biocompatibility of studies of biomedical devices, and related topics.
",isbn:"978-1-80356-246-9",printIsbn:"978-1-80356-245-2",pdfIsbn:"978-1-80356-247-6",doi:null,price:0,priceEur:0,priceUsd:0,slug:null,numberOfPages:0,isOpenForSubmission:!1,isSalesforceBook:!1,hash:"ad664980a1e5007239b6de58fcf0bd9a",bookSignature:"Prof. Sukumaran Anil",publishedDate:null,coverURL:"https://cdn.intechopen.com/books/images_new/11678.jpg",keywords:"Cytotoxicity, Cytotoxicity Testing, Biocompatibility, ATP Assay, MTT Assay, Cell Viability, DNA Synthesis Cell Proliferation Assays, Raman Micro-Spectroscopy, Trypan Blue Dye Exclusion Assay, Medical Devices, Drugs, Safety Testing",numberOfDownloads:null,numberOfWosCitations:0,numberOfCrossrefCitations:null,numberOfDimensionsCitations:null,numberOfTotalCitations:null,isAvailableForWebshopOrdering:!0,dateEndFirstStepPublish:"February 10th 2022",dateEndSecondStepPublish:"March 10th 2022",dateEndThirdStepPublish:"May 9th 2022",dateEndFourthStepPublish:"July 28th 2022",dateEndFifthStepPublish:"September 26th 2022",remainingDaysToSecondStep:"2 months",secondStepPassed:!0,currentStepOfPublishingProcess:4,editedByType:null,kuFlag:!1,biosketch:"Prof. Anil Sukumaran is currently Senior Consultant and Professor of Periodontics and Implant Dentistry, Hamad Medical Corporation/Qatar University, Doha, Qatar. He received his Ph.D. in 2002 at the University of Hong Kong. In 1995 he was the invited Researcher at the UK Centre for Oral HIV Studies, UMDS Guys Hospital, London. He is the honorary fellow of the International College of Dentists, USA, and Pierre Fauchard Academy, USA.",coeditorOneBiosketch:null,coeditorTwoBiosketch:null,coeditorThreeBiosketch:null,coeditorFourBiosketch:null,coeditorFiveBiosketch:null,editors:[{id:"420937",title:"Prof.",name:"Sukumaran",middleName:null,surname:"Anil",slug:"sukumaran-anil",fullName:"Sukumaran Anil",profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",biography:null,institutionString:null,position:null,outsideEditionCount:0,totalCites:0,totalAuthoredChapters:"0",totalChapterViews:"0",totalEditedBooks:"0",institution:null}],coeditorOne:null,coeditorTwo:null,coeditorThree:null,coeditorFour:null,coeditorFive:null,topics:[{id:"19",title:"Pharmacology, Toxicology and Pharmaceutical Science",slug:"pharmacology-toxicology-and-pharmaceutical-science"}],chapters:null,productType:{id:"1",title:"Edited Volume",chapterContentType:"chapter",authoredCaption:"Edited by"},personalPublishingAssistant:{id:"455410",firstName:"Dajana",lastName:"Jusic",middleName:null,title:"Mrs.",imageUrl:"https://mts.intechopen.com/storage/users/455410/images/20500_n.jpeg",email:"dajana.j@intechopen.com",biography:"As an Author Service Manager my responsibilities include monitoring and facilitating all publishing activities for authors and editors. From chapter submission and review, to approval and revision, copyediting and design, until final publication, I work closely with authors and editors to ensure a simple and easy publishing process. I maintain constant and effective communication with authors, editors and reviewers, which allows for a level of personal support that enables contributors to fully commit and concentrate on the chapters they are writing, editing, or reviewing. I assist authors in the preparation of their full chapter submissions and track important deadlines and ensure they are met. I help to coordinate internal processes such as linguistic review, and monitor the technical aspects of the process. As an ASM I am also involved in the acquisition of editors. Whether that be identifying an exceptional author and proposing an editorship collaboration, or contacting researchers who would like the opportunity to work with IntechOpen, I establish and help manage author and editor acquisition and contact."}},relatedBooks:[{type:"book",id:"1591",title:"Infrared Spectroscopy",subtitle:"Materials Science, Engineering and Technology",isOpenForSubmission:!1,hash:"99b4b7b71a8caeb693ed762b40b017f4",slug:"infrared-spectroscopy-materials-science-engineering-and-technology",bookSignature:"Theophile Theophanides",coverURL:"https://cdn.intechopen.com/books/images_new/1591.jpg",editedByType:"Edited by",editors:[{id:"37194",title:"Dr.",name:"Theophile",surname:"Theophanides",slug:"theophile-theophanides",fullName:"Theophile Theophanides"}],productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}},{type:"book",id:"3161",title:"Frontiers in Guided Wave Optics and Optoelectronics",subtitle:null,isOpenForSubmission:!1,hash:"deb44e9c99f82bbce1083abea743146c",slug:"frontiers-in-guided-wave-optics-and-optoelectronics",bookSignature:"Bishnu Pal",coverURL:"https://cdn.intechopen.com/books/images_new/3161.jpg",editedByType:"Edited by",editors:[{id:"4782",title:"Prof.",name:"Bishnu",surname:"Pal",slug:"bishnu-pal",fullName:"Bishnu Pal"}],productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}},{type:"book",id:"3092",title:"Anopheles mosquitoes",subtitle:"New insights into malaria vectors",isOpenForSubmission:!1,hash:"c9e622485316d5e296288bf24d2b0d64",slug:"anopheles-mosquitoes-new-insights-into-malaria-vectors",bookSignature:"Sylvie Manguin",coverURL:"https://cdn.intechopen.com/books/images_new/3092.jpg",editedByType:"Edited by",editors:[{id:"50017",title:"Prof.",name:"Sylvie",surname:"Manguin",slug:"sylvie-manguin",fullName:"Sylvie Manguin"}],productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}},{type:"book",id:"371",title:"Abiotic Stress in Plants",subtitle:"Mechanisms and Adaptations",isOpenForSubmission:!1,hash:"588466f487e307619849d72389178a74",slug:"abiotic-stress-in-plants-mechanisms-and-adaptations",bookSignature:"Arun Shanker and B. Venkateswarlu",coverURL:"https://cdn.intechopen.com/books/images_new/371.jpg",editedByType:"Edited by",editors:[{id:"58592",title:"Dr.",name:"Arun",surname:"Shanker",slug:"arun-shanker",fullName:"Arun Shanker"}],productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}},{type:"book",id:"72",title:"Ionic Liquids",subtitle:"Theory, Properties, New Approaches",isOpenForSubmission:!1,hash:"d94ffa3cfa10505e3b1d676d46fcd3f5",slug:"ionic-liquids-theory-properties-new-approaches",bookSignature:"Alexander Kokorin",coverURL:"https://cdn.intechopen.com/books/images_new/72.jpg",editedByType:"Edited by",editors:[{id:"19816",title:"Prof.",name:"Alexander",surname:"Kokorin",slug:"alexander-kokorin",fullName:"Alexander Kokorin"}],productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}},{type:"book",id:"314",title:"Regenerative Medicine and Tissue Engineering",subtitle:"Cells and Biomaterials",isOpenForSubmission:!1,hash:"bb67e80e480c86bb8315458012d65686",slug:"regenerative-medicine-and-tissue-engineering-cells-and-biomaterials",bookSignature:"Daniel Eberli",coverURL:"https://cdn.intechopen.com/books/images_new/314.jpg",editedByType:"Edited by",editors:[{id:"6495",title:"Dr.",name:"Daniel",surname:"Eberli",slug:"daniel-eberli",fullName:"Daniel Eberli"}],productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}},{type:"book",id:"57",title:"Physics and Applications of Graphene",subtitle:"Experiments",isOpenForSubmission:!1,hash:"0e6622a71cf4f02f45bfdd5691e1189a",slug:"physics-and-applications-of-graphene-experiments",bookSignature:"Sergey Mikhailov",coverURL:"https://cdn.intechopen.com/books/images_new/57.jpg",editedByType:"Edited by",editors:[{id:"16042",title:"Dr.",name:"Sergey",surname:"Mikhailov",slug:"sergey-mikhailov",fullName:"Sergey Mikhailov"}],productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}},{type:"book",id:"1373",title:"Ionic Liquids",subtitle:"Applications and Perspectives",isOpenForSubmission:!1,hash:"5e9ae5ae9167cde4b344e499a792c41c",slug:"ionic-liquids-applications-and-perspectives",bookSignature:"Alexander Kokorin",coverURL:"https://cdn.intechopen.com/books/images_new/1373.jpg",editedByType:"Edited by",editors:[{id:"19816",title:"Prof.",name:"Alexander",surname:"Kokorin",slug:"alexander-kokorin",fullName:"Alexander Kokorin"}],productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}},{type:"book",id:"2270",title:"Fourier Transform",subtitle:"Materials Analysis",isOpenForSubmission:!1,hash:"5e094b066da527193e878e160b4772af",slug:"fourier-transform-materials-analysis",bookSignature:"Salih Mohammed Salih",coverURL:"https://cdn.intechopen.com/books/images_new/2270.jpg",editedByType:"Edited by",editors:[{id:"111691",title:"Dr.Ing.",name:"Salih",surname:"Salih",slug:"salih-salih",fullName:"Salih Salih"}],productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}},{type:"book",id:"872",title:"Organic Pollutants Ten Years After the Stockholm Convention",subtitle:"Environmental and Analytical Update",isOpenForSubmission:!1,hash:"f01dc7077e1d23f3d8f5454985cafa0a",slug:"organic-pollutants-ten-years-after-the-stockholm-convention-environmental-and-analytical-update",bookSignature:"Tomasz Puzyn and Aleksandra Mostrag-Szlichtyng",coverURL:"https://cdn.intechopen.com/books/images_new/872.jpg",editedByType:"Edited by",editors:[{id:"84887",title:"Dr.",name:"Tomasz",surname:"Puzyn",slug:"tomasz-puzyn",fullName:"Tomasz Puzyn"}],productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}}]},chapter:{item:{type:"chapter",id:"51618",title:"Validation and Experimental Testing of Observers for Robust GNSS-Aided Inertial Navigation",doi:"10.5772/63575",slug:"validation-and-experimental-testing-of-observers-for-robust-gnss-aided-inertial-navigation",body:'\n
\n
1. Introduction
\n
Inertial navigation systems (INSs) are widely used with price being a crucial factor predetermining the application. In case of unmanned vehicles, “low-cost” or “cost-effective” systems are preferred in general applications. As long as low-cost inertial measurement units (IMUs) use micro-electro-mechanical system (MEMS)-based inertial sensors, they are small in dimension and light and are low power consuming, and thus their presence can be found for instance in mobile phones, terrestrial vehicles, robots, stabilized platforms as well as in unmanned aerial vehicles (UAVs), small aircraft, and satellites. Even if the applications are cost-effective, the performance commonly requires data fusion from various sources due to the inertial sensors’ imperfections, such as insufficient resolution for navigation purposes, bias instabilities, noise, etc. Therefore, special data treatment is required. In sense of aerial applications, the usage of UAVs has increased rapidly in recent years. UAVs can be used in many applications [1, 2] fulfilling a broad spectrum of assignments in fields of reconnaissance, surveillance, search and rescue, remote sensing for atmospheric measurements, traffic monitoring, natural disaster response, damage assessment, inspection of power lines, or for aerial photography [2, 3]. These applications generally require navigation to be carried out which includes the position, velocity, and attitude (PVA) estimation [4], and thus cost-effective solutions have been commonly studied and implemented with advantage.
\n
Current research and development in the area of low-cost navigation systems are focused on small-scale and integrated solutions [5]. As mentioned, as long as MEMS-based IMUs are used, the evaluation process requires data fusion from other aiding sources available. These sources stabilize errors in navigation solutions and thus increase navigation accuracy. Over the last few years, a solution for vehicle navigation without absolute position measurements provided by global positioning system (GPS) or radio frequency beacons has become very popular. For indoor or low-altitude navigation, it can use for example cameras, laser scanners, or odometers in terrestrial navigation [6, 7]. However, the solutions fusing inertial and GPS measurements are still preferable for aerial vehicles operating outside in large areas simply because of unblocked GPS signals. The implementation of other aiding sensors, such as magnetometer or pressure sensors, can further enhance the overall accuracy, reliability, and robustness of a navigation system [8, 9]. Attention is also paid to data processing algorithms used for PVA estimation, so that many literature sources can be found dealing with filtering techniques used for instance complementary filters [10], particle filters [11], or Kalman filters (KFs) [12, 13]. In the last named case, the extended KF (EKF) is used most of the time since it provides an acceptable accuracy with a reasonable computational load. Therefore, KF represents one of the most used algorithms for UAV attitude estimation (see comprehensive survey of estimation techniques in [14]) and is often complemented by other algorithms and decision-based aiding [15]. Since the accuracy of navigation systems is always directly related with the choice of sensors, the chapter also includes a short introduction on sensors suitable for cost-effective navigation systems as well as topics concerning stochastic sensor parameter evaluation methods and data pre-processing.
\n
The contribution of this chapter is dedicated to comparison of two approaches suitable for navigation solutions and thus provides a clear understanding of the differences in the studied approaches. These approaches are tuned to satisfy a certain level of accuracy and applied on real flight data. The results are compared to an accurate referential attitude obtained from a multi-antenna GPS receiver. Such comparison with an independent referential system provides a thorough evaluation of performances of the studied approaches and shows their capabilities to handle sensors’ imperfections and vibration impacts of harsh environment on the accuracy of attitude estimation in aerial applications.
\n
\n
\n
2. Theoretical background
\n
This section will include an introduction to sensors suitable for cost-efficient navigation systems, as well as topics concerning deterministic and stochastic sensor parameters. Moreover, a review of the current state of the art on state estimation will be included, while also the kinematic vehicle model and general assumptions are presented.
\n
\n
2.1. Inertial sensors
\n
Navigation systems providing the tracking of an object’s attitude, position, and velocity play a key role in a wide range of applications, e.g., in aeronautics, astronautics, robotics, automotive industry, underwater vehicles, or human motion observation. A basic technique to do so is via dead reckoning. One technique for dead reckoning is using an initial position, velocity, and attitude and consecutively updating the estimates based on acceleration and angular rate measurements. These measurements are generally provided by three axial accelerometer (ACC) and three axial angular rate sensors (gyros) forming a so-called inertial measurement unit (IMU). The inertial sensors have to be chosen according to required accuracy and economical aspects. The sensors are a major source of errors in navigation systems. Therefore, the type of application should be considered as well. The required accuracy related to various applications is shown in Figures 1 and 2, see [16], for gyroscopes and accelerometers, respectively.
\n
Figure 1.
Bias instability of gyroscopes related to specified applications [16].
\n
Figure 2.
Bias instability of accelerometers related to specified applications [16].
\n
Accuracy of performed navigation is related to inertial sensors’ characteristics such as resolution and sensitivity and their imperfections in terms of bias instability, scale factor nonlinearity, and dependency of sensitive element on other quantities than just gyros or ACCs. Unwanted deterministic behavior can be reduced by calibration, but stochastic parameters such as bias instability and initial offset can be described by statistical values.
\n
An uncompensated accelerometer bias, bACC, contributes in position error based on Δp=1/2bACCt2, where t is time. Thus, even small deviations in sensed acceleration will cause unbound error in position with time. For instance, when bACC = 0.1 mg is considered, it leads to position errors of 0.05 m after 10 s, and an error of 177 m after 600 s. Generally speaking, all navigation systems dedicated for aircraft need to fulfill the requirement of a maximum error of 1 nautical mile per hour. In navigation attitude, accuracy also plays a key role. When attitude is considered, the azimuth is the most difficult parameter to estimate, since ACCs can be used for pith and roll angle compensation. For azimuth compensation, other sources can be used, e.g., magnetometers and GNSS, but these are not inertial sensors and thus depend on environmental conditions.
\n
For aircraft navigation it is, according to Figures 1 and 2, required to use gyros with the precision better than 1 deg/h and ACC not more than 10μg, see [17]. The higher precision, the more expensive the device is. The other aspect, which has to be taken into account, is to check if a particular device is in solid state or is using moving parts. Figures 3 and 4 depict the current state of gyroscope and accelerometer technology. Recently, there has been a progress on MEMS-based sensors increasing the sensitivity of the gyroscopes to compete with the fiber optic gyros (FOGs). However, FOGs still provide better stability than the MEMS-based gyros. For ACCs, it has become very popular to use quartz resonator in applications with high-accuracy requirements due to its costs. If higher accuracy is still required, only mechanical pendulous rebalance (servo) ACCs have to be utilized. According to Figures 3 and 4, one can see that mechanical gyros and ACCs still satisfy the precision requirements best; nevertheless, there is a trend to replace them with solid-state devices for their better reliability, stability, and mean-time-before-failure parameter. Therefore, in the following paragraphs, solid-state devices will be considered.
\n
Figure 3.
Gyro technology [17].
\n
Figure 4.
Accelerometer types and their performances [17].
\n
The most precise device for angular rate measurements is a ring laser gyroscope (RLG), which has stability better than 0.1 deg/h and resolution better than 10−6 deg/s. In the case of ACC, the most precise existing device is a servo ACC with a resolution about 1 μg. These devices would have been ideal for all applications, if they were not so expensive. Due to this reason, other systems, such as micro-electro-mechanical system (MEMS)-based ones, have been used in cost-effective applications, such as navigation of small aircraft and unmanned vehicles both terrestrial and aerial. MEMS sensors offer reduced power consumption, weight, manufacturing and assembly costs, and increased system design flexibility. Reducing the size and weight of a device allows multiple MEMS components to be used to increase functionality, device capability, and reliability. In contrast, MEMS-based systems might suffer from low resolution, noisy output, bias instability, temperature dependence, etc. Nevertheless, their applicability in navigation is wide due to fast technology improvements, applied data processing algorithms, and aiding systems. In navigation, aiding systems are commonly used to provide corrections for position, velocity, or attitude. Those systems might be based for instance on GNSS, electrolytic tilt sensors, pressure-based altimeter, odometer, laser scan, or vision-based odometry usage.
\n
In cost-effective applications, MEMS-based devices are preferred. Therefore, their usage has to be accompanied by modern methods of signal and data processing, algorithms for their calibration, parameters identification, and fusion.
\n
\n
2.1.1. Gyroscopes
\n
The basic parameters generally provided in product datasheets include dynamic range, initial sensitivity, nonlinearity, alignment error, initial bias error, in-run bias instability, angular random walk, linear acceleration effect on bias, and rate noise density. According to these parameters, the following types of gyros can be defined: low-cost, moderate-cost, and high-performance gyros. When looking at datasheets, the in-run bias stability provides the information about the best sensor performance corresponding to the gyro resolution floor. Unfortunately, there are other exhibiting error factors which affect a gyro performance. In all cases, the gyro noise and its frequency dependency have to be taken into account and handled. Stochastic sensor parameters can be generally estimated via power spectral density (PSD) analyses or via Allan variance analysis (AVAR).
\n
In the case of low- and moderate-cost gyros, scale factor, alignment error, and null bias errors accompanied by parameters variation over a temperature range highly decrease the gyro performance. To minimize their impacts, it is required to perform the calibration within which a correction table or polynomial correction function is acquired. More details about the calibration methods and procedures can be found in [18].
\n
The other perspectives of the gyro performance are produced by the fact that it does not measure just a rotational rate, but also its sensitive element has linear acceleration and g2 sensitivities. It is caused by the asymmetry of a mechanical design and/or micromachining inaccuracies, and it can vary from design to design. Due to Earth’s 1 g field of gravity, according to [19], it can suffer from large errors when uncompensated. In the case of low-cost gyros, the g and g2 sensitivities are not specified because their design is not optimized for a vibration rejection. They can have g sensitivity about 0.3°/s/g. Therefore, looking at a bias instability in these cases is almost pointless due to the high effect of this vibration behavior. Higher performance gyros improve the vibration rectification by design so the g sensitivity can go down to about 0.01°/s/g. To further decrease this sensitivity, anti-vibration mounts might be applied. Nevertheless, these anti-vibration mounts are very difficult to design, because they do not have a flat response over a wide frequency range, and they work particularly poorly at low frequencies. Moreover, their vibration reduction characteristics change with temperature and life cycle.
\n
\n
\n
2.1.2. Accelerometers
\n
MEMS technology-based accelerometers (ACCs) in the navigation area measure specific force mainly on a capacitive principle and/or on a vibrating differential structure. The basic parameters include measurement range, nonlinearity, sensitivity, initial bias error, in-run bias instability, noise density, bandwidth of frequency response, alignment error, and cross-axis sensitivity. In the case of multi-axial ACCs, the z-axis often has a different noise and bias performance. Vibrations will affect ACCs; however, if the frequency spectrum is adequate for the application, no problem arises from this point of view. The current MEMS technology cannot compete with high-performance types and cannot be implemented to stand-alone inertial navigation systems due to their low resolution, bias instability, and insufficient noise level reduction. Generally, this type of ACC is used in navigation systems in which a GNSS receiver is also implemented to compensate position errors, or in attitude and heading reference systems in which the position is not required, and thus ACCs are used just for an attitude measurement done according to Earth’s field 1 g sensing. ACC stochastic parameters can be estimated the same way as in the case of gyros via PSD or AVAR. More details about the calibration and estimation of deterministic errors and consecutive analyses can be found in [18, 20].
\n
\n
\n
\n
2.2. Inertial sensors’ stochastic parameters
\n
Various methods for stochastic error estimation and sensor modeling exist, for example PSD and auto correlation function (ACF) which are straightforward; however, these methods cannot clearly distinguish different characters of noise error sources inside the data without understanding the sensor model and its state-space representation [21]. On the contrary, AVAR is a time-domain approach to analyze time series of data from the noise terms’ point of view. The AVAR was introduced by Allan in 1966 [22]. Originally, it was oriented at the study of oscillator stability; however, after its first publication, this kind of analysis was adopted for general noisy data characterization. Because of the close analogies to inertial sensors, the AVAR has been also included in the IEEE standards, e.g. [23–25], and that is why AVAR has become a standard tool for inertial sensors’ noise analysis. As described in [26], the AVAR technique provides several significant advantages over the others. Traditional approaches, such as computing the sampled mean and variance from a measured data set, do not reveal the underlying error sources. Although the combined PSD/ACF approach provides a complete description of error sources, the results are difficult to interpret.
\n
The AVAR and its results are related to five noise terms, defined in Table 1, whose typical performance can be seen in Figure 5. This kind of error sources can be identified in inertial sensor output, and whose estimation can lead to error suppression in the data [25, 27]. The five basic noise terms correspond to the following random processes: angle/velocity random walk, rate/acceleration random walk, bias instability, quantization noise, and drift rate ramp. Values of particular coefficients denoted in Table 2 in the last column can be observed in AVAR deviation plots in a time instance corresponding to the one indicated in particular brackets. Furthermore, this basic set of random processes is extended by the sinusoidal noise and exponentially correlated (Markov) noise [27]. Generally, a total noise error can be classified as a sum of individual independent noise errors [25], and the total variance can be expressed as\n
σtotal2=σQ2+σARW2+σBIN2+σRRW2+σRR2E1
\nwhere the abbreviations correspond to Table 1.\n
\n\n
\n
Type of noise
\n
Abbreviation
\n
Curve slope
\n
Value of coefficients
\n
\n
\n\n\n
\n
Quantization noise
\n
Q
\n
−1
\n
Q = σ(3)
\n
\n
\n
Angular/velocity random walk
\n
ARW
\n
−1/2
\n
N = σ(1)
\n
\n
\n
Flicker noise/bias instability
\n
BIN
\n
0
\n
B = σmin / 0.664
\n
\n
\n
Rate/acceleration random walk
\n
RRW
\n
+1/2
\n
K = σ(3)
\n
\n
\n
Rate ramp noise
\n
RR
\n
+1
\n
R=σ(2)
\n
\n\n
Table 1.
Summary of error sources and their characterization [25].
\n
Figure 5.
Allan variance/deviation plot [25].
\n
\n\n
\n
\n
Parameter
\n
DMU10 (Silicon S.)
\n
AHRS M3 (InnaLabs)
\n
MPU9150 (InvenSense)
\n
DSP-3100 (KVH)
\n
INN-204 (InnaLabs)
\n
\n\n\n
\n
GYR
\n
ARW(°/h)
\n
0.35
\n
2.50
\n
0.25
\n
0.03
\n
NA
\n
\n
\n
BIN (°/h)
\n
7.53
\n
55.72
\n
15.06
\n
0.60
\n
NA
\n
\n
\n
ACC
\n
VRW(m/s/h)
\n
0.05
\n
0.06
\n
0.08
\n
NA
\n
0.01
\n
\n
\n
BIN (mg)
\n
0.04
\n
0.06
\n
0.06
\n
NA
\n
0.01
\n
\n\n
Table 2.
Stochastic parameters of inertial sensors according to AVAR.
\n
\n
\n
2.3. State-of-the-art of state estimators
\n
Many physical systems are considered partly closed systems with no means of measuring internal signals, where only the inputs and outputs are available. However, it is often of interest to know the current value of the internal states, e.g., such that appropriate action can be taken using a control element. There might be multiple internal states and only a few measured outputs due to lack of appropriate sensors, cost, or insufficient data rate. The state estimation problem describes the need to estimate variables of interest in a model that is not otherwise directly observable [28].
\n
The model describes the dominating dynamics of the system, while less important dynamics might be removed for simplicity. The states for navigation systems often include position, linear velocity, and attitude of the vehicle, while the inclusion of auxiliary states is possible. These auxiliary states might describe specific force of the vehicle or inertial sensor errors [29].
\n
State estimators consist of two categories: “filters” and “observers.” Filters take the stochastic approach to find the current state values and consider the measurement and state noise as well as the covariance estimate of the states. Observers use a deterministic approach based on control theory focusing on the stability of the proposed equations. In both cases, a model of the physical system is duplicated to propagate the states while comparing with the system outputs. In the literature, the terms “filter” and “observer” are used somewhat interchangeably.
\n
The following sections will include a review of previous work on Kalman filters and nonlinear observers for navigation.
\n
\n
2.3.1. Kalman filter review
\n
Modern filtering theory began around 1959–1960 with publications by Swerling [30] and Kalman [31], presenting error propagation methods using a minimum variance estimation algorithm for linear systems. The discrete method presented by Kalman has received large attention and is now a coined term in multiple fields [32].
\n
The Kalman filter (KF) introduced a recursive algorithm for state estimation, which is optimal in the sense of minimum variance or least square error. Changing from analytical solutions to a recursive algorithm had the advantage of being easily implementable in digital computers. Another advantage was that the previous non-recursive estimation methods used the entire measurement set, whereas the recursive estimation of the KF uses current measurements as well as prior estimates to propagate the states from an initial estimate. The KF is therefore more computational efficient as it can discard previous measurements and update the state estimates with only the present measurements [29]. The KF theory was expanded upon in 1961 by Kalman and Bucy [33], introducing a continuous time variant.
\n
The Kalman filter’s stochastic approach to the state estimation problem assumes noise on the measurements as well as the state equations of the filter. It is a well-established state estimation approach [34] which excels in working with normal-distributed inputs characterized by their mean and covariance values and a linear time-varying state space model in its basic form. The KF is an estimator, which provides estimates of the state as well as its uncertainty [35]. The measurements have to be functions of the states, as the residual measurement (the difference between measured and estimated measurements) is used to update the states and keep them from diverging. The process and measurement noise is assumed to be Gaussian white noise. In some cases where the noise of the physical system cannot be confirmed to be white, the KF might be augmented, by so-called “shaping filters, with additional linear state equations to let the colored noise be driven by Gaussian white noise [28]. In addition to the recursive estimation of the model states, the Kalman filter also propagates a covariance matrix describing the uncertainties of the state estimates as well as the correlation between the various states [29].
\n
Even though the Kalman filter was designed for linear systems, it can be applied to nonlinear systems without changing the structure or the operational principles. However, the optimality of minimal variance of the errors is lost, and the filter is no longer an optimal estimator. The kinematic equations are inherently nonlinear and thus must be addressed by nonlinear techniques or approximations to maintain the performance and stability of the modeled system. Nonlinear problems are commonly handled by the linearized KF (LKF), extended KF (EKF), or sample-based methods such as unscented KF (UKF) [36, 37]. Probably the most popular of the mentioned methods is the EKF, which has been applied in an enormous number of applications where it achieved excellent performance [38]. The EKF linearizes the model around an estimate of the current mean using multivariate Taylor expansions to adapt to the nonlinear model; however, this makes the EKF more susceptible to errors in the initial estimates and modeling errors compared to the KF.
\n
The KF and EKF are seen as the standard theory and are therefore used as baseline for comparison when developing new methods. The KF and its variants are widely used in the navigation-related literature where a few examples are mentioned. An introduction to choice of states and sensor alignment consideration can be found in [39], while [40] considers alternative attitude error representations. For extensive details on Kalman filtering, see [28, 29, 38, 9, 41–43]. Among the extensions to nonlinear systems, other examples can be found, e.g., [44] where a method for evaluating the linearization quality is presented alongside a Kalman filter extension for nonlinear systems. The unscented Kalman filter (UKF) is an extension to nonlinear systems that does not involve an explicit Jacobian matrix, see e.g., [45]. Studies on time-correlated noise, as opposed to the white noise assumption, without state augmentation have been carried out in [46, 47]. The adaptive Kalman filter might be used in applications where tuning of the Kalman filter is uncertain at initialization, see [48–50]. If the application is not real-time critical, such as surveying, the estimate can be enhanced by use of a smoother. In [51], a forward smoother was proposed, while in [52] a backward smoother was introduced. When nonlinear systems are considered, another alternative to the EKF is the particle filter. Particle filters are based on sequential Monte Carlo estimation algorithms, which compared to the Kalman filter are more computationally demanding; however, they are noise distribution independent, see e.g. [37, 53–56]. The advantage of the particle filter is its use in nonlinear non-Gaussian systems. However, since this approach is computationally heavy in current navigation systems, it is not often used. Therefore, the particle filter is considered outside the scope of this chapter.
\n
\n
\n
2.3.2. Nonlinear observer review
\n
In comparison to the Kalman filter, the nonlinear observers have a shorter history, motivated by drawbacks of the KF when applied to nonlinear systems. These drawbacks include unclear convergence properties for nonlinear systems, difficulty of tuning, and large computational load.
\n
Nonlinear observers are contrary to the Kalman filters based on a deterministic approach. The noise is not assumed to have specific properties, except that the difference between the measured and estimated signal is smallest when the estimate reflects the true signal. Like the Kalman filter, nonlinear observers commonly utilize an injection term consisting of the difference between measured and estimated system output to drive the observer states toward the true values.
\n
The field of nonlinear observers has expanded within groups dealing with specific problems. Nonlinear attitude estimation has been the focus of extensive research [57–61]; see in particular [13] for an extensive survey including EKF methods. One method used has centered on the comparison of two attitude measurement vectors in the BODY frame with two corresponding vectors in an Earth-fixed or inertial frame. One such attitude observer was proposed by [62] and was later expanded upon by [63] to include a gyro bias estimate. A vector-based attitude observer was proposed by [64] which depended on inertial measurements, magnetometer readings, and GNSS velocity measurements. Expanding on this framework [65] introduced an attitude observer that utilized the derivative of the GNSS velocity as the vehicle acceleration allowing for comparison with accelerometer measurements.
\n
Where the Kalman filter computes new gains for each iteration, some nonlinear observers have proven convergence with fixed or slowly time-varying gains, e.g. [66]. This is a computational improvement as the gain determination is the dominating computational burden, see [28; Section 5.6.1].
\n
One of the design challenges of nonlinear observers is the requirement for proven stability. The optimality of the Kalman filter may give the user confidence in the performance and stability of the filter. However, for nonlinear observers, the stability should be explicitly stated, as the gain usually comes without any optimality guarantee. The aim is to be robust toward disturbances and poor initial estimates.
\n
The field of nonlinear observers is recent and rapidly expanding. A few publications within navigation are mentioned here. Considerations of a nonlinear attitude estimator for use on a small aircraft was presented in [67], while a globally exponentially stable observer for long baseline navigation was presented in [68] with clock bias estimation in a tightly coupled system.
\n
\n
\n
\n
2.4. Models and preliminaries
\n
Estimating the position, linear velocity, and attitude (PVA) of a vehicle is commonly achieved through INS/GNSS integration, where the inertial navigation system (INS) consists of an inertial measurement unit (IMU) providing inertial navigation between updates from a GNSS receiver. The GNSS receiver usually has a lower sample rate than the IMU and is used to update the PVA estimates by correcting for the drift of the inertial sensors.
\n
\n
2.4.1. Notation
\n
A column vector x∈ℝ3 is denoted x = [x1; x2; x3] with its transpose xT and Euclidean vector norm ‖x‖2. The same notation is used for matrices where the induced norm is used. The skew symmetric matrix of a vector x is given as\n
S(x)=[0−x3x2x30−x1−x2x10]
\n
A unit quaternion, q = [rq; sq], consisting of a real part, rq∈ℝ, and a vector part, sq∈ℝ3, has ‖q‖2 = 1. A vector x∈ℝ3 can be represented as a quaternion with zero real part; x¯=[0;x]. The product of two quaternions q1 and q2 is the Hamiltonian product denoted by q1⊗q2. The cross-product of two vectors is then represented by ×.
\n
Superscripts are used to signify which coordinate frame a vector is decomposed in. Rotation between two frames may be represented by a quaternion, qac, describing the rotation from coordinate frame a to c, with the corresponding rotation matrix Rac=R(qac)∈SO3, where R(qac):=I+2sqacS(rqac)+2S(rqac)2. The attitude can also be expressed as Euler angles; Θca=[ϕ,θ,ψ]T with the associated rotation matrix Rac=R(Θca):\n
\nwhere the sine and cosine functions have been abbreviated, e.g. sin(ϕ)=sϕ. There is no difference between using R(qac) and R(Θca) in terms of transformation. The Euler angles are often preferred as they are more intuitively interpreted; however, they suffer from singularities (e.g., at pitch of 90°) which the quaternion representation avoids [40].\n
Various reference frames will be used where the Earth-centered-Earth-fixed (ECEF) frame will use notation e, while b will be used for BODY frame, n for North East down (NED), and i for Earth-centered inertial (ECI) frame.
\n
\n
\n
2.4.2. Kinematic vehicle model
\n
The vehicle model describes position, pe, and linear velocity, ve, as well as the attitude described either as Euler angles or quaternions. The gyroscope bias, bb, is also included in the model and is assumed to be slowly time varying.
\n
The kinematic equations describing the vehicle motion are [22]\n
p˙e=veE2
\n
v˙e=−2S(ωiee)ve+fe+ge(pe)E3
\n
q˙be=12qbe⊗ω¯ibb−12ω¯iee⊗qbeE4
\n
R˙bn=RbnS(ωibb)E5
\n
b˙b=0E6
\nwhere Earth rotation rate around the ECEF z-axis, ωiee, is known and ge(pe) is the plumb bob gravity vector at the vehicle position. The specific force acting on the vehicle is described by fe. The rotational matrix from body to NED frame is denoted as Rbn. The kinematic equations for the Euler angle and quaternion propagations have been included; however, at implementation, only one of Eqs. (4) or (5) should be used.\n
The vehicle is described with 6 degrees of freedom (DOF) where the BODY-frame vectors are defined as shown in Figure 6. An UAV is used as an example with a position vector pb = (xb, yb, zb) and Euler vector Θnb=[ϕ,θ,ψ]T.
\n
Figure 6.
6 DOF UAV in the BODY frame.
\n
The UAV can be seen as an example of a high dynamic vehicle and can be considered a challenging navigation environment, as it allows for rapid changes in attitude and heading.
\n
\n
\n
2.4.3. Measurement assumptions
\n
It is assumed that the vehicle is equipped with an IMU and a GNSS receiver, as well as a magnetometer. The following measurements are assumed available:\n
Position measurement, pGNSSe=pe,
Specific force measurement, fIMUb=fb, acting on the vehicle,
Magnetic field measurement, mIMUb=mb, of the Earth’s magnetic field at vehicle position.
\n
Furthermore, knowledge of bounds on the magnitude of specific force and gyro bias, denoted as Mf and Mb respectively, is assumed. The natural magnetic field at any position is assumed known in NED and ECEF frame, as mn and me, respectively.
\n
\n
\n
\n
\n
3. Practical approaches to the state estimation problem
\n
In the following, the two state estimators will be introduced. First, the EKF will be presented where the Allan variance is applied to tune the covariance matrices. Second, the nonlinear observer will be introduced consisting of two parts: a nonlinear attitude estimator and a translational motion observer.
\n
\n
3.1. Extended Kalman filter
\n
One solution for estimating position, linear velocity, and attitude is to utilize an IMU/GPS loosely coupled integration scheme, shown in Figure 7, which can be done by an EKF (for details about the EKF algorithm see [69]). The 12-dimensional state vector contains position in NED frame, velocity in the BODY frame, attitude, and gyro biases. The estimation is done with respect to a control vector u consisting of measured specific forces and angular rates, and to a measurement vector y defined in Eq. (8). The measurement vector in Eq. (8) is three dimensional and includes a GNSS position in NED frame. The state and measurement vectors are given as\n
x=[pN,pE,pD,vx,vy,vz,ϕ,θ,ψ,bωx,bωy,bωz]TE7
\n
y=[pN,pE,pD]TE8
\nwhere pn=(pN,pE,pD) are components of position vector in NED frame; vb=(vx,vy,vz) are the BODY-frame components of velocity vector; the gyroscope bias is decomposed into bb=(bωx,bωy,bωz); and y is the measurement vector.\n
Figure 7.
IMU/GNSS loosely coupled integration scheme.
\n
(SF stands for specific force and LP is low pass)
\n
The system function f(x, u) propagates the state x and input u (i.e., accelerations and angular rates) and the measurement function h(x) is used to update the EKF state with measurements (i.e., GNSS-based position). They are defined as\n
\nwhere gn=[0;0;g]T is the gravity vector and sec(⋅) is the secant function. The process and measurement noise covariance matrices Q and R for the model used in Eqs. (9) and (10) are defined as follows:\n
Q=diag(03,σv2,σω2,σbω2),R=diag(σp2)E11
\nwhere diag denotes a diagonal matrix, and σ*2 is a vector of element-wise squared standard deviations for velocity, angular rate, gyroscope biases, and GNSS-based position.\n
The system dynamic and measurement models are\n
xk=Φk−1xk−1+Γk−1uk−1+wk−1E12
\n
zk=Hkxk+vkE13
\nwhere the state transition matrix, Φk, and control matrix, Γk, are linearized from Eq. (9) with respect to the state and input vector, respectively. The initial conditions are E〈x0〉=x^0 and E〈x0,x0T〉=P0. The process noise and measurement noise are assumed to satisfy wk~N(0,Qk) and vk~N(0,Rk).\n
Figure 8.
Enhanced IMU/GNSS integration scheme.
\n
The state vector and covariance matrices are described by a priori and posteriori part denoted with superscripts − and +, respectively. A discrete form of the time and correction update of the state vector and covariance matrix are given as [69]:\n
x^k−=Φk−1x^k−1++ΓkukE14
\n
Pk−=Φk−1Pk−1+Φk−1T+Qk−1E15
\n
Kk=Pk−HkT(HkPk−HkT+Rk)−1E16
\n
x^k+=x^k−+Kk(zk−Hkx^k−)E17
\n
Pk+=(I−KkHk)Pk−E18
\nwhere the Kalman gain matrix is denoted by Kk, while the observation matrix, Hk, is the linearization of Eq. (10) with respect to the state vector.\n
The advantage of this approach is a straightforward implementation and satisfactory navigation performance. The motion model is corrected for the centrifugal force; therefore, it is highly preferable for applications where this force occurs frequently, e.g., during a turn. However, even when properly tuned, the estimates strongly rely on the GNSS signal availability. In the case of blocked or lost GNSS signal, the estimates begin to diverge quickly and results may become unstable as long as the filter parameters are not adjusted.
\n\n
To enable enhanced positioning function of the solution within GNSS outages, it is recommended to integrate accelerometer biases into a state vector and add attitude corrections obtained from accelerometer readings. This extended solution might use the integration scheme depicted in Figure 8.
\n
\n
3.1.1. AVAR applied in Kalman filter modeling
\n
Having a state transition matrix and observation matrix defined is one issue, but it is also very important to set driving noise in accordance to expected situation. The AVAR analysis can help to do so in terms for inertial sensors. A comparison of different grades inertial sensors from their stochastic parameters point of view is shown in Figures 9 and 10 and further summarized in Table 2 where two basic parameters, i.e., angular random walk (ARW) or velocity random walk (VRW), and bias instability (BIN) are picked up.
\n
Figure 9.
AVAR analysis—Allan deviation plot of several MEMS based gyros (DMU10, DSP3100—tactical grade gyros, AHRS M3, MPU9150—commercial grade gyros).
\n
Figure 10.
AVAR analysis—Allan deviation plot of several MEMS-based accelerometers (DMU10, INN204— tactical grade, AHRS M3, MPU9150—commercial grade).
\n
According to Table 1, one can see that analyzed sensors differ, but the parameters still correspond to its sensor grade. However, it needs to be highlighted that the cheapest IMU MPU-9150 has parameters close to the boundary between commercial and tactical grade. So it leads to considering this unit as suitable for navigation solutions in robotics for its price and performance. From other perspectives, it is hard to say anything about the gyro sensitivity to “g” in the form of vibrations which might degrade the overall performance. Parameters ARW/VRW and BIN are generally used in covariance matrix of process noise, of course according to the particular model utilized.
\n
Figure 11.
Block diagram of nonlinear observer.
\n
\n
\n
\n
3.2. Nonlinear observer
\n
Numerous nonlinear observers have been proposed for integration of IMU and GNSS data; however, in the following, the observer proposed in [66] will be considered, estimating position and velocity in the ECEF frame and describing the attitude as a unit quaternion.
\n\n
The nonlinear observer presented here has a modular structure consisting of an attitude estimator and a translational motion observer. The two subsystems are interconnected with feedback of the specific force estimate from the motion observer to the attitude estimator. An advantage of the modular design is that the stability properties of the subsystems can be investigated individually leading to the stability result of the entire observer system using nonlinear stability theory, see [66] for further details. The observer structure is depicted in Figure 11.
\n
The subsystems will be explained in detail in the following sections.
\n
\n
3.2.1. Attitude estimation
\n
The attitude of the vehicle is denoted by a unit quaternion, q^be, describing the rotation between the BODY and ECEF frame. The attitude observer is a complementary filter fusing data from an accelerometer, magnetometer, and gyroscope to estimate the vehicle attitude. The nonlinear observer estimating the attitude and gyro bias, b^b, is given as [58, 61]:
\n
q^˙be=12q^be⊗(ω¯ib,IMUb−b^¯b+σ^¯)−12ω¯iee⊗q^beE19
\n
b^˙b=Proj(b^b,−kIσ^)E20
\n
σ^=k1v1b×R(q^be)Tv1e+k2v2b×R(q^be)Tv2eE21
\n
where k1, k2, and kI are positive and sufficiently large tuning constants. The Proj(·,·) operator limits the gyro bias estimate to a sphere with radius Mb^ where Mb^>Mb. The injection term, σ^, consists of two vectors in BODY frame and their corresponding vectors in ECEF frame. There are various ways of choosing these vectors, but here they will be considered as
where the specific force estimate, f^e, will be supplied by the translational motion observer, while the magnetic field vector, me, is assumed known and depends on the vehicle position.
\n
\n
\n
3.2.2. Translational motion observer
\n
The translational motion observer estimates the position and velocity of the vehicle by using injection terms based on the difference between measured and estimated position. The measurements are traditionally provided by a GNSS receiver. Additionally, the observer also estimates the specific force of the vehicle by introducing an auxiliary state, ξ. The translational motion observer is described by
The observer can also be stated with additional injection terms using GNSS velocity; however, it was shown in [70] that the velocity part of the injection term is not required to achieve stability.
\n
The constant θ ≥ 1 serves as a tuning parameter that should be sufficiently large to guarantee global stability of the interconnection of the translational motion observer and attitude observer. The gain matrices, Kpp, Kvp, and Kξp can be chosen to satisfy A−KC being Hurwitz with\n
A=[0I3000I3000],C=[I300],K=[KppKvpKξp]E27
\n
The translational motion observer is similar to the EKF, and the gain matrix K can therefore be determined similarly to the EKF gain, by solving a Riccati equation. However, an advantage of this nonlinear observer is that the gain matrix is not required to be determined in each iteration, but rather on a slower time scale, see [66]. This time scale can be slower than the GNSS update rate, decreasing the computational load substantially. The load can be further reduced by considering the implementation as a fixed gain observer only determining the gains at the initialization phase. It has been shown in [71] that time-varying gains aid in sensor noise suppression and gives faster convergence.
\n
\n
\n
\n
\n
4. Experimental verification
\n
Experimental measurements from flights with a fixed-wing Bellanca Super Decathlon XXL unmanned aerial vehicle (UAV) are used to verify and compare the performance of the EKF and nonlinear observer. The UAV (shown in Figure 6) is equipped with an ADIS 16375 IMU, supplying acceleration and angular rate measurements, a HMR2300 magnetometer, and a GARMIN 18X GPS-receiver. The inertial data are sampled at 100 Hz, while the position measurements are sampled at 5 Hz. Furthermore, the UAV is equipped with a Polar X2@e (Septentrio) GPS system consisting of three antennas, placed at the wing tips and tale, providing attitude and position estimates. The estimates of the Septentrio system are considered highly accurate and therefore used as a reference for comparison with the estimates of the EKF and nonlinear observer.
\n
The accuracy of the reference represented by the three-antenna Septentrio GPS receiver is evaluated based on the distances among three antennas and manufacturer documentation. The resulting attitude accuracy of 1σ is 0.2° in roll angle, 0.6° in pitch angle, and 0.3° in yaw angle. Accuracy in horizontal position in standalone application is 1.1m, with SBAS corrections about 0.7m.
\n
The goal of the following experimental verification is to compare the performance of the proposed EKF and nonlinear observer. Two datasets were used in the verification where it was desired to use the same tuning for both datasets to ensure that the state estimators were not tuned specifically for a single dataset. The performance has been evaluated by comparison with the reference position, speed, and attitude. For each of the datasets, figures showing the estimation errors are depicted comparing the state estimators.
\n
\n
4.1. Parameters and tuning variables
\n
The state estimators have several parameters and tuning variables to be determined, which will be presented and explained here. In the case of coinciding, naming subscripts “EKF” and “NO” will be used.
\n
Tuning the EKF consists of choosing reasonable QEKF and REKF matrices. While the REKF matrix relies on the accuracy of the GNSS receiver, the QEKF matrix describes the expected process noise due to accelerometer and gyro noise and instabilities and can be tuned for the application. Here they are initialized as REKF = 14.40 I3, with QEKF = blkdiag (03, 0.0962I3, 0.0761 · 10−4I2, 0.3047 · 10−4, 3.0462 · 10−10I3). The state vector is driven by measured angular rates and specific force by inertial sensors having particular noise parameters. These parameters should be involved in the QEKF matrix.
\n
Two versions of the fixed gain nonlinear observer are presented for comparison with the difference being the vectors used for attitude estimation: a magnetometer implementation (denoted as NLO-Mag) and a version with velocity vectors (denoted as NLO-Vel). The NLO-Vel version substitutes v2b and v2e in Eq. (22) with v2b=[1;0;0] and v2e=v^e/‖v^e‖2. This approach assumes the heading and course to be coinciding, which is mostly true for straight flight trajectories, ensuring uniform semi-global exponential stability through [72]. For flights including numerous turns, a magnetometer might be preferred as loitering, and cross-winds could affect the heading assumption.
\n
The nonlinear observers include bound parameters which should be chosen sufficiently large Mb = 0.0087, while the remaining parameters are k1 = 0.2, k2 = 0.05, θ = 1, kI = 0.00005. The fixed gains are Kpp = 0.38I3, Kvp = 0.44 I3 and Kξp = 0.14 I3. For the NLO-Vel, the attitude injection gain is substituted for k2v = 0.01.
\n
The initial values of the state vectors are chosen from the first available measurements and are similar for the three estimators (EKF, NLO-Mag, and NLO-Vel). It is important to tune the three state estimators equally and thoroughly to keep the comparison fair.
\n
\n
\n
4.2. Results
\n
Two datasets are available using the same UAV and sensor suite. The proposed state estimators are tested on both datasets to verify that they are not tuned exclusively for one dataset. The inertial measurements are preprocessed with a low-pass filter whose bandwidth is set according to vibration spectrum. Based on measured real-flight data obtained by the IMU unit and FFT analyses shown in Figure 12, the bandwidth of the fifth order low-pass filter was set to 5 Hz.
\n
Figure 12.
Amplitude spectrum of the IMU measurements from the UAV flight. Top—accelerations, bottom—angular rates.
Results of dataset 1 can be seen in Figures 13–16, while the results of dataset 2 are shown in Figures 17–20. The occasional gap in the attitude error is due to temporary loss of reference. The findings are evaluated and summarized in Table 2 which compares the two estimators during the two flights.
The trajectory of flight 1 is shown in Figure 13, covering an area of approximately 0.7 km2 with a maximum altitude of 170 m. The estimation errors of speed, attitude, and position are shown in Figures 14–16, where the speed estimation error is centered around zero and includes a zoomed view for clarification. The attitude errors shown in Figure 15 have similar behavior for roll and pitch for the state estimators, whereas the nonlinear yaw estimate has some systematic offset. The position errors of Figure 16 are very similar for the state estimators attesting that the nonlinear observers have comparable results to the EKF.
The second dataset consisted of approximately a third of the amount of measurements compared to Dataset 1. The speed and attitude estimation errors are shown in Figures 17 and 18, with comparable performance between the EKF and nonlinear observers. The position errors depicted in Figure 19 show that an offset is present between the estimates, although the estimates follow the same pattern. Finally, the gyro bias estimates are shown in Figure 20. As there are no reference for the gyro biases, these are included to show the similarities across the state estimators.
In summary, according to Table 3 and previous figures, the EKF and nonlinear observers are seen to have similar performance during both compared flights. The differences can be assumed negligible, and real flight conditions are considered. The attitude estimates shown in Figures 15 and 18 are very alike and correspond well to the reference, although the nonlinear yaw estimation is seen to have a systematic difference.
\n
\n\n
\n
\n
\n
EKF
\n
NLO-Mag
\n
NLO-Vel
\n
\n\n\n
\n
Dataset 1
\n
POS RMS:
\n
3.43
\n
2.71
\n
2.62
\n
3.37
\n
2.62
\n
2.50
\n
3.37
\n
2.63
\n
2.50
\n
\n
\n
\n
POS STD:
\n
2.60
\n
2.44
\n
2.46
\n
2.48
\n
2.41
\n
2.44
\n
2.48
\n
2.42
\n
2.44
\n
\n
\n
\n
ATT RMS:
\n
1.83
\n
2.59
\n
5.50
\n
2.02
\n
2.69
\n
5.46
\n
1.93
\n
3.01
\n
6.88
\n
\n
\n
\n
ATT STD:
\n
1.67
\n
1.81
\n
5.42
\n
1.84
\n
1.90
\n
5.28
\n
1.90
\n
1.92
\n
6.15
\n
\n
\n
\n
SPE RMS:
\n
\n
0.60
\n
\n
\n
0.67
\n
\n
\n
0.69
\n
\n
\n
\n
\n
SPE STD:
\n
\n
0.59
\n
\n
\n
0.66
\n
\n
\n
0.69
\n
\n
\n
\n
Dataset 2
\n
POS RMS:
\n
4.43
\n
4.40
\n
3.43
\n
3.38
\n
5.00
\n
3.63
\n
3.37
\n
5.00
\n
3.63
\n
\n
\n
\n
POS STD:
\n
2.53
\n
4.35
\n
2.86
\n
2.46
\n
4.20
\n
2.82
\n
2.46
\n
4.20
\n
2.82
\n
\n
\n
\n
ATT RMS:1.76
\n
1.87
\n
6.39
\n
2.09
\n
1.87
\n
7.85
\n
1.56
\n
1.94
\n
6.36
\n
\n
\n
\n
ATT STD:
\n
1.70
\n
1.66
\n
6.34
\n
1.73
\n
1.67
\n
6.28
\n
1.46
\n
1.59
\n
6.36
\n
\n
\n
\n
SPE RMS:
\n
\n
0.86
\n
\n
\n
1.06
\n
\n
\n
1.05
\n
\n
\n
\n
\n
SPE STD:
\n
\n
0.83
\n
\n
\n
1.02
\n
\n
\n
1.02
\n
\n
\n\n
Table 3.
Observer performance comparison (NED position in m, attitude in degree, and speed in m/s).
\n
The position estimation errors depicted in Figures 16 and 19 are within the expected bounds. From Table 3, it can be concluded that the three state estimators have good performances with little variation between the estimators. It can further be concluded that the tuning used gave good results for both datasets.
\n
\n
\n
\n
5. Conclusive remarks
\n
Two methods for INS/GNSS integration have been investigated and compared: an extended Kalman filter using a 12-state vector and a nonlinear observer. The advantages and drawbacks of the methods have been presented and experimentally verified on flight data from a fixed-wing UAV. A reference system consisting of three-antenna GNSS receiver with the antennas placed at the tail and each wing tip was use for performance comparison of the presented state estimators.
\n
The inertial sensors used in the integration schemes are considered low-cost variants with respect to the reference system utilized. As the performance of the presented methods estimates the position, linear velocity, and attitude reasonably close to the reference, it is concluded that the methods are able to overcome the vibrations, disturbances, and bias drift connected to low-cost sensors in reasonable manner and thus provide sufficiently stable and accurate navigation solution.
\n
\n
Acknowledgments
\n
This work was partially supported by the EEA/Norway grant No. NF-CZ07-ICP-3-2082015 supported by the Ministry of Education, Youth and Sports of the Czech Republic and named Enhanced Navigation Algorithms in Joint Research and Education, and partially by Norwegian Research Council (projects no. 221666 and 223254) through the NTNU Centre of Autonomous Marine Operations and Systems (NTNU AMOS) at the Norwegian University of Science and Technology.
\n
\n',keywords:"inertial navigation, INS/GNSS, integration, nonlinear observers, extended Kalman filter, UAV",chapterPDFUrl:"https://cdn.intechopen.com/pdfs/51618.pdf",chapterXML:"https://mts.intechopen.com/source/xml/51618.xml",downloadPdfUrl:"/chapter/pdf-download/51618",previewPdfUrl:"/chapter/pdf-preview/51618",totalDownloads:1677,totalViews:257,totalCrossrefCites:2,totalDimensionsCites:3,totalAltmetricsMentions:0,impactScore:1,impactScorePercentile:66,impactScoreQuartile:3,hasAltmetrics:0,dateSubmitted:"October 19th 2015",dateReviewed:"April 12th 2016",datePrePublished:null,datePublished:"September 28th 2016",dateFinished:"July 6th 2016",readingETA:"0",abstract:"This chapter is the study of state estimators for robust navigation. Navigation of vehicles is a vast field with multiple decades of research. The main aim is to estimate position, linear velocity, and attitude (PVA) under all dynamics, motions, and conditions via data fusion. The state estimation problem will be considered from two different perspectives using the same kinematic model. First, the extended Kalman filter (EKF) will be reviewed, as an example of a stochastic approach; second, a recent nonlinear observer will be considered as a deterministic case. A comparative study of strapdown inertial navigation methods for estimating PVA of aerial vehicles fusing inertial sensors with global navigation satellite system (GNSS)-based positioning will be presented. The focus will be on the loosely coupled integration methods and performance analysis to compare these methods in terms of their stability, robustness to vibrations, and disturbances in measurements.",reviewType:"peer-reviewed",bibtexUrl:"/chapter/bibtex/51618",risUrl:"/chapter/ris/51618",book:{id:"5245",slug:"recent-advances-in-robotic-systems"},signatures:"Jakob M. Hansen, Jan Roháč, Martin Šipoš, Tor A. Johansen and\nThor I. Fossen",authors:[{id:"132264",title:"Prof.",name:"Tor Arne",middleName:null,surname:"Johansen",fullName:"Tor Arne Johansen",slug:"tor-arne-johansen",email:"tor.arne.johansen@itk.ntnu.no",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",institution:{name:"Norwegian University of Science and Technology",institutionURL:null,country:{name:"Norway"}}},{id:"179630",title:"Prof.",name:"Thor",middleName:"I",surname:"Fossen",fullName:"Thor Fossen",slug:"thor-fossen",email:"thor.fossen@ntnu.no",position:null,profilePictureURL:"https://mts.intechopen.com/storage/users/179630/images/4350_n.jpg",institution:null},{id:"179647",title:"Dr.",name:"Martin",middleName:null,surname:"Šipoš",fullName:"Martin Šipoš",slug:"martin-sipos",email:"martin.sipos@fel.cvut.cz",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",institution:null},{id:"179649",title:"Associate Prof.",name:"Jan",middleName:null,surname:"Rohac",fullName:"Jan Rohac",slug:"jan-rohac",email:"xrohac@fel.cvut.cz",position:null,profilePictureURL:"https://mts.intechopen.com/storage/users/179649/images/4644_n.jpg",institution:null},{id:"181258",title:"Mr.",name:"Jakob Mahler",middleName:null,surname:"Hansen",fullName:"Jakob Mahler Hansen",slug:"jakob-mahler-hansen",email:"jakob.mahler.hansen@itk.ntnu.no",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",institution:null}],sections:[{id:"sec_1",title:"1. Introduction",level:"1"},{id:"sec_2",title:"2. Theoretical background",level:"1"},{id:"sec_2_2",title:"2.1. Inertial sensors",level:"2"},{id:"sec_2_3",title:"2.1.1. Gyroscopes",level:"3"},{id:"sec_3_3",title:"2.1.2. Accelerometers",level:"3"},{id:"sec_5_2",title:"2.2. Inertial sensors’ stochastic parameters",level:"2"},{id:"sec_6_2",title:"2.3. State-of-the-art of state estimators",level:"2"},{id:"sec_6_3",title:"2.3.1. Kalman filter review",level:"3"},{id:"sec_7_3",title:"2.3.2. Nonlinear observer review",level:"3"},{id:"sec_9_2",title:"2.4. Models and preliminaries",level:"2"},{id:"sec_9_3",title:"2.4.1. Notation",level:"3"},{id:"sec_10_3",title:"2.4.2. Kinematic vehicle model",level:"3"},{id:"sec_11_3",title:"2.4.3. Measurement assumptions",level:"3"},{id:"sec_14",title:"3. Practical approaches to the state estimation problem",level:"1"},{id:"sec_14_2",title:"3.1. Extended Kalman filter",level:"2"},{id:"sec_14_3",title:"3.1.1. AVAR applied in Kalman filter modeling",level:"3"},{id:"sec_16_2",title:"3.2. Nonlinear observer",level:"2"},{id:"sec_16_3",title:"3.2.1. Attitude estimation",level:"3"},{id:"sec_17_3",title:"3.2.2. Translational motion observer",level:"3"},{id:"sec_20",title:"4. Experimental verification",level:"1"},{id:"sec_20_2",title:"4.1. Parameters and tuning variables",level:"2"},{id:"sec_21_2",title:"4.2. Results",level:"2"},{id:"sec_23",title:"5. Conclusive remarks",level:"1"},{id:"sec_24",title:"Acknowledgments",level:"1"}],chapterReferences:[{id:"B1",body:'B. Liu, Z. Chen, X. Liua, and F. Yang. An Efficient Nonlinear Filter for Space Attitude Estimation. International Journal of Aerospace Engineering, 1–11, 2014.'},{id:"B2",body:'M. Tarhan and E. Altug. EKF based Attitude Estimation and Stabilization of a Quadrotor UAV Using Vanishing Point in Catadioptric Images. Journal of Intelligent & Robotic Systems, 62(3-4):587–607, 2011.'},{id:"B3",body:'Derek B. Kingston and Randal W. Beard. Real-Time Attitude and Position Estimation for Small UAVs Using Low-Cost Sensors. American Institute of Aeronautics and Astronautics, “Unmanned Unlimited”, 1–9, 2004.'},{id:"B4",body:'Y. S. Suh. Attitude Estimation by Multiple-Mode Kalman Filters. IEEE Transactions on Industrial Electronics, 53(4):1386–1389, 2006.'},{id:"B5",body:'S. Leutenegger and R. Siegwart. A Low-Cost and Fail-Safe Inertial Navigation System for Airplanes. IEEE Conference on Robotics and Automation, 2012.'},{id:"B6",body:'A. Bry, A. Bachrach, and N. Roy. State Estimation for Aggressive Flight in GPS-denied Environments Using Onboard Sensing. Proceedings of IEEE International Conference on Robotics Automation, 2012.'},{id:"B7",body:'S. Weiss, M. Achtelik, M. Chli, and R. Siegwart. Versatile Distributed Pose Estimation and Sensor Self-calibration for an Autonomous MAV. International Conference on Robotics and Automation (ICRA), 2012.'},{id:"B8",body:'J. Calusdian, X. Yun, and E. Bachmann. Adaptive-gain Complementary Filter of Inertial and Magnetic Data for Orientation Estimation. International Conference on Robotics and Automation, 2011.'},{id:"B9",body:'D. Zachariah and M. Jansson. Self-Motion and Wind Velocity Estimation for Small-Scale UAVs. International Conference on Robotics and Automation, 2011.'},{id:"B10",body:'M. Euston, P. Coote, R. Mahony, J. Kim, and T. Hamel. A Complementary Filter for Attitude Estimation of a Fixed-wing UAV. IEEE International Conference on Intelligent Robots and Systems, 2008.'},{id:"B11",body:'M Sotak, M. Sopata, and F. Kmec. Navigation Systems using Monte Carlo Method. Guidance, Navigation and Control Systems, 2006.'},{id:"B12",body:'A. Bachrach, S. Prentice, R. He, and N. Roy. RANGE - Robust Autonomous Navigation in GPS-denied Environments. Journal of Field Robotics, 28(5):644–666, 2011.'},{id:"B13",body:'John L. Crassidis, F. Landis Markley, and Yang Cheng. Survey of Nonlinear Attitude Estimation Methods. Journal of Guidance, Control, and Dynamics, 30(1):12–28, 2007.'},{id:"B14",body:'R. Munguia and A. Grau. A Practical Method for Implementing an Attitude and Heading Reference System. International Journal of Advanced Robotic Systems, 11(62), 2014.'},{id:"B15",body:'H. G. de Marina, F. J. Pereda, J. M. Giron-Sierre, and F. Espinosa. UAV Attitude Estimation Using Unscented Kalman Filter and TRIAD. IEEE Transactions on Industrial Electronics, 59(11):4465–4474, 2012.'},{id:"B16",body:'N. M. Barbour. Inertial Navigation Sensors. NATO. USA: Charles Stark Draper Laboratory. Cambridge, RTO-EN-SET-116, 2011.'},{id:"B17",body:'G. T. Schmidt. INS/GPS Technology Trends. NATO. USA: Massachusetts Institute of Technology. Lexington, RTO-EN-SET-116, 2011.'},{id:"B18",body:'J. Roháč, M. Šipoš, and J. Šimánek. Calibration of the Low-Cost Triaxial Inertial Sensors. IEEE Instrumentation & Measurement Magazine, (18)6:32–38, 2015.'},{id:"B19",body:'Analog Devices Inc. http://www.analog.com. Technical report, Analog Devices Inc.'},{id:"B20",body:'M. Šipoš, P. Paces, J. Roháč, and P. Novacek. Analyses of Triaxel Accelerometer Calibration Algorithms. IEEE Sensors Journal, 12(5):1157–1165, 2012.'},{id:"B21",body:'N. El-Sheimy, H. Hou, and X. Niu. Analysis and Modeling of Inertial Sensors Using Allan Variance. IEEE Transactions on Instrumentation and Measurement, 57:140–149, 2008.'},{id:"B22",body:'D. W. Allan. Statistics of Atomic Frequency Standards. Proceedings of the IEEE, 2(54):221–230, 1966.'},{id:"B23",body:'IEEE Std. 1293. IEEE Standard Specification Format Guide and Test Procedure for Linear, Single-Axis, Nongyroscopic Accelerometers. Technical report, Institute of Electrical and Electronics Engineers, Available: ISBN 0-7381-1430-8 SS94679.'},{id:"B24",body:'IEEE Std. 528. IEEE Standard for Inertial Sensor Terminology. Technical report, Institute of Electrical and Electronics Engineers, Available: ISBN 0-7381-3022-2.'},{id:"B25",body:'IEEE Std. 647. IEEE Standard Specification Format Guide and Test Procedure for Single Axis Laser Gyros. Technical report, Institute of Electrical and Electronics Engineers.'},{id:"B26",body:'C. N. Lawrence. On the Application of Allan Variance Method for Ring Laser Gyro Performance Characterization. No. UCRL-ID–115695. Lawrence Livermore National Lab., 1993.'},{id:"B27",body:'M. Sotak. Determining Stochastic Parameters Using an Unified Method. Acta Electrotechnica et Informatica, 9(2):59–63, 2009.'},{id:"B28",body:'Jay A. Farrell. Aided Navigation: GPS with High Rate Sensors. McGraw Hill, 2008.'},{id:"B29",body:'P. D. Groves. Principles of GNSS, Inertial, and Multisensor Integrated Navigation Systems. Artech House, 2013.'},{id:"B30",body:'P. Swerling. First Order Error Propagation in a State-Wise Smoothing Procedure for Satellite Observations. Journal of Astro Sciences, (6):1–31, 1959.'},{id:"B31",body:'R. E. Kalman. A New Approach to Linear Filtering and Prediction Theory. Transactions on American Society of Mechanical Engineers, Series D, Journal of Basic Engineering, (82):35–45, 1960.'},{id:"B32",body:'E. Hendricks, O. Jannerup, and P. H. Sørensen. Linear Systems Control - Deterministic and Stochastic Methods. Springer, 2008.'},{id:"B33",body:'R. E. Kalman and R. S. Bucy. New Results in Linear and Prediction Theory. Transactions on American Society of Mechanical Engineers, Series D, Journal of Basic Engineering, 83:95–108, 1961.'},{id:"B34",body:'G. Dissanayake, S. Sukkarieh, E. Nebot, and H. Durrant-Whyte. The Aiding of a Lowcost Strapdown Inertial Measurement Unit Using Vehicle Model Constraints for Land Vehicle Applications. IEEE Transactions on Robotics and Automation, 17(5):731–747, 2001.'},{id:"B35",body:'Y. Bar-Shalom, X. R. Li, and T. Kirubarajan. Estimation with Applications to Tracking and Navigation. John Wiley & Sons, 2004.'},{id:"B36",body:'Z. Chen. Bayesian Filtering: From Kalman Filters to Particle Filters, and Beyond. Statistics, 182(1):1–69, 2003.'},{id:"B37",body:'F. Gustafsson, F. Gunnarsson, N. Bergman, U. Forssell, J. Jansson, R. Karlsson, and P. J. Nordlund. Particle Filters for Positioning, Navigation and Tracking. IEEE Transactions on Signal Processing, 50:425–437, 2002.'},{id:"B38",body:'M. S. Grewal, L. R. Weill, and A. P. Andrews. Global Positioning Systems, Inertial navigation, and Integration. John Wiley & Sons, Ltd., 2007.'},{id:"B39",body:'\nL. Stimac and T. A. Kennedy. Sensor Alignment Kalman Filters for Inertial Stabilization Systems. Proceedings of IEEE PLANS, 321–334, 1992.'},{id:"B40",body:'F. L. Markley. Attitude Error Representations for Kalman Filtering. Journal of guidance, control, and dynamics, 26(2):311–317, 2003.'},{id:"B41",body:'Thor I. Fossen. Handbook of Marine Craft Hydrodynamics and Motion Control. John Wiley & Sons, Ltd., 2011.'},{id:"B42",body:'R. G. Brown and Y. C. Hwang. Introduction to Random Signals and Applied Kalman Filtering. John Wiley & Sons, Inc. New York, 1998.'},{id:"B43",body:'A. Gelb, J. F. Kasper Jr., R. A. Nash Jr., C. F. Price, and A. A. Sutherland Jr. Applied Optimal Estimation. MIT Press. Boston, MA, 1988.'},{id:"B44",body:'A. Draganov, L. Haas, and M. Harlacher. The IMRE Kalman Filter - A New Kalman Filter Extension for Nonlinear Applications. Proceedings of IEEE/ION PLANS, 428–440, 2012.'},{id:"B45",body:'S. J. Julier and J. K. Uhlmann. A New Extension of the Kalman Filter to Nonlinear Systems. Proceedings of SPIE Signal Processing, Sensor Fusion, and Target Recognition VI, 3068:182–193, 1997.'},{id:"B46",body:'S. F. Schmidt. Application of State-Space Methods to Navigation Problems. Advances in Control Systems: Theory and Applications, Vol. 3, Academic Press. New York, pp. 293–340, 1966.'},{id:"B47",body:'M. G. Petovello, K.O’Keefe, G. Lachapelle, and M. E. Cannon. Consideration of Time-Correlated Errors in a Kalman Filter Application to GNSS. Journal of Geodesy, 83(1):51–56, 2009.'},{id:"B48",body:'R. K. Mehra. Approaches to Adaptive Filtering. IEEE Symposium on Adaptive Processess, Decision and Control, 1970.'},{id:"B49",body:'A. H. Mohammed and K. P. Schwarz. Adaptive Kalman Filtering for INS/GPS. Journal of Geodesy, 73:193–203, 1999.'},{id:"B50",body:'D. T. Magill. Optimal Adaptive Estimation of Sampled Stochastic Processes. IEEE Transactions on Automatic Control, AC-10:434–439, 1965.'},{id:"B51",body:'D. C. Fraser and J. E. Potter. The Optimum Linear Smoother as a Combination of Two Optimum Linear Filters. IEEE Transactions on Automatic Control, 7:387–390, 1969.'},{id:"B52",body:'H. E. Rauch, F. Tung, and C. T. Striebel. Maximum Likelihood Estimates of Linear Dynamic Systems. AIAA Journal, 3:1445–1450, 1965.'},{id:"B53",body:'N. J. Gordon, D. J. Salmond, and A. F. M. Smith. A Novel Approach to Nonlinear/Non-Gaussian Bayesian State Estimation. Proceedings of IEE Radar Signal Process, 140:170–113, 1993.'},{id:"B54",body:'B. Ristic, S. Arulampalam, and N. J. Gordon. Beyond the Kalman Filter: Particle Filters for Tracking Applications. Artech house, 2004.'},{id:"B55",body:'A. Doucet, Nando de Freitas, and N. Gordon. Sequential Monte Carlo Methods in Practice. New York: Springer, 2001.'},{id:"B56",body:'A. Doucet and A. M. Johansen. A Tutorial on Particle Filtering and Smoothing: Fifteen years later. Oxford Handbook of Nonlinear Filtering (C. Crisan and B. Rozovsky, Oxford), pp. 656–704, 2011.'},{id:"B57",body:'J. Thienel and R. M. Sanner. A Coupled Nonlinear Space Attitude Controller and Observer with an Unknown Constant Gyro Bias and Gyro Noise. IEEE Transactions on Automatic Control, 48:2011–2015, 2003.'},{id:"B58",body:'R. Mahony, T. Hamel, J. Trumpf, and C. Lageman. Nonlinear Attitude Observer on SO(3) for Complementary and Compatible Measurements: A Theoretical Study. IEEE Conference on Decision and Control, 6407–6412, 2009.'},{id:"B59",body:'P. Batista, C. Silvestre, and P. Oliveira. Ges Attitude Observers - Part I: Single Vector Observations. IFAC World Congress, 2991–2996, 2011.'},{id:"B60",body:'P. Batista, C. Silvestre, and P. Oliveira. Ges Attitude Observers - Part II: Multiple General Vector Observations. IFAC World Congress. Milan, Italy, 2985–2990, 2011.'},{id:"B61",body:'H. F. Grip, T. I. Fossen, T. A. Johansen, and A. Saberi. Attitude Estimation Using Biased Gyro and Vector Measurements with Time-Varying Reference Vectors. IEEE Transactions on Automatic Control, 57:1332–1338, 2012.'},{id:"B62",body:'S. Salcudean. A Globally Convergent Angular Velocity Observer for Rigid Body Motion. IEEE Transactions on Automatic Control, 36:1493–1497, 1991.'},{id:"B63",body:'B. Vik and Thor I. Fossen. A Nonlinear Observer for GPS and INS Integration. Proceedings of Conference on Decision and Control, 3:2956–2961, 2001.'},{id:"B64",body:'T. Hamel and R. Mahony. Attitude Estimation on SO(3) Based on Direct Inertial Measurements. Proceedings of IEEE International Conference on Robotics Automation, 2170–2175, 2006.'},{id:"B65",body:'Minh-Duc Hua. Attitude Estimation for Accelerated Vehicles Using GPS/INS Measurements. Control Engineering Practice, 18:723–732, 2010.'},{id:"B66",body:'H. F. Grip, T. I. Fossen, T. A. Johansen, and A. Saberi. Nonlinear Observer for GNSS-Aided Inertial Navigation with Quaternion-Based Attitude Estimation. American Control Conference, 272–279, 2013.'},{id:"B67",body:'Minh-Duc Hua, G. Ducard, T. Hamel, R. Mahony, and K. Rudin. Implementation of a Nonlinear Attitude Estimator for Aerial Robotic Vehicles. IEEE Transactions on Control Systems Technology, 22(1):201–213, 2014.'},{id:"B68",body:'P. Batista. Long Baseline Navigation with Clock Offset Estimation and Discrete-Time Measurements. Control Engineering Practice, 35:43–53, 2015.'},{id:"B69",body:'M. S. Grewal and A. P. Andrews. Kalman Filtering: Theory and Practice Using MATLAB. John Wiley & Sons, 2011.'},{id:"B70",body:'H. F. Grip, T. I. Fossen, T. A. Johansen, and A. Saberi. Nonlinear Observer for Integration of GNSS and IMU Measurements with Gyro Bias Estimation. Proceedings of the American Control Conference, 6, 2012.'},{id:"B71",body:'T. H. Bryne, T. I. Fossen, and T. A. Johansen. Nonlinear Observer with Time-Varying Gains for Inertial Navigation Aided by Satellite Reference Systems in Dynamic Positioning. Mediterranean Conference on Control and Automation (MED), 1:1353–1360, 2014.'},{id:"B72",body:'L. Fusini, T. I. Fossen, and T. A. Johansen. A Uniformly Semiglobally Exponentially Stable Nonlinear Observer for GNSS- and Camera-Aided Inertial Navigation. Proceedings of 22nd IEEE Mediterranean Conference on Control and Automation, Italy, 1031–1036, 2014.'}],footnotes:[],contributors:[{corresp:"yes",contributorFullName:"Jakob M. Hansen",address:"jakob.mahler.hansen@itk.ntnu.no",affiliation:'
Norwegian University of Science and Technology, Department of Engineering Cybernetics, Centre for Autonomous Marine Operations and Systems, Trondheim, Norway
Czech Technical University in Prague, Faculty of Electrical Engineering, Department of Measurement, Prague, Czech Republic
'},{corresp:null,contributorFullName:"Tor A. Johansen",address:null,affiliation:'
Norwegian University of Science and Technology, Department of Engineering Cybernetics, Centre for Autonomous Marine Operations and Systems, Trondheim, Norway
'},{corresp:null,contributorFullName:"Thor I. Fossen",address:null,affiliation:'
Norwegian University of Science and Technology, Department of Engineering Cybernetics, Centre for Autonomous Marine Operations and Systems, Trondheim, Norway
'}],corrections:null},book:{id:"5245",type:"book",title:"Recent Advances in Robotic Systems",subtitle:null,fullTitle:"Recent Advances in Robotic Systems",slug:"recent-advances-in-robotic-systems",publishedDate:"September 28th 2016",bookSignature:"Guanghui Wang",coverURL:"https://cdn.intechopen.com/books/images_new/5245.jpg",licenceType:"CC BY 3.0",editedByType:"Edited by",isbn:"978-953-51-2571-6",printIsbn:"978-953-51-2570-9",pdfIsbn:"978-953-51-4180-8",reviewType:"peer-reviewed",numberOfWosCitations:25,isAvailableForWebshopOrdering:!0,editors:[{id:"178603",title:"Dr.",name:"Guanghui",middleName:null,surname:"Wang",slug:"guanghui-wang",fullName:"Guanghui Wang"}],equalEditorOne:null,equalEditorTwo:null,equalEditorThree:null,coeditorOne:null,coeditorTwo:null,coeditorThree:null,coeditorFour:null,coeditorFive:null,topics:[{id:"1291"}],productType:{id:"1",title:"Edited Volume",chapterContentType:"chapter",authoredCaption:"Edited by"},chapters:[{id:"50884",type:"chapter",title:"Autonomous Quadrocopter for Search, Count and Localization of Objects",slug:"autonomous-quadrocopter-for-search-count-and-localization-of-objects",totalDownloads:1698,totalCrossrefCites:1,signatures:"Nils Gageik, Christian Reul and Sergio Montenegro",reviewType:"peer-reviewed",authors:[{id:"168230",title:"Ph.D. Student",name:"Nils",middleName:null,surname:"Gageik",fullName:"Nils Gageik",slug:"nils-gageik"},{id:"168231",title:"Prof.",name:"Sergio",middleName:null,surname:"Montenegro",fullName:"Sergio Montenegro",slug:"sergio-montenegro"},{id:"181110",title:"MSc.",name:"Christian",middleName:null,surname:"Reul",fullName:"Christian Reul",slug:"christian-reul"}]},{id:"51486",type:"chapter",title:"Design, Implementation and Modeling of Flooding Disaster-Oriented USV",slug:"design-implementation-and-modeling-of-flooding-disaster-oriented-usv",totalDownloads:1884,totalCrossrefCites:2,signatures:"Junfeng Xiong, Feng Gu, Decai Li, Yuqing He and Jianda Han",reviewType:"peer-reviewed",authors:[{id:"9884",title:"Dr.",name:"Yuqing",middleName:null,surname:"He",fullName:"Yuqing He",slug:"yuqing-he"},{id:"9921",title:"Prof.",name:"Jianda",middleName:null,surname:"Han",fullName:"Jianda Han",slug:"jianda-han"},{id:"185358",title:"Dr.",name:"Junfeng",middleName:null,surname:"Xiong",fullName:"Junfeng Xiong",slug:"junfeng-xiong"},{id:"185359",title:"Dr.",name:"Feng",middleName:null,surname:"Gu",fullName:"Feng Gu",slug:"feng-gu"},{id:"185360",title:"Dr.",name:"Decai",middleName:null,surname:"Li",fullName:"Decai Li",slug:"decai-li"}]},{id:"51357",type:"chapter",title:"Muscle‐Like Compliance in Knee Articulations Improves Biped Robot Walkings",slug:"muscle-like-compliance-in-knee-articulations-improves-biped-robot-walkings",totalDownloads:1647,totalCrossrefCites:3,signatures:"Hayssan Serhan and Patrick Henaff",reviewType:"peer-reviewed",authors:[{id:"184415",title:"Dr.",name:"Patrick",middleName:null,surname:"Henaff",fullName:"Patrick Henaff",slug:"patrick-henaff"},{id:"185026",title:"Dr.",name:"Hayssam",middleName:null,surname:"Serhan",fullName:"Hayssam Serhan",slug:"hayssam-serhan"}]},{id:"52096",type:"chapter",title:"Kinematic Analysis of the Triangle-Star Robot with Telescopic Arm and Three Kinematics Chains as T-S Robot (3-PRP)",slug:"kinematic-analysis-of-the-triangle-star-robot-with-telescopic-arm-and-three-kinematics-chains-as-t-s",totalDownloads:1842,totalCrossrefCites:0,signatures:"Ahmad Zahedi, Hadi Behzadnia, Hassan Ghanbari and Seyed\nHamed Tabatabaei",reviewType:"peer-reviewed",authors:[{id:"184776",title:"Dr.",name:"Hadi",middleName:null,surname:"Behzadnia",fullName:"Hadi Behzadnia",slug:"hadi-behzadnia"},{id:"184777",title:"Dr.",name:"Ahmed",middleName:null,surname:"Zahedi",fullName:"Ahmed Zahedi",slug:"ahmed-zahedi"},{id:"184778",title:"Dr.",name:"Hassan",middleName:null,surname:"Ghanbari",fullName:"Hassan Ghanbari",slug:"hassan-ghanbari"},{id:"184779",title:"Dr.",name:"Hamed",middleName:null,surname:"Tabatabaei",fullName:"Hamed Tabatabaei",slug:"hamed-tabatabaei"}]},{id:"51053",type:"chapter",title:"Recent Developments in Monocular SLAM within the HRI Framework",slug:"recent-developments-in-monocular-slam-within-the-hri-framework",totalDownloads:1868,totalCrossrefCites:0,signatures:"Edmundo Guerra, Yolanda Bolea, Rodrigo Munguia and Antoni\nGrau",reviewType:"peer-reviewed",authors:[{id:"13038",title:"Prof.",name:"Antoni",middleName:null,surname:"Grau",fullName:"Antoni Grau",slug:"antoni-grau"},{id:"18024",title:"Dr.",name:"Yolanda",middleName:null,surname:"Bolea",fullName:"Yolanda Bolea",slug:"yolanda-bolea"},{id:"163432",title:"Dr.",name:"Rodrigo",middleName:null,surname:"Munguia",fullName:"Rodrigo Munguia",slug:"rodrigo-munguia"},{id:"165970",title:"Ph.D. Student",name:"Edmundo",middleName:null,surname:"Guerra",fullName:"Edmundo Guerra",slug:"edmundo-guerra"}]},{id:"51618",type:"chapter",title:"Validation and Experimental Testing of Observers for Robust GNSS-Aided Inertial Navigation",slug:"validation-and-experimental-testing-of-observers-for-robust-gnss-aided-inertial-navigation",totalDownloads:1677,totalCrossrefCites:2,signatures:"Jakob M. Hansen, Jan Roháč, Martin Šipoš, Tor A. Johansen and\nThor I. Fossen",reviewType:"peer-reviewed",authors:[{id:"132264",title:"Prof.",name:"Tor Arne",middleName:null,surname:"Johansen",fullName:"Tor Arne Johansen",slug:"tor-arne-johansen"},{id:"179630",title:"Prof.",name:"Thor",middleName:"I",surname:"Fossen",fullName:"Thor Fossen",slug:"thor-fossen"},{id:"179647",title:"Dr.",name:"Martin",middleName:null,surname:"Šipoš",fullName:"Martin Šipoš",slug:"martin-sipos"},{id:"179649",title:"Associate Prof.",name:"Jan",middleName:null,surname:"Rohac",fullName:"Jan Rohac",slug:"jan-rohac"},{id:"181258",title:"Mr.",name:"Jakob Mahler",middleName:null,surname:"Hansen",fullName:"Jakob Mahler Hansen",slug:"jakob-mahler-hansen"}]},{id:"51816",type:"chapter",title:"Time-Energy Optimal Cluster Space Motion Planning for Mobile Robot Formations",slug:"time-energy-optimal-cluster-space-motion-planning-for-mobile-robot-formations",totalDownloads:1738,totalCrossrefCites:0,signatures:"Kyle Stanhouse, Chris Kitts and Ignacio Mas",reviewType:"peer-reviewed",authors:[{id:"13486",title:"Dr.",name:"Christopher",middleName:null,surname:"Kitts",fullName:"Christopher Kitts",slug:"christopher-kitts"}]},{id:"51093",type:"chapter",title:"Laser Graphics in Augmented Reality Applications for Real- World Robot Deployment",slug:"laser-graphics-in-augmented-reality-applications-for-real-world-robot-deployment",totalDownloads:1541,totalCrossrefCites:0,signatures:"Gerald Seet, Viatcheslav Iastrebov, Dinh Quang Huy and Pang Wee-\nChing",reviewType:"peer-reviewed",authors:[{id:"81562",title:"Prof.",name:"Gerald",middleName:null,surname:"Seet",fullName:"Gerald Seet",slug:"gerald-seet"},{id:"185583",title:"Dr.",name:"Viatcheslav",middleName:null,surname:"Iastrebov",fullName:"Viatcheslav Iastrebov",slug:"viatcheslav-iastrebov"},{id:"185584",title:"Ms.",name:"Wee-Ching",middleName:null,surname:"Pang",fullName:"Wee-Ching Pang",slug:"wee-ching-pang"},{id:"185585",title:"Mr.",name:"Quang Huy",middleName:null,surname:"Dinh",fullName:"Quang Huy Dinh",slug:"quang-huy-dinh"}]},{id:"51155",type:"chapter",title:"Dynamic Optimized Bandwidth Management for Teleoperation of Collaborative Robots",slug:"dynamic-optimized-bandwidth-management-for-teleoperation-of-collaborative-robots",totalDownloads:1515,totalCrossrefCites:1,signatures:"Chadi Mansour, Mohamad El Hariri, Imad H. Elhajj, Elie Shammas\nand Daniel Asmar",reviewType:"peer-reviewed",authors:[{id:"184287",title:"Dr.",name:"Mohamad",middleName:null,surname:"El Hariri",fullName:"Mohamad El Hariri",slug:"mohamad-el-hariri"}]},{id:"51224",type:"chapter",title:"Series Elastic Actuator: Design, Analysis and Comparison",slug:"series-elastic-actuator-design-analysis-and-comparison",totalDownloads:3413,totalCrossrefCites:4,signatures:"Arnaldo Gomes Leal Junior, Rafhael Milanezi de Andrade and\nAntônio Bento Filho",reviewType:"peer-reviewed",authors:[{id:"182082",title:"Dr.",name:"Rafhael",middleName:"Milanezi De",surname:"Andrade",fullName:"Rafhael Andrade",slug:"rafhael-andrade"},{id:"185372",title:"Dr.",name:"Antônio",middleName:null,surname:"Bento Filho",fullName:"Antônio Bento Filho",slug:"antonio-bento-filho"},{id:"185373",title:"MSc.",name:"Arnaldo",middleName:null,surname:"Gomes Leal Junior",fullName:"Arnaldo Gomes Leal Junior",slug:"arnaldo-gomes-leal-junior"}]},{id:"50812",type:"chapter",title:"Fish-Like Robot Encapsulated by a Plastic Film",slug:"fish-like-robot-encapsulated-by-a-plastic-film",totalDownloads:1569,totalCrossrefCites:2,signatures:"Mizuho Shibata",reviewType:"peer-reviewed",authors:[{id:"180106",title:"Dr.",name:"Mizuho",middleName:null,surname:"Shibata",fullName:"Mizuho Shibata",slug:"mizuho-shibata"}]},{id:"51432",type:"chapter",title:"CODA Algorithm: An Immune Algorithm for Reinforcement Learning Tasks",slug:"coda-algorithm-an-immune-algorithm-for-reinforcement-learning-tasks",totalDownloads:1540,totalCrossrefCites:0,signatures:"Daniel R. Ramirez Rebollo, Pedro Ponce Cruz and Arturo Molina",reviewType:"peer-reviewed",authors:[{id:"181021",title:"Ph.D. Student",name:"Daniel",middleName:"Rodrigo",surname:"Ramirez Rebollo",fullName:"Daniel Ramirez Rebollo",slug:"daniel-ramirez-rebollo"},{id:"181149",title:"Dr.",name:"Pedro",middleName:null,surname:"Ponce",fullName:"Pedro Ponce",slug:"pedro-ponce"},{id:"181151",title:"Dr.",name:"Arturo",middleName:null,surname:"Molina",fullName:"Arturo Molina",slug:"arturo-molina"}]}]},relatedBooks:[{type:"book",id:"1591",title:"Infrared Spectroscopy",subtitle:"Materials Science, Engineering and Technology",isOpenForSubmission:!1,hash:"99b4b7b71a8caeb693ed762b40b017f4",slug:"infrared-spectroscopy-materials-science-engineering-and-technology",bookSignature:"Theophile Theophanides",coverURL:"https://cdn.intechopen.com/books/images_new/1591.jpg",editedByType:"Edited by",editors:[{id:"37194",title:"Dr.",name:"Theophile",surname:"Theophanides",slug:"theophile-theophanides",fullName:"Theophile Theophanides"}],equalEditorOne:null,equalEditorTwo:null,equalEditorThree:null,productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"},chapters:[{id:"36273",title:"Introduction to Infrared Spectroscopy",slug:"introduction-to-infrared-spectroscopy",signatures:"Theophile Theophanides",authors:[{id:"37194",title:"Dr.",name:"Theophile",middleName:null,surname:"Theophanides",fullName:"Theophile Theophanides",slug:"theophile-theophanides"}]},{id:"36166",title:"Using Infrared Spectroscopy to Identify New Amorphous Phases - A Case Study of Carbonato Complex Formed by Mechanochemical Processing",slug:"using-infrared-spectroscopy-to-identify-new-amorphous-phases-a-case-study-of-carbonato-complexes-fo",signatures:"Tadej Rojac, Primož Šegedin and Marija Kosec",authors:[{id:"25116",title:"Prof.",name:"Marija",middleName:null,surname:"Kosec",fullName:"Marija Kosec",slug:"marija-kosec"},{id:"105876",title:"Dr.",name:"Tadej",middleName:null,surname:"Rojac",fullName:"Tadej Rojac",slug:"tadej-rojac"},{id:"111754",title:"Prof.",name:"Primoz",middleName:null,surname:"Segedin",fullName:"Primoz Segedin",slug:"primoz-segedin"}]},{id:"36167",title:"Application of Infrared Spectroscopy to Analysis of Chitosan/Clay Nanocomposites",slug:"application-of-infrared-spectroscopy-to-analysis-of-chitosan-clay-nanocomposites",signatures:"Suédina M.L. Silva, Carla R.C. Braga, Marcus V.L. Fook, Claudia M.O. Raposo, Laura H. Carvalho and Eduardo L. Canedo",authors:[{id:"104808",title:"Prof.",name:"Suedina Maria",middleName:"De Lima",surname:"Silva",fullName:"Suedina Maria Silva",slug:"suedina-maria-silva"},{id:"111910",title:"Prof.",name:"Carla",middleName:"Lima",surname:"R. C. Braga",fullName:"Carla R. C. Braga",slug:"carla-r.-c.-braga"},{id:"142933",title:"Prof.",name:"Marcus Vinícius",middleName:null,surname:"Lia Fook",fullName:"Marcus Vinícius Lia Fook",slug:"marcus-vinicius-lia-fook"},{id:"142934",title:"Prof.",name:"Claudia Maria",middleName:null,surname:"De Oliveira Raposo",fullName:"Claudia Maria De Oliveira Raposo",slug:"claudia-maria-de-oliveira-raposo"},{id:"142936",title:"Prof.",name:"Laura",middleName:null,surname:"Hecker De Carvalho",fullName:"Laura Hecker De Carvalho",slug:"laura-hecker-de-carvalho"},{id:"142939",title:"Dr.",name:"Eduardo Luis",middleName:null,surname:"Canedo",fullName:"Eduardo Luis Canedo",slug:"eduardo-luis-canedo"}]},{id:"36168",title:"Structural and Optical Behavior of Vanadate-Tellurate Glasses Containing PbO or Sm2O3",slug:"structural-and-optical-behavior-of-vanadate-tellurate-glasses",signatures:"E. Culea, S. Rada, M. Culea and M. Rada",authors:[{id:"114650",title:"Dr",name:"Eugen",middleName:null,surname:"Culea",fullName:"Eugen Culea",slug:"eugen-culea"},{id:"114653",title:"Dr.",name:"Simona",middleName:null,surname:"Rada",fullName:"Simona Rada",slug:"simona-rada"}]},{id:"36169",title:"Water in Rocks and Minerals - Species, Distributions, and Temperature Dependences",slug:"water-in-rocks-and-minerals-species-distributions-and-temperature-dependences",signatures:"Jun-ichi Fukuda",authors:[{id:"105384",title:"Dr.",name:"Jun-Ichi",middleName:null,surname:"Fukuda",fullName:"Jun-Ichi Fukuda",slug:"jun-ichi-fukuda"}]},{id:"36170",title:"Attenuated Total Reflection - Infrared Spectroscopy Applied to the Study of Mineral - Aqueous Electrolyte Solution Interfaces: A General Overview and a Case Study",slug:"attenuated-total-reflection-infrared-spectroscopy-applied-to-the-study-of-mineral-aqueous-el",signatures:"Grégory Lefèvre, Tajana Preočanin and Johannes Lützenkirchen",authors:[{id:"108416",title:"Dr.",name:"Johannes",middleName:null,surname:"Lützenkirchen",fullName:"Johannes Lützenkirchen",slug:"johannes-lutzenkirchen"},{id:"111675",title:"Dr.",name:"Gregory",middleName:null,surname:"Lefevre",fullName:"Gregory Lefevre",slug:"gregory-lefevre"},{id:"111676",title:"Prof.",name:"Tajana",middleName:null,surname:"Preocanin",fullName:"Tajana Preocanin",slug:"tajana-preocanin"}]},{id:"36171",title:"Research of Calcium Phosphates Using Fourier Transform Infrared Spectroscopy",slug:"research-of-calcium-phosphates-using-fourier-transformation-infrared-spectroscopy",signatures:"Liga Berzina-Cimdina and Natalija Borodajenko",authors:[{id:"110522",title:"Prof.",name:"Liga",middleName:null,surname:"Berzina-Cimdina",fullName:"Liga Berzina-Cimdina",slug:"liga-berzina-cimdina"},{id:"112181",title:"MSc.",name:"Natalija",middleName:null,surname:"Borodajenko",fullName:"Natalija Borodajenko",slug:"natalija-borodajenko"}]},{id:"36172",title:"FTIR Spectroscopy of Adsorbed Probe Molecules for Analyzing the Surface Properties of Supported Pt (Pd) Catalysts",slug:"ftir-spectroscopy-of-adsorbed-probe-molecules-for-analyzing-the-surface-properties-of-supported-pt-p",signatures:"Olga B. Belskaya, Irina G. Danilova, Maxim O. Kazakov, Roman M. Mironenko, Alexander V. Lavrenov and Vladimir A. Likholobov",authors:[{id:"107715",title:"Dr.",name:"Olga",middleName:null,surname:"Belskaya",fullName:"Olga Belskaya",slug:"olga-belskaya"},{id:"140198",title:"Dr.",name:"Irina",middleName:null,surname:"Danilova",fullName:"Irina Danilova",slug:"irina-danilova"},{id:"140200",title:"Dr.",name:"Maxim",middleName:null,surname:"Kazakov",fullName:"Maxim Kazakov",slug:"maxim-kazakov"},{id:"140202",title:"Mr.",name:"Roman",middleName:"Mikhailovich",surname:"Mironenko",fullName:"Roman Mironenko",slug:"roman-mironenko"},{id:"140203",title:"Dr.",name:"Alexander",middleName:null,surname:"Lavrenov",fullName:"Alexander Lavrenov",slug:"alexander-lavrenov"},{id:"140204",title:"Prof.",name:"Vladimir",middleName:null,surname:"Likholobov",fullName:"Vladimir Likholobov",slug:"vladimir-likholobov"}]},{id:"36173",title:"Hydrothermal Treatment of Hokkaido Peat - An Application of FTIR and 13C NMR Spectroscopy on Examining of Artificial Coalification Process and Development",slug:"hydrothermal-treatment-of-hokkaido-peat-an-application-of-ftir-and-13c-nmr-spectroscopy-on-examinin",signatures:"Anggoro Tri Mursito and Tsuyoshi Hirajima",authors:[{id:"104786",title:"Dr.",name:"Anggoro Tri",middleName:null,surname:"Mursito",fullName:"Anggoro Tri Mursito",slug:"anggoro-tri-mursito"},{id:"110978",title:"Prof.",name:"Tsuyoshi",middleName:null,surname:"Hirajima",fullName:"Tsuyoshi Hirajima",slug:"tsuyoshi-hirajima"}]},{id:"36174",title:"FTIR - An Essential Characterization Technique for Polymeric Materials",slug:"ftir-an-essential-characterization-technique-for-polymeric-materials",signatures:"Vladimir A. Escobar Barrios, José R. Rangel Méndez, Nancy V. Pérez Aguilar, Guillermo Andrade Espinosa and José L. Dávila Rodríguez",authors:[{id:"12709",title:"Dr.",name:"Jose Rene",middleName:null,surname:"Rangel-Mendez",fullName:"Jose Rene Rangel-Mendez",slug:"jose-rene-rangel-mendez"},{id:"12711",title:"Dr.",name:"Vladimir Alonso",middleName:null,surname:"Escobar Barrios",fullName:"Vladimir Alonso Escobar Barrios",slug:"vladimir-alonso-escobar-barrios"},{id:"112164",title:"Dr",name:"Guillermo",middleName:null,surname:"Andrade-Espinosa",fullName:"Guillermo Andrade-Espinosa",slug:"guillermo-andrade-espinosa"},{id:"112165",title:"Dr.",name:"José Luis",middleName:null,surname:"Dávila-Rodríguez",fullName:"José Luis Dávila-Rodríguez",slug:"jose-luis-davila-rodriguez"},{id:"112167",title:"Dr.",name:"Nancy Verónica",middleName:null,surname:"Pérez-Aguilar",fullName:"Nancy Verónica Pérez-Aguilar",slug:"nancy-veronica-perez-aguilar"}]},{id:"36175",title:"Preparation and Characterization of PVDF/PMMA/Graphene Polymer Blend Nanocomposites by Using ATR-FTIR Technique",slug:"preparation-and-characterization-of-pvdf-pmma-graphene-polymer-blend-nanocomposites-by-using-ft-ir-t",signatures:"Somayeh Mohamadi",authors:[{id:"108556",title:"Dr.",name:"Somayeh",middleName:null,surname:"Mohamadi",fullName:"Somayeh Mohamadi",slug:"somayeh-mohamadi"}]},{id:"36176",title:"Reflectance IR Spectroscopy",slug:"fundamental-of-reflectance-ir-spectroscopy",signatures:"Zahra Monsef Khoshhesab",authors:[{id:"111629",title:"Dr.",name:"Zahra",middleName:null,surname:"Monsef Khoshhesab",fullName:"Zahra Monsef Khoshhesab",slug:"zahra-monsef-khoshhesab"}]},{id:"36177",title:"Evaluation of Graft Copolymerization of Acrylic Monomers Onto Natural Polymers by Means Infrared Spectroscopy",slug:"evaluation-of-graft-copolymerization-of-acrylic-monomers-onto-natural-polymers-by-means-infrared-spe",signatures:"José Luis Rivera-Armenta, Cynthia Graciela Flores-Hernández, Ruth Zurisadai Del Angel-Aldana, Ana María Mendoza-Martínez, Carlos Velasco-Santos and Ana Laura Martínez-Hernández",authors:[{id:"37761",title:"Prof.",name:"Ana Laura",middleName:null,surname:"Martinez-Hernandez",fullName:"Ana Laura Martinez-Hernandez",slug:"ana-laura-martinez-hernandez"},{id:"107855",title:"Dr.",name:"Jose Luis",middleName:null,surname:"Rivera Armenta",fullName:"Jose Luis Rivera Armenta",slug:"jose-luis-rivera-armenta"},{id:"108894",title:"MSc.",name:"Cynthia Graciela",middleName:null,surname:"Flores-Hernández",fullName:"Cynthia Graciela Flores-Hernández",slug:"cynthia-graciela-flores-hernandez"},{id:"108896",title:"MSc.",name:"Ruth Zurisadai",middleName:null,surname:"Del Angel Aldana",fullName:"Ruth Zurisadai Del Angel Aldana",slug:"ruth-zurisadai-del-angel-aldana"},{id:"108898",title:"Dr.",name:"Carlos",middleName:null,surname:"Velasco-Santos",fullName:"Carlos Velasco-Santos",slug:"carlos-velasco-santos"},{id:"108905",title:"Dr.",name:"Ana Maria",middleName:null,surname:"Mendoza-Martínez",fullName:"Ana Maria Mendoza-Martínez",slug:"ana-maria-mendoza-martinez"}]},{id:"36178",title:"Applications of FTIR on Epoxy Resins - Identification, Monitoring the Curing Process, Phase Separation and Water Uptake",slug:"applications-of-ftir-on-epoxy-resins-identification-monitoring-the-curing-process-phase-separatio",signatures:"María González González, Juan Carlos Cabanelas and Juan Baselga",authors:[{id:"107857",title:"Prof.",name:"Juan",middleName:null,surname:"Baselga",fullName:"Juan Baselga",slug:"juan-baselga"},{id:"138113",title:"Dr.",name:"María",middleName:null,surname:"González",fullName:"María González",slug:"maria-gonzalez"},{id:"138114",title:"Dr.",name:"Juan C.",middleName:null,surname:"Cabanelas",fullName:"Juan C. Cabanelas",slug:"juan-c.-cabanelas"}]},{id:"36179",title:"Use of FTIR Analysis to Control the Self-Healing Functionality of Epoxy Resins",slug:"use-of-ft-ir-analysis-to-control-the-self-healing-functionality-of-epoxy-resins",signatures:"Liberata Guadagno and Marialuigia Raimondo",authors:[{id:"106836",title:"Prof.",name:"Liberata",middleName:null,surname:"Guadagno",fullName:"Liberata Guadagno",slug:"liberata-guadagno"}]},{id:"36180",title:"Infrared Analysis of Electrostatic Layer-By-Layer Polymer Membranes Having Characteristics of Heavy Metal Ion Desalination",slug:"infrared-analysis-of-electrostatic-layer-by-layer-polymer-membranes-having-characteristics-of-heavy",signatures:"Weimin Zhou, Huitan Fu and Takaomi Kobayashi",authors:[{id:"110384",title:"Dr.",name:"Takaomi",middleName:null,surname:"Kobayashi",fullName:"Takaomi Kobayashi",slug:"takaomi-kobayashi"}]},{id:"36181",title:"Infrared Spectroscopy as a Tool to Monitor Radiation Curing",slug:"infrared-spectroscopy-as-a-tool-to-monitor-radiation-curing",signatures:"Marco Sangermano, Patrick Meier and Spiros Tzavalas",authors:[{id:"112286",title:"Dr.",name:"Spiros",middleName:null,surname:"Tzavalas",fullName:"Spiros Tzavalas",slug:"spiros-tzavalas"},{id:"114382",title:"Prof.",name:"Marco",middleName:null,surname:"Sangermano",fullName:"Marco Sangermano",slug:"marco-sangermano"},{id:"114384",title:"Dr",name:"Patrick",middleName:null,surname:"Meier",fullName:"Patrick Meier",slug:"patrick-meier"}]},{id:"36182",title:"Characterization of Compositional Gradient Structure of Polymeric Materials by FTIR Technology",slug:"characterization-of-compositional-gradient-structure-of-polymeric-materials-by-ft-ir-technology",signatures:"Alata Hexig and Bayar Hexig",authors:[{id:"20867",title:"Dr.",name:"Bayar",middleName:null,surname:"Hexig",fullName:"Bayar Hexig",slug:"bayar-hexig"},{id:"111986",title:"Dr.",name:"Alata",middleName:null,surname:"Hexig",fullName:"Alata Hexig",slug:"alata-hexig"}]},{id:"36183",title:"Fourier Transform Infrared Spectroscopy - Useful Analytical Tool for Non-Destructive Analysis",slug:"fourier-trasform-infrared-spectroscopy-useful-analytical-tool-for-non-destructive-analysis",signatures:"Simona-Carmen Litescu, Eugenia D. Teodor, Georgiana-Ileana Truica, Andreia Tache and Gabriel-Lucian Radu",authors:[{id:"24425",title:"Dr.",name:"Simona Carmen",middleName:null,surname:"Litescu",fullName:"Simona Carmen Litescu",slug:"simona-carmen-litescu"},{id:"24429",title:"Prof.",name:"Gabriel-Lucian",middleName:null,surname:"Radu",fullName:"Gabriel-Lucian Radu",slug:"gabriel-lucian-radu"},{id:"108318",title:"Dr.",name:"Eugenia D.",middleName:null,surname:"Teodor",fullName:"Eugenia D. Teodor",slug:"eugenia-d.-teodor"},{id:"108323",title:"Dr.",name:"Georgiana-Ileana",middleName:null,surname:"Badea",fullName:"Georgiana-Ileana Badea",slug:"georgiana-ileana-badea"},{id:"136337",title:"Ms.",name:"Andreia",middleName:null,surname:"Tache",fullName:"Andreia Tache",slug:"andreia-tache"}]},{id:"36184",title:"Infrared Spectroscopy in the Analysis of Building and Construction Materials",slug:"infrared-spectroscopy-of-cementitious-materials",signatures:"Lucia Fernández-Carrasco, D. Torrens-Martín, L.M. Morales and Sagrario Martínez-Ramírez",authors:[{id:"107401",title:"Dr.",name:"Lucia J",middleName:null,surname:"Fernández",fullName:"Lucia J Fernández",slug:"lucia-j-fernandez"}]},{id:"36185",title:"Infrared Spectroscopy Techniques in the Characterization of SOFC Functional Ceramics",slug:"infrared-spectroscopy-techniques-in-the-characterization-of-sofc-functional-ceramics",signatures:"Daniel A. Macedo, Moisés R. Cesário, Graziele L. Souza, Beatriz Cela, Carlos A. Paskocimas, Antonio E. Martinelli, Dulce M. A. Melo and Rubens M. Nascimento",authors:[{id:"102015",title:"MSc.",name:"Daniel",middleName:null,surname:"Macedo",fullName:"Daniel Macedo",slug:"daniel-macedo"},{id:"112309",title:"MSc",name:"Moisés",middleName:"Romolos",surname:"Cesário",fullName:"Moisés Cesário",slug:"moises-cesario"},{id:"112310",title:"Ms.",name:"Graziele",middleName:null,surname:"Souza",fullName:"Graziele Souza",slug:"graziele-souza"},{id:"112311",title:"MSc.",name:"Beatriz",middleName:null,surname:"Cela",fullName:"Beatriz Cela",slug:"beatriz-cela"},{id:"112312",title:"Prof.",name:"Carlos",middleName:null,surname:"Paskocimas",fullName:"Carlos Paskocimas",slug:"carlos-paskocimas"},{id:"112314",title:"Prof.",name:"Antonio",middleName:null,surname:"Martinelli",fullName:"Antonio Martinelli",slug:"antonio-martinelli"},{id:"112315",title:"Prof.",name:"Dulce",middleName:null,surname:"Melo",fullName:"Dulce Melo",slug:"dulce-melo"},{id:"112316",title:"Dr.",name:"Rubens",middleName:"Maribondo Do",surname:"Nascimento",fullName:"Rubens Nascimento",slug:"rubens-nascimento"}]},{id:"36186",title:"Infrared Spectroscopy of Functionalized Magnetic Nanoparticles",slug:"infrared-spectroscopy-of-functionalized-magnetic-nanoparticles",signatures:"Perla E. García Casillas, Claudia A. Rodriguez Gonzalez and Carlos A. Martínez Pérez",authors:[{id:"104636",title:"Dr.",name:"Perla E.",middleName:null,surname:"García Casillas",fullName:"Perla E. García Casillas",slug:"perla-e.-garcia-casillas"},{id:"112440",title:"Dr.",name:"Carlos A.",middleName:null,surname:"Martínez Pérez",fullName:"Carlos A. Martínez Pérez",slug:"carlos-a.-martinez-perez"},{id:"112441",title:"Dr.",name:"Claudia A.",middleName:null,surname:"Rodriguez Gonzalez",fullName:"Claudia A. Rodriguez Gonzalez",slug:"claudia-a.-rodriguez-gonzalez"}]},{id:"36187",title:"Determination of Adsorption Characteristics of Volatile Organic Compounds Using Gas Phase FTIR Spectroscopy Flow Analysis",slug:"determination-of-adsorption-characteristics-of-volatile-organic-compounds-using-gas-phase-ftir-spect",signatures:"Tarik Chafik",authors:[{id:"107310",title:"Prof.",name:"Tarik",middleName:null,surname:"Chafik",fullName:"Tarik Chafik",slug:"tarik-chafik"}]},{id:"36188",title:"Identification of Rocket Motor Characteristics from Infrared Emission Spectra",slug:"identification-of-rocket-motor-characteristics-from-infrared-emission-spectra",signatures:"N. Hamp, J.H. Knoetze, C. Aldrich and C. Marais",authors:[{id:"112229",title:"Prof.",name:"Chris",middleName:null,surname:"Aldrich",fullName:"Chris Aldrich",slug:"chris-aldrich"},{id:"112232",title:"Prof.",name:"Hansie",middleName:null,surname:"Knoetze",fullName:"Hansie Knoetze",slug:"hansie-knoetze"},{id:"135327",title:"Ms.",name:"Corne",middleName:null,surname:"Marais",fullName:"Corne Marais",slug:"corne-marais"}]},{id:"36189",title:"Optical Technologies for Determination of Pesticide Residue",slug:"optical-technology-for-determination-of-pesticide-residue",signatures:"Yankun Peng, Yongyu Li and Jingjing Chen",authors:[{id:"113343",title:"Prof.",name:"Yankun",middleName:null,surname:"Peng",fullName:"Yankun Peng",slug:"yankun-peng"},{id:"116636",title:"Dr.",name:"Yongyu",middleName:null,surname:"Li",fullName:"Yongyu Li",slug:"yongyu-li"},{id:"116637",title:"Dr.",name:"Jingjing",middleName:null,surname:"Chen",fullName:"Jingjing Chen",slug:"jingjing-chen"}]},{id:"36190",title:"High Resolution Far Infrared Spectra of the Semiconductor Alloys Obtained Using the Synchrotron Radiation as Source",slug:"high-resolution-spectra-of-semiconductor-s-alloys-obtained-using-the-far-infrared-synchrotron-radi",signatures:"E.M. Sheregii",authors:[{id:"102655",title:"Prof.",name:"Eugen",middleName:null,surname:"Sheregii",fullName:"Eugen Sheregii",slug:"eugen-sheregii"}]},{id:"36191",title:"Effective Reaction Monitoring of Intermediates by ATR-IR Spectroscopy Utilizing Fibre Optic Probes",slug:"effective-reaction-monitoring-of-intermediates-by-atr-ir-spectroscopy-utilizing-fibre-optic-probes",signatures:"Daniel Lumpi and Christian Braunshier",authors:[{id:"109019",title:"Dr.",name:"Christian",middleName:null,surname:"Braunshier",fullName:"Christian Braunshier",slug:"christian-braunshier"},{id:"111798",title:"MSc.",name:"Daniel",middleName:null,surname:"Lumpi",fullName:"Daniel Lumpi",slug:"daniel-lumpi"}]}]}],publishedBooks:[{type:"book",id:"10",title:"Coherence and Ultrashort Pulse Laser Emission",subtitle:null,isOpenForSubmission:!1,hash:"e1bd25a76712d1cb8792820acf2ff001",slug:"coherence-and-ultrashort-pulse-laser-emission",bookSignature:"F. J. Duarte",coverURL:"https://cdn.intechopen.com/books/images_new/10.jpg",editedByType:"Edited by",editors:[{id:"13752",title:"Dr.",name:"F. J.",surname:"Duarte",slug:"f.-j.-duarte",fullName:"F. J. Duarte"}],equalEditorOne:null,equalEditorTwo:null,equalEditorThree:null,productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}},{type:"book",id:"11",title:"Multi-Robot Systems",subtitle:"Trends and Development",isOpenForSubmission:!1,hash:null,slug:"multi-robot-systems-trends-and-development",bookSignature:"Toshiyuki Yasuda",coverURL:"https://cdn.intechopen.com/books/images_new/11.jpg",editedByType:"Edited by",editors:[{id:"5669",title:"Dr.",name:"Toshiyuki",surname:"Yasuda",slug:"toshiyuki-yasuda",fullName:"Toshiyuki Yasuda"}],equalEditorOne:null,equalEditorTwo:null,equalEditorThree:null,productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}},{type:"book",id:"12",title:"Numerical Simulations",subtitle:"Examples and Applications in Computational Fluid Dynamics",isOpenForSubmission:!1,hash:null,slug:"numerical-simulations-examples-and-applications-in-computational-fluid-dynamics",bookSignature:"Lutz Angermann",coverURL:"https://cdn.intechopen.com/books/images_new/12.jpg",editedByType:"Edited by",editors:[{id:"13342",title:"Prof.",name:"Lutz",surname:"Angermann",slug:"lutz-angermann",fullName:"Lutz Angermann"}],equalEditorOne:null,equalEditorTwo:null,equalEditorThree:null,productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}},{type:"book",id:"13",title:"Paths to Sustainable Energy",subtitle:null,isOpenForSubmission:!1,hash:null,slug:"paths-to-sustainable-energy",bookSignature:"Jatin Nathwani and Artie Ng",coverURL:"https://cdn.intechopen.com/books/images_new/13.jpg",editedByType:"Edited by",editors:[{id:"13730",title:"Dr.",name:"Artie",surname:"Ng",slug:"artie-ng",fullName:"Artie Ng"}],equalEditorOne:null,equalEditorTwo:null,equalEditorThree:null,productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}},{type:"book",id:"14",title:"Traveling Salesman Problem",subtitle:"Theory and Applications",isOpenForSubmission:!1,hash:null,slug:"traveling-salesman-problem-theory-and-applications",bookSignature:"Donald Davendra",coverURL:"https://cdn.intechopen.com/books/images_new/14.jpg",editedByType:"Edited by",editors:[{id:"2961",title:"Prof.",name:"Donald",surname:"Davendra",slug:"donald-davendra",fullName:"Donald Davendra"}],equalEditorOne:null,equalEditorTwo:null,equalEditorThree:null,productType:{id:"1",chapterContentType:"chapter",authoredCaption:"Edited by"}}],publishedBooksByAuthor:[]},onlineFirst:{chapter:{type:"chapter",id:"77605",title:"Tourist Sentiment Mining Based on Deep Learning",doi:"10.5772/intechopen.98836",slug:"tourist-sentiment-mining-based-on-deep-learning",body:'
1. Introduction
Since the world has been inundated with the increasing amount of tourist data, tourism organizations and business should keep abreast about tourist experience and views about the business, product and service. Gaining insights into these fields can facilitate the development of the robust strategy that can enhance tourist experience and further boost tourist loyalty and recommendations. Traditionally, business rely on the structured quantitative approach, for example, rating tourist satisfaction level based on the Likert Scale. Although this approach is effective to prove or disprove existing hypothesis, the closed ended questions cannot reveal exact tourist experience and feelings of the products or services, which hampers obtaining insights from tourists. Actually, business have already applied sophisticated and advanced approaches, such as text mining and sentiment analysis, to disclose the patterns hidden behind the data and the main themes.
Sentiment analysis (SA) has been used to deal with the unstructured data in the domain of tourism, such as texts, images, and video to investigate decision-making process [1], service quality [2], destination image and reputation [3]. As for the level of sentiment analysis, it has been found that most extant sentiment analysis in the domain of tourism is conducted at document level [4, 5, 6, 7]. Document-based sentiment analysis (DBSA) regards the individual whole review or each sentence as an independent unit and assume there is only one topic in the review or in the sentence. However, this assumption is invalid as people normally express their semantic orientation on different aspects in a review or a sentence [8]. For example, in the sentence “we had impressive breakfast, comfortable bed and friendly and professional staff serving us”, the aspects discussed here are “breakfast”, “bed” and “staff” and the users give positive comments on these aspects (“impressive”, “comfortable” and “friendly and professional”). Since the sentiment obtained through DBSA is at coarse level, aspect-based sentiment analysis (ABSA) has been suggested to capture sentiment tendency of finer granularity.
To obtain the sentiment at the finer level, ABSA has been proposed and developed over the years. ABSA normally involves three tasks, the extraction of opinion target (also known as the “aspect term”), the detection of aspect category and the classification of sentiment polarity. Traditional methods to extract aspects rely on the word frequency or the linguistic patterns. Nevertheless, it cannot identify infrequent aspects and heavily depends on the grammatical accuracy to manipulate the rules [9]. As for the detection of sentiment polarity, supervised machine learning approaches, like Maximum Entropy (ME), Conditional Random Field (CRF) and Support Vector Machine (SVM). Although machine learning-based approaches have achieved desirable accuracy and precision, they require huge dataset and manual training data. In addition, the results cannot be duplicated in other fields [10]. To overcome these shortcomings, ABSA of deep learning (DL) approaches has the advantage of automatically extracting features from data [9]. Extant studies based on DL methods in tourism have investigated and explored tourist experiences in economy hotel [11], the identification of destination image [12], review classification [13]. Although DL methods have been applied in tourism, ABSA in tourism is scant. Therefore, this study reviewed sentiment analysis at aspect level conducted by DL approaches, compared the performance of DL models, and explored the model training process.
With the references of surveys about DL methods [9, 14], this study followed the framework of ABSA proposed by Liu (2011) [8] to achieve the following aims: (1) provide an overview of the studies using DL-based ABSA in tourism for researchers and practitioners; (2) provide practical guidelines including data annotation, pre-processing, as well as model training for potential application of ABSA in similar areas; (3) train the model to classify sentiments with the state-of-art DL methods and optimizers using datasets collected from TripAdvisor. This paper is organized as follows: Section 2 reviews the cutting-edge techniques for ABSA, studies using DL for NLP tasks in tourism, and research gap; Section 3 presents the annotation schema of the given corpus and DL methods used in this study; Section 4 describes the details of annotation results, model training, and the experiment results. Section 5 provides the conclusions and future extensions.
2. Literature review
An extensive literature review of the state-of-art techniques for ABSA and the studies using DL in tourism is provided in this section.
2.1 Input vectors
To convert the NLP problems into the form that computers can deal with, the texts are required to be transformed into a numerical value. In ML-based approaches, One-hot and Counter Vectorizer are commonly used. One-hot encoding can realize a token-level representation of a sentence. However, the use of One-hot encoding usually results in high dimension issues, which is not computationally efficient [15]. Another issue is the difficulty of extracting meanings as this approach assumes that words in the sentence are independent, and the similarities cannot be measured by distance nor cosine-similarity. As for Counter Vectorizer, although it can convert the whole sentence into one vector, it cannot consider the sequence of the words and the context.
Nevertheless, in DL based approaches, pre-trained word embeddings have been proposed in [16, 17]. Word embedding, or word representation, refers to the learned representation of texts in which the words with identical meanings would have similar representation. It has been proved that the use of word embeddings as the input vectors can make a 6–9% increase in aspect extraction [18] and 2% in the identification of sentiment polarity [19]. Pre-trained word embeddings are favored as random initialization could result in stochastic gradient descent (SGD) in local minima [20]. Based on the network language model, a feedforward architecture, which combined a linear projection layer and a non-linear hidden layer, could learn the word vector representation and a statistical language model [21].
Word2Vec [16] proposed the skip-gram and continuous bag-of-words (CBOW) models. By setting the window size, skip-gram can predict the context based on the given words, while the CBOW can predict the word based on the context. Frequent words also are assigned binary codes in Huffman trees because Also, due to the fact that the word frequency is appropriate to acquire classes in neural net language models, frequent words are assigned binary codes in Huffman trees. This practice in Word2Vec helps reduce the number of output units that are required to be assessed. However, the window-based approaches of Word2Vec do not work on the co-occurrence of the text and do not harness the huge amount of repetition in the texts. Therefore, to capture the global representation of the words in all sentences, GloVe can take advantage of the nonzero elements in a word-word cooccurrence matrix [17]. Although the models discussed above performed well in similarity tasks and named entity recognition, they cannot cope with the polysemous words. In a more recent development, Embeddings from language model (ELMo) [22], Bi-directional Encoder Representations from Transformers (BERT) [23] can identify the context-sensitive features in the corpus. The main difference between these two architectures is that ELMo is feature-based, while BERT is deeply bidirectional. To be specific, the contextual representation of each token is obtained through the concatenation of the left-to-right and right-to-left representations. In contrast, BERT applies masked language models (MLM) to acquire the pre-trained deep bidirectional representations. MLM can randomly mask certain tokens from the input and predict the ID of the input depending only on the context. Additionally, BERT is capable of addressing the issues of long text dependence.
Nonetheless, researchers have combined certain features with word embedding to produce more pertinent results. These features include Part-Of-Speech (POS) and chunk tags, and commonsense knowledge. It has been observed that aspect terms are usually nouns or noun phrases [8]. The original word embeddings of the texts are concatenated with as k-dimensional binary vectors that represent the k POS, or k tags. The concatenated word embeddings are fed into the models (Do et al.,, Prasad, Maag, and Alsadoon, 2019 [9]). It has been proved that the use of POS tagging as input can improve the performance of aspect extraction, with gains from 1% [18, 20] to 4% [24]. Apart from the POS, concepts that are closely related to the affections are suggested to be added as word embeddings [25, 26]. POS focused on the grammatical tagging of the words in a corpus, while concepts that are extracted from SenticNet emphasize the multi-word expressions and the dependency relation between clauses. For example, the multi-word expression “win lottery” could be related to the emotions “Arise-joy” and the single-word expression “dog” is associated with the property “Isa-pet” and the emotions “Arise-joy” [26]. After being parsed by SenticNet, the obtained concept-level information (property and the emotions) is embedded into the deep neural sequential models. The performance of the Long Short-Term Memory (LSTM) [27] combined with SenticNet exceeded the baseline LSTM [26].
2.2 DL methods for ABSA
This section reviews the DL methods used for ABSA, including Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), Attention-based RNN, and Memory Network.
2.2.1 CNN
CNN can learn to capture the fixed-length expressions based on the assumption that keywords usually include the aspect terms with few connections of the positions [28]. Besides, as CNN is a non-linear model, it usually outperforms the linear-model and rarely relies on language rules [29]. A local feature window of 5 words was firstly created for each word in the sentence to extract the aspects. Then, a seven-layer of CNN was tested and generated better results [29]. To capture the multi-word expressions, the model proposed [30] contained two separate convolutional layers with non-linear gates. N-gram features can be obtained by the convolutional layers with multiple filters. Li et al. [13] put position information between the aspect words and the context words into the input layer in CNN and introduced the aspect-aware transformation parts. Fan et al. [31] integrated the attention mechanism with a convolutional memory network. This proposed model can learn multi-word expressions in the sentence and identify long-distance dependency.
Apart from simply extracting the aspects alone, CNN can identify the sentiment polarity at the same time, which can be regarded as multi-label tasking classification or multitasking issues. As for researchers who considered ABSA multi-label tasking classification, a probability distribution threshold was applied to select the aspect category and the aspect vector was concatenated with the word embedding, which was then further performed using CNN. Xu et al. [32] combined the CNN with the non-linear CRF to extract the aspect, which was then concatenated with the word embeddings and fed into another CNN to identify the sentiment polarity. Gu et al. [33] proposed a CNN with two levels that integrated the aspect mapping and sentiment classification. Compared with conventional ML approaches, this approach can lessen the feature engineering work and elapsed time [9]. It should be noticed that the performance of multitasking CNN does not necessarily outperform multitasking methods [19].
2.2.2 RNN and attention-based RNN
RNN has been applied for the ABSA and SBSA in the UGC. RNN models use a fixed-size vector to represent one sequence, which could be a sentence or a document, to feed each token into a recurrent unit. The main differences between CNN and RNN are: (1) the parameters of different layers in RNN are the same, making a fewer number of parameters required to be learned; (2) since the outputs from RNN relies on the prior steps, RNN can identify the context dependency and suitable for texts of different lengths [34, 35, 36].
However, the standard RNN has prominent shortcomings of gradient explosion and vanishing, causing difficulties to train and fine-tune the parameter during the process of prorogation [34]. LSTM and Gated Recurrent Unit (GRU) [37] have been proposed to tackle such issues. Also, Bi-directional RNN (Bi-RNN) models have been proposed in many studies [38, 39]. The principle behind Bi-RNN is the context-aware representation can be acquired by concatenating the backward and the forward vectors. Instead of the forward layer alone, a backward layer was combined to learn from both prior and future, enabling Bi-RNN to predict by using the following words. It has been proved that the Bi-RNN model achieved better results than LSTM in the highly skewed data in the task of aspect category detection [40]. Especially, Bi-directional GRU is capable of extracting aspects and identifying the sentiment in the meanwhile [23, 41] by using Bi-LSTM-CRF and CNN to extract the aspects in the sentence that has more than one sentiment targets.
Another drawback of RNN is that RNN encodes peripheral information, especially when it is fed with information-rich texts, which would further result in semantic mismatching problems. To tackle the issue, the attention mechanism is proposed to capture the weights from each lower level, which are further aggregated as the weighted vector for high-level representation [42]. In doing so, the attention mechanism can emphasize aspects and the sentiment in the sentence. Single attention-based LSTM with aspect embeddings [43], and position attention-based LSTM [44], syntactic-aware vectors [45] were used to capture the important aspects and the context words. The aspect and opinion terms can be extracted in the Coupled Multi-Layer Attention Model based on GRU [46] and the Bi-CNN with attention [47]. These frameworks require fewer engineering features compared with the use of CRF.
2.2.3 Memory network
The development of the deep memory network in ABSA was originated from the multi-hop attention mechanism that applies the exterior memory to compute the influence of context words on the given aspects [36]. A multi-hop attention mechanism was set over an external memory that can recognize the importance level of the context words and can infer the sentiment polarity based on the contexts. The tasks of aspect extraction and sentiment identification can be achieved simultaneously in the memory network in the model proposed by [13]. Li et al. [13] used the signals obtained in aspect extraction as the basis to predict the sentiment polarity, which would further be computed to identify the aspects.
Memory networks can tackle the problems that cannot be addressed by attention mechanism. To be specific, in certain sentences, the sentiment polarity is dependent on the aspects and cannot be inferred from the context alone. For example, “the price is high” and “the screen resolution is high”. Both sentences contain the word “high”. When “high” is related to “price”, it refers to negative sentiment, while it represents positive sentiment when “high” is related to “screen resolution”. Wang et al. [48] proposed a target-sensitive memory network proposed six techniques to design target-sensitive memory networks that can deal with the issues effectively.
2.3 Studies using DL methods in tourism and research gap
To obtain finer-grained sentiment of tourists’ experiences in economy hotels in China, [11] used Word2Vec to obtain the word embeddings as the model input, and bidirectional LSTM with CRF model was used to train and predict the data. The whole model includes the text layer, POS layer, connection layer, and output layer, in which CRF was used for data output, reaching an accuracy of 84%. Chang et al. [49] applied GloVe to pre-train the word embedding. To improve the performance, feature vectors, like sentiment scores, temporal intervals, reviewer profiles, were added into CNN models. Their results proved that temporal intervals made a greater contribution than the sentiment score and review profile for the managers to respond to the reviews. Gao et al. [50] explored the model that built CNN on LSTM and proved that the combined model outperformed the single CNN or LSTM model, with an improvement of 3.13% and 1.71% respectively.
To summarize, DL methods have been extensively used to perform ABSA. However, ABSA in the domain of tourism is little in the literature. Therefore, this study aimed at conducting ABSA using a dataset collected from TripAdvisor for predicting sentiments. Based on the literature review, it can be observed that RNN models especially attention-based RNN models achieved better performance than CNN models in terms of accuracy. Therefore, attention-based gated RNN models including LSTM and GRU were used in this study, which is summarized in the following section. Zhou et al. [14] conducted a series of ABSA on Semeval datasets [51, 52] using various DL methods. The experimental results confirmed that RNN with an attention-based mechanism obtained higher accuracies but relatively low precisions and recalls. This is because the Semeval datasets are naturally unbalanced datasets in which the fraction of positive sentiment samples is significantly higher than the fractions of neutral and negative sentiment samples, which indicates the importance of fractions of sentiment samples in the datasets. Inspired by ABSA on Semeval datasets, four datasets with different fractions of sentiment samples were resampled from the dataset of TripAdvisor hotel reviews to investigate the effect of sample imbalance on the model performance. Also, optimizers to minimize loss play a key role in model training. Therefore, three optimizers including the state-of-art optimizer were used in this study to compare their performance.
3. Research design and experiment
3.1 Corpora design
Based on the consideration and the purpose of the study, the corpora in this study will be completely in English and will include reviews collected from casino resorts in Macao. A self-designed tool programmed in Python was implemented to acquire all the URLs, which were first stored and further used as the initial page to crawl all the UGC that belongs to the hotel. The corpus includes 61544 reviews of 66 hotels. The length of the reviews varied greatly, with a maximum of 15 sentences, compared to the minimum of one sentence.
In terms of the size of the corpora that requires annotation, as there is no clear instruction regarding the size of the corpora, this study referred to Liu’s work and SemEval’s task. In machine learning based studies, it is reasonable to consider that the corpus that has 800–1000 aspects would be sufficient, while for deep-learning based approach, we think at least 5000 aspects in total would be acceptable. As the original data was annotated first to be further analyzed, 1% of the reviews were randomly sampled from the corpus. Therefore, 600 reviews that contain 5506 sentences were selected for ABSA in this study.
3.2 Annotation
Although previous works annotated the corpora and performed sentiment analysis, they did not reveal the annotation principles [51, 53] and the categories are rather coarse. For example, [53] used pre-defined categories to annotate the aspects of the restaurant. The categories involved “Food, Service, Price, Ambience, Anecdotes, and Miscellaneous”, which did not annotate the aspects of finer levels. In addition, the reliability and validity of the annotation scheme have not been proved.
As the training of the models discussed above requires the annotation of domain-specific corpora, this study referred to [54]. The design of the annotation schema calls for the identification of aspect-sentiment pairs. Specifically, Α is the collection of aspects aj (with j=1,…,s). Then, sentiment polarity pk (with k=1,…,t) should be added to each aspect in the form of a tuple (aj, pk).
To ensure the reliability and validity, Cohen’s kappa, Krippendorff’s alpha, and Inter-Annotator-Agreement (IAA) are introduced in this study, which are calculated by the agreement package in NLTK. Both indicators are used to measure (1) the agreement of the entire aspect-sentiment pair, (2) the agreement of each independent category.
3.3 Attention-based gated RNN
3.3.1 LSTM unit
The LSTM unit proposed by [25] overcomes the gradient vanishing or exploding issues in the standard RNN. The LSTM unit is consisted of forget, input, and output gates, as well as a cell memory state. The LSTM unit maintained a memory cell ct at time t instead of the recurrent unit computing a weighted sum of the inputs and applying an activation function. Each LSTM unit can be computed as follows:
X=ht−1xtE1
ft=σXWfT+bfE2
it=σXWiT+biE3
ot=σXWoT+boE4
ct=ft⊙ct−1+it⊙tanhXWcT+bcE5
ht=ot⊙tanhctE6
where Wf, Wi, Wo, Wc∈Rd×2d are the weighted matrices, and bf, bi, bo, bc∈Rd are the bias vectors to be learned, parameterizing the transformation of three gates; d is the dimension of the word embedding; σ is the sigmoid activation function, and ⊙ represents element-wise multiplication; xt and ht are the word embedding vectors and hidden layer at timet, respectively.
The forget gate decides the extent to which the existing memory is kept (Eq. (2)), while the extent to which the new memory is added to the memory cell is controlled by the input gate (Eq. (3)). The memory cell is updated by partially forgetting the existing memory and adding a new memory content (Eq. (5)). The output gate summarizes the memory content exposure in the unit (Eq. (4)). LSTM unit can decide whether to keep the existing memory with three gates. Intuitively, if the LSTM unit detects an important feature from an input sequence at an early stage, it easily carries this information (the existence of the feature) over a long distance, hence, capturing potential long-distance dependencies.
3.3.2 GRU
A Gated Recurrent Unit (GRU) that adaptively remembers and forgets was proposed by [37]. GRU has reset and update gates that modulate the flow of information inside the unit without having a memory cell compared with the LSTM unit. Each GRU can be computed as follows:
X=ht−1xtE7
rt=σXWrT+brE8
zt=σXWzT+bzE9
ht=1−zt⊙ht−1+zt⊙tanhrt⨀ht−1xtWT+bE10
The reset gate filters the information from the previous hidden layer as a forget gate does in the LSTM unit (Eq. (8)), which effectively allows the irrelevant information to be dropped, thus, allowing a more compact representation. On the other hand, the update gate decides how much the GRU updates its information (Eq. (9)). This is similar to LSTM. However, the GRU does not have the mechanism to control the degree to which its state is exposed instead of fully exposing the state each time.
3.3.3 Attention mechanism
The standard LSTM and GRU cannot detect the important part for aspect-level sentiment classification. To address this issue, [43] proposed an attention mechanism that allows the model to capture the key part of a sentence when different aspects are concerned. The architecture of a gated RNN model considering the attention mechanism which can produce an attention weight vector α, and a weighted hidden representation r.
M=tanhWhHWvva⨂eNE11
α=softmaxWmME12
r=HαTE13
where H∈Rdh×N is the hidden matrix, dh is the dimension of the hidden layer, N is the length of the given sentence; va∈Rda is the aspect embedding, and eN∈RN is a N-dimensional vector with an element of 1; ⨂ represents element-wise multiplication; Wh∈Rd×d, Wv∈Rda×da, Wm∈Rd+da, and α∈RN are the parameters to be learned.
The feature representation of a sentence with an aspect h∗ is given by:
h∗=tanhWpr+WxhNE14
where h∗∈Rd, Wp and Wx∈Rd×d are the parameters to be learned.
To better take advantage of aspect information, aspect embedding is appended into each word embedding to allow its contribution to the attention weight. Therefore, the hidden layer can gather information from the aspect and the interdependence of words and aspects can be modeled when computing the attention weights.
4. Experiments and results
4.1 Annotation results
In the first trial, Cohen’s kappa and Krippendorff’s alpha are obtained at 0.80 and 0.78 respectively. Which are highly acceptable in the study since the scores measured the overall attribute and polarity. To identify the category that has the largest variation between two coders, Cohen’s kappa for each label was calculated separately. Results (Table 1) indicated that Polarity had the highest agreement, while attribute showed lower agreement among two annotators. At the end of the first trial, both coders discussed the issues they encountered when they were annotating the corpus and make efforts to improve the preliminary annotation schema. The problems include dealing with the sentence that is difficult to assign the aspects.
Attribute
Polarity
First trial
0.86
0.88
Second trial
0.89
0.91
Table 1.
Cohen’s kappa for categories of aspect and polarity.
Based on the revisions of the annotation schema, the coders conducted the second trial. With the revised annotation schema, the Cohen’s kappa for the attribute and polarity is obtained at 0.89 and 0.91 respectively. In addition, Cohen’s kappa and Krippendorff’s alpha for the aspect-sentiment pair is computed by the end of the second trial, with 0.82 and 0.81 respectively, which indicated that the annotation schema in this study is valid.
4.2 Model training
The experiment was conducted on the dataset of TripAdvisor hotel reviews which contains 5506 sentences, where the numbers of positive, neutral, and negative sentiment samples are 3032, 2986, and 2725, respectively. Given a dataset, maximizing the predictive performance and training efficiency of a model requires finding the optimal network architecture and tuning hyper-parameters. In addition, the samples can significantly affect the performance of the model. To investigate the effect of sentiment sample fractions on the model performance, four sub-datasets with 4000 sentiment samples subjected to different sentiment fractions were resampled from the TripAdvisor hotel dataset as the train sets, one is a balanced dataset and three are unbalanced datasets that the sample fraction of sentiment positive, neutral, and negative dominated, respectively. In addition, it is observed that the average number of the aspects in a sentence is about 1.4, and the average length of the aspects in a sentence is about 8.0, which indicates that one sentence normally contains more than one aspect and the aspect averagely contains eight characters. The number of aspects in train and test sets is more than 850 and 320, respectively, which confirms the diversity of aspects in the dataset of TripAdvisor hotel reviews. For each train set, 20% of reviews were selected as the validation set.
Attention-based gated RNN models including LSTM and GRU were used for ABSA. Attention-based GRU/LSTM without and with aspect embedding were referred to as AT-GRU/AT-LSTM and ATAE-GRU/ATAE-LSTM, respectively. The details of the configurations and used hyper-parameters are summarized in Table 2. In the experiments, all word embeddings with the dimension of 300 were initialized by GloVe [17]. The word embeddings were pre-trained on an unlabeled corpus of which size is about 840 billion. The dimension of hidden layer vectors and aspect embedding are 300 and 100 respectively. The weight matrices are initialized with the uniform distribution U (−0.1, 0.1), and the bias vectors are initialized to zero. The learning rate and mini-batch size are 0.001 and 16 respectively. The best optimizer and number of epochs were obtained from {SGD, Adam, AdaBelief} and {100, 300, 500} respectively via grid search. The optimal parameters based on the best performance on the validation set were kept and the optimal model is used for evaluation in the test set.
Configuration
Hyper-parameter
Word embedding
GloVe
Dimension of word embedding
300
Dimension of hidden layer
30
Dimension of aspect embedding
100
Initializer of weight matrices
Uniform distribution U(−0.1, 0.1)
Initializer of bias vectors
Zero
Optimizer
Search from {SGD, Adam, AdaBelief}
Number of epochs
Search from {100, 300, 500}
Dropout
0.5
Learning rate
0.001
Multi-batch size
16
Table 2.
Details of configurations and used hyper-parameters.
The aim of the training is to minimize the cross-entropy error between the target sentiment distribution y and the predicted sentiment distribution ŷ. However, overfitting is a common issue during training. In order to avoid the over-fitting, regularization procedures including L2-regularization, early stopping as well as dropout were used in the experiment. L2-regularization adds “squared magnitude” of coefficient as a penalty term to the loss function.
loss=−∑i∑jyijlogŷij+λθ2E15
where i is the index of review; j is the index of sentiment class, and the classification in this paper is three-way; λ is the L2-regularization term, which modified the learning rule to multiplicatively shrink the parameter set on each step before performing the usual gradient update; θ is the parameter set.
On the other hand, early stopping is a commonly used and effective way to avoid over-fitting. It reliably occurs that the training error decreases steadily over time, but validation set error begins to rise again. Therefore, early stopping terminates when no parameters have improved over the best-recorded validation error for a pre-specified number of iterations. Additionally, dropout is a simple way to prevent the neural network from overfitting, which refers to temporarily removing cells and their connections from a neural network [55]. In an RNN model, dropout can be implemented on input, output, and hidden layers. In this study, only the output layer with a dropout ratio of 0.5 was followed by a linear layer to transform the feature representation to the conditional probability distribution.
Optimizers are algorithms used to update the attributes of the neural network such as parameter set and learning rate to reduce the losses to provide the most accurate results possible. Three optimizers namely SGD [56], Adam [57], and AdaBelief [58] were used in the experiment to search for the best performance. The standard SGD uses a randomly selected batch of samples from the train set to compute derivate of loss, on which the update of the parameter set is dependent. The updates in the case of the standard SGD are much noisy because the derivative is not always toward minima. As result, the standard SGD may have a more time complexity to converge and get stuck at local minima. In order to overcome this issue, SGD with momentum is proposed by Polyak [56] (1964) to denoise derivative using the previous gradient information to the current update of the parameter set. Given a loss function fθ to be optimized, the SGD with momentum is given by:
vt+1=βvt−αgtE16
θt+1=θt+vt+1E17
where α>0 is the learning rate; β∈01 is the momentum coefficient, which decides the degree to which the previous gradient contributing to the updates of the parameter set, and gt=∇fθt is the gradient at θt.
Both Adam and AdaBelief are adaptive learning rates optimizer. Adam records the first moment of gradient mt which is similar to SGD with momentum and second moment of gradient vt in the meanwhile. mt and vt are updated using the exponential moving average (EMA) of gt and gt2, respectively:
mt+1=β1mt+1−β1gtE18
vt+1=β2vt+1−β2gt2E19
where β1 and β2 are exponential decay rates.
The second moment of gradient st in AdaBelief is updated using the EMA of gt−mt2, which is easily modified from Adam without extra parameters:
st+1=β2st+1−β2gt−mt2E20
The update rules for parameter set using Adam and AdaBelief are given by Eqs. (23) and (24), respectively:
θt+1=θt−αmtvt+εE21
θt+1=θt−αmtst+εE22
where ε is a small number, typically set as 10−8.
Specifically, the update direction in Adam is mt/vt, while the update direction in AdaBelief is mt/st. Intuitively, 1/st is the “belief” in the observation, viewing mt as the prediction of gt, AdaBelief takes a large step when observation gt is close to prediction mt, and a small step when the observation greatly deviates from the prediction.
It is noted that the best models in the validation set were obtained by returning to the parameter set at the point in time with the lowest validation set error.
4.3 Results and analysis
As for the confusion matrix for a multi-class classification task, accuracy is the most basic evaluation measure of classification. The evaluation measure accuracy represents the proportion of the correct predictions of the trained model, and it can be calculated as:
Accuracy=∑1CTPiNE23
where C is the number of classes (C equals to 3 in this study); N is the sample number of the test set; TPi is the number of true predictions for the samples of the ith class, which is diagonally positioned in the confusion matrix. In addition to accuracy, classification effectiveness is usually evaluated in terms of macro precision and recall, which are aimed at a class with only local significance. As Figure 1 illustrates, the class that is being measured is referred to as the positive class and the rest classes are uniformly referred to as the negative classes. The macro precision is the proportion of correct predictions among all predictions with the positive class, while macro recall is the proportion of correct predictions among all positive instances. The macro F1-score is the harmonic mean of macro precision and recall. The macro-average measures take evaluations of each class into consideration, which can be computed as:
where FPi and FNi are the number of false predictions for the positive and negative samples of the ith class, respectively.
This study computed accuracy (A), macro precision (P), macro recall (R), and macro F1-score (F) of AT-GRU, ATAE-GRU, AT-LSTM, and ATAE-LSTM trained with various optimizers and epochs. The results show: (1) Attention-based models (AT-GRU and AT-LSTM) performed better than attention-based models with aspect embedding (ATAE-GRU and ATAE-LSTM). Taken Dataset 1 for example, the best accuracy in the test set using AT-GRU was 80.7%, while the best accuracy using ATAE-GRU was 75.3%; (2) Attention-based GRU performed better than attention-based LSTM. Taken AT-GRU and AT-LSTM for example, the accuracy and macro F1-score of AT-GRU for all datasets were higher than those of AT-LSTM; (3) The balanced dataset (Dataset 1) achieved the best predictive performance for all models. For the unbalanced datasets, the accuracy was exactly close to that of the balanced dataset. However, the macro precision, recall, and F1-score were significantly lower than those of the balanced dataset, which confirmed that the balanced dataset had the best generalization and stability in this study; (4) For Dataset 3 in which the neutral sentiment samples dominated, all of the models exhibited the worst predictive performance compared with other datasets. The candidate model for each dataset is illustrated in Figure 1. It is noted that the candidate model was selected according to accuracy. However, the model with a higher macro F1-score was selected as the candidate model instead when the accuracies of models were similar. Among 16 models, AT-GRU trained with the optimizer of AdaBelief and epoch of 300 in Dataset 1 achieved the highest accuracy of 80.7% and macro F1-score of 75.0% in the meanwhile. Figure 2 illustrates the normalized confusion matrix of the best predictive model of which diagonal represented for the precisions. The precisions of positive and negative sentiment classification were about 20% higher than that of neutral sentiment classification, which confirmed that the need to boost the precision of neutral sentiment classification in order to globally improve the accuracy of the model in future work.
Figure 2.
Normalized confusion matrix of model with best predictive performance.
Early stopping was used in this research to avoid overfitting and save training time. Figure 3 illustrates the learning history of AT-GRU using early stopping in four datasets, where the training stopped when the validation loss kept increasing for 5 epochs (i.e., “patience” equals to 5 in this study). For all datasets, the validation accuracy was exactly close to the training validation during the training procedure, which confirmed that early stopping was able to effectively avoid overfitting. Experimental results of A/P/R/F obtained based on training AT-GRU and AT-LSTM using early stopping. The accuracies obtained by AT-GRU and AT-LSTM were similar. For the balanced dataset, the accuracy and macro F1-score obtained by early stopping were significantly lower than that obtained by the corresponding model without early stopping. This is because the loss function probably found the local minima if the training stopped when the loss started to rise for 5 epochs. All of the optimizers used in this study were aimed at avoiding the loss function sticking at the local minima to find the global loss minima, therefore, using more epochs in the training was effective to obtain the best predictive performance model. On the other hand, for the unbalanced datasets, the accuracy and macro F1-score obtained by early stopping were similar to that obtained by the corresponding model without early stopping, which indicated that early stopping was effective to avoid overfitting as the loss converged fast in the unbalanced dataset. Although early stopping is a straightforward way of avoiding overfitting and improving training efficiency, the trade-off is that the model for test set possibly returns at the time point when reaching the local minima of loss function especially for the balanced dataset, and a new hyper-parameter of “patience” which is sensitive to the results is introduced.
Figure 3.
Learning history of AT-GRU using early stopping.
Three optimizers were used in this study to find the best model. Figure 4 illustrates the learning history of AT-GRU in four datasets. The gap between training and validation accuracy was the largest, which indicated that the worst generalization of Adam among three optimizers in this study although it converged quickly at the very beginning except for Dataset 3. Both SGD and AdaBelief can achieve good predictive performance with good generalization, however, AdaBelief converged faster than SGD, and the best results were achieved by AdaBelief.
Figure 4.
Learning history of AT-GRU.
5. Conclusions and future extensions
In this study, the hotel review dataset collected from TripAdvisor for aspect-level sentiment classification was first established. The dataset contains 5506 sentences in which the numbers of positive, neutral, and negative sentiment samples are 3032, 2986, and 2725, respectively. In order to study the effect of the fraction of sentiment samples on the model performance, four sub-datasets with a various fraction of sentiment samples were resampled from the TripAdvisor hotel review dataset as the train sets. The task in this study is to determine the aspect polarity of a given review with the corresponding aspects. To achieve a good predictive performance toward a multi-class classification task, attention-based GRU and LSTM (AT-GRU and AT-LSTM), as well as attention-based GRU and LSTM with aspect embedding (ATAE-GRU and ATAE-LSTM), were optimized with SGD, Adam, and AdaBelief and trained with epochs of 100, 300, and 500, respectively. Conclusions from these experiments are as follows:
AT-GRU and AT-LSTM performed better than ATAE-GRU and ATAE-LSTM. Taken the balanced dataset as an example, the best accuracy in the test set using AT-GRU was 80.7%, while the best accuracy using ATAE-GRU was 75.3%.
Attention-based GRU performed better than attention-based LSTM. Taken AT-GRU and AT-LSTM for example, the accuracy and macro F1-score of AT-GRU for all datasets were higher than those of AT-LSTM.
The balanced dataset achieved the best predictive performance. For the unbalanced datasets, the accuracy was exactly close to that of the balanced dataset, however, the macro precision, recall, and F1-score were significantly lower than those of the balanced dataset, which confirmed that the balanced dataset had the best generalization and stability in this study. For the dataset in which the neutral sentiment samples dominated, all of the models exhibited the worst predictive performance.
For the balanced dataset, the accuracy and macro F1-score obtained by early stopping was significantly lower than that obtained by the corresponding model without early stopping. However, for the unbalanced datasets, the accuracy and macro F1-score obtained by early stopping were similar to that obtained by the corresponding model without early stopping, which indicated that early stopping was effective to avoid overfitting as the loss converged fast in the unbalanced datasets.
For optimizers, both SGD and AdaBelief can achieve good predictive performance with good generalization, however, AdaBelief converged faster than SGD, and the best results were achieved by AdaBelief.
This work includes the application of natural language processing technologies on the aspect-level sentiment analysis of the TripAdvisor hotel dataset, and there are still several extensions to be explored as follows:
Enlargement of the dataset. This study focused on the hotel in Macau, collecting 5506 reviews from TripAdvisor. To improve the model performance, hotels from other countries and regions can be collected into the dataset.
Improvement of model performance, especially for the predictive capacity of the neutral sentiment samples. The sentence and aspect embeddings were initialized with GloVe, and BERT which is popular in recent research can be used. In addition, although the attention mechanism was used in this study to improve model performance, the state-of-art self-attention mechanism such as multi-head attention can be used in the future to further refine the model.
Development of a mobile application. Once the model with stable performance is achieved, RNN algorithms can be integrated into a portable device such as a smartphone to help with real-time aspect-level sentiment analysis in tourism.
\n',keywords:"Deep learning, Aspect-based Sentiment Analysis, User-generated content, Gated Recurrent Neural Network",chapterPDFUrl:"https://cdn.intechopen.com/pdfs/77605.pdf",chapterXML:"https://mts.intechopen.com/source/xml/77605.xml",downloadPdfUrl:"/chapter/pdf-download/77605",previewPdfUrl:"/chapter/pdf-preview/77605",totalDownloads:163,totalViews:0,totalCrossrefCites:0,dateSubmitted:"May 17th 2021",dateReviewed:"June 10th 2021",datePrePublished:"July 19th 2021",datePublished:"March 30th 2022",dateFinished:"July 19th 2021",readingETA:"0",abstract:"Mining the sentiment of the user on the internet via the context plays a significant role in uncovering the human emotion and in determining the exactness of the underlying emotion in the context. An increasingly enormous number of user-generated content (UGC) in social media and online travel platforms lead to development of data-driven sentiment analysis (SA), and most extant SA in the domain of tourism is conducted using document-based SA (DBSA). However, DBSA cannot be used to examine what specific aspects need to be improved or disclose the unknown dimensions that affect the overall sentiment like aspect-based SA (ABSA). ABSA requires accurate identification of the aspects and sentiment orientation in the UGC. In this book chapter, we illustrate the contribution of data mining based on deep learning in sentiment and emotion detection.",reviewType:"peer-reviewed",bibtexUrl:"/chapter/bibtex/77605",risUrl:"/chapter/ris/77605",signatures:"Weijun Li, Qun Yang and Wencai Du",book:{id:"10859",type:"book",title:"Data Mining",subtitle:"Concepts and Applications",fullTitle:"Data Mining - Concepts and Applications",slug:"data-mining-concepts-and-applications",publishedDate:"March 30th 2022",bookSignature:"Ciza Thomas",coverURL:"https://cdn.intechopen.com/books/images_new/10859.jpg",licenceType:"CC BY 3.0",editedByType:"Edited by",isbn:"978-1-83969-267-3",printIsbn:"978-1-83969-266-6",pdfIsbn:"978-1-83969-268-0",isAvailableForWebshopOrdering:!0,editors:[{id:"43680",title:"Prof.",name:"Ciza",middleName:null,surname:"Thomas",slug:"ciza-thomas",fullName:"Ciza Thomas"}],productType:{id:"1",title:"Edited Volume",chapterContentType:"chapter",authoredCaption:"Edited by"}},authors:[{id:"357198",title:"Prof.",name:"Wencai",middleName:null,surname:"Du",fullName:"Wencai Du",slug:"wencai-du",email:"georgedu@cityu.mo",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",institution:null},{id:"357214",title:"Dr.",name:"Weijun",middleName:null,surname:"Li",fullName:"Weijun Li",slug:"weijun-li",email:"vivian_lwjun@hotmail.com",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",institution:null},{id:"419199",title:"Dr.",name:"Qun",middleName:null,surname:"Yang",fullName:"Qun Yang",slug:"qun-yang",email:"qyan327@aucklanduni.ac.nz",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",institution:{name:"University of Auckland",institutionURL:null,country:{name:"New Zealand"}}}],sections:[{id:"sec_1",title:"1. Introduction",level:"1"},{id:"sec_2",title:"2. Literature review",level:"1"},{id:"sec_2_2",title:"2.1 Input vectors",level:"2"},{id:"sec_3_2",title:"2.2 DL methods for ABSA",level:"2"},{id:"sec_3_3",title:"2.2.1 CNN",level:"3"},{id:"sec_4_3",title:"2.2.2 RNN and attention-based RNN",level:"3"},{id:"sec_5_3",title:"2.2.3 Memory network",level:"3"},{id:"sec_7_2",title:"2.3 Studies using DL methods in tourism and research gap",level:"2"},{id:"sec_9",title:"3. Research design and experiment",level:"1"},{id:"sec_9_2",title:"3.1 Corpora design",level:"2"},{id:"sec_10_2",title:"3.2 Annotation",level:"2"},{id:"sec_11_2",title:"3.3 Attention-based gated RNN",level:"2"},{id:"sec_11_3",title:"3.3.1 LSTM unit",level:"3"},{id:"sec_12_3",title:"3.3.2 GRU",level:"3"},{id:"sec_13_3",title:"3.3.3 Attention mechanism",level:"3"},{id:"sec_16",title:"4. Experiments and results",level:"1"},{id:"sec_16_2",title:"4.1 Annotation results",level:"2"},{id:"sec_17_2",title:"4.2 Model training",level:"2"},{id:"sec_18_2",title:"4.3 Results and analysis",level:"2"},{id:"sec_20",title:"5. Conclusions and future extensions",level:"1"}],chapterReferences:[{id:"B1",body:'Gretzel U, Yoo KH. Use and impact of online travel reviews. In: Information and Communication Technologies in Tourism 2008. Vienna: Springer Vienna; 2008. p. 35–46'},{id:"B2",body:'Li H, Ye Q, Law R. Determinants of customer satisfaction in the hotel industry: An application of online review analysis. Asia Pac J. Tour Res. 2013;18(7):784–802'},{id:"B3",body:'Choi S, Lehto XY, Morrison AM. Destination image representation on the web: Content analysis of Macau travel related websites. Tour Manag. 2007;28(1):118–29'},{id:"B4",body:'García-Pablos A, Cuadros M, Linaza MT. OpeNER: Open tools to perform natural language processing on accommodation reviews. In: Information and Communication Technologies in Tourism 2015. Cham: Springer International Publishing; 2015. p. 125–37'},{id:"B5",body:'Kang H, Yoo SJ, Han D. Senti-lexicon and improved Naïve Bayes algorithms for sentiment analysis of restaurant reviews. Expert Syst Appl. 2012;39(5):6000–10'},{id:"B6",body:'Zheng W, Ye Q. Sentiment classification of Chinese traveler reviews by support vector machine algorithm. In: 2009 Third International Symposium on Intelligent Information Technology Application. IEEE; 2009'},{id:"B7",body:'Zhang Z, Ye Q, Zhang Z, Li Y. Sentiment classification of Internet restaurant reviews written in Cantonese. Expert Syst Appl. 2011;38(6):7674–82'},{id:"B8",body:'Liu B. Opinion Mining and Sentiment Analysis. In: Web Data Mining. Berlin, Heidelberg: Springer Berlin Heidelberg; 2011. p. 459–526'},{id:"B9",body:'Do HH, Prasad PWC, Maag A, Alsadoon A. Deep learning for aspect-based sentiment analysis: A comparative review. Expert Syst Appl. 2019;118:272–99'},{id:"B10",body:'Schouten K, Frasincar F. Survey on aspect-level sentiment analysis. IEEE Trans Knowl Data Eng. 2016;28(3):813–30'},{id:"B11",body:'Luo J, Huang S (sam), Wang R. A fine-grained sentiment analysis of online guest reviews of economy hotels in China. J Hosp Mark Manag. 2021;30(1):71–95'},{id:"B12",body:'Sheng F, Zhang Y, Shi C, Qiu M, Yao S. Xi’an tourism destination image analysis via deep learning. J. Ambient Intell Humaniz Comput [Internet]. 2020; Available from: http://dx.doi.org/10.1007/s12652-020-02344-w'},{id:"B13",body:'Li X, Bing L, Lam W, Shi B. Transformation networks for target-oriented sentiment classification. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Stroudsburg, PA, USA: Association for Computational Linguistics; 2018'},{id:"B14",body:'Zhou J, Huang JX, Chen Q, Hu QV, Wang T, He L. Deep learning for aspect-level sentiment classification: Survey, vision, and challenges. IEEE Access. 2019;7:78454–83'},{id:"B15",body:'Gu, S. Q., Zhang, L. P., Hou, Y. X., & Song, Y. A. A Position-aware Bidirectional Attention Network for Aspect-Level Sentiment Analysis. Proceedings of the 27th International Conference on Computational Linguistics. 2018;774–84'},{id:"B16",body:'Mikolov T, Chen K, Corrado G, Dean J. Efficient estimation of word representations in vector space [Internet]. arXiv [cs.CL]. 2013. Available from: http://arxiv.org/abs/1301.3781'},{id:"B17",body:'Pennington J, Socher R, Manning C. Glove: Global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Stroudsburg, PA, USA: Association for Computational Linguistics; 2014'},{id:"B18",body:'Poria S, Chaturvedi I, Cambria E, Bisio F. Sentic LDA: Improving on LDA with semantic similarity for aspect-based sentiment analysis. In: 2016 International Joint Conference on Neural Networks (IJCNN). IEEE; 2016'},{id:"B19",body:'Wu H, Gu Y, Sun S, Gu X. Aspect-based opinion summarization with convolutional neural networks. In: 2016 International Joint Conference on Neural Networks (IJCNN). IEEE; 2016'},{id:"B20",body:'Liu P, Joty S, Meng H. Fine-grained opinion mining with recurrent neural networks and word embeddings. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA, USA: Association for Computational Linguistics; 2015'},{id:"B21",body:'Bengio, Y., Schwenk, H., Senécal, J. S., Morin, F. M., & Gauvain, J. L. Neural Probabilistic Language Models. Heidelberg: Springer; 2006'},{id:"B22",body:'Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L, editor. Deep contextualized word representations. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2018. p. 2227–37'},{id:"B23",body:'Devlin J, Chang M-W, Lee K, Toutanova K. BERT: Pre-training of deep bidirectional Transformers for language understanding [Internet]. arXiv [cs.CL]. 2018. Available from: http://arxiv.org/abs/1810.04805'},{id:"B24",body:'Feng J, Cai S, Ma X. Enhanced sentiment labeling and implicit aspect identification by integration of deep convolution neural network and sequential algorithm. Cluster Comput. 2019;22(S3):5839–57'},{id:"B25",body:'Jebbara S, Cimiano P. Aspect-based sentiment analysis using a two-step neural network architecture. In: Semantic Web Challenges. Cham: Springer International Publishing; 2016. p. 153–67'},{id:"B26",body:'MA, Y., Peng, H. Y., & Cambria, E. Targeted Aspect-Based Sentiment Analysis via Embedding Commonsense Knowledge into an Attentive LSTM. In: The Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18). 2018. p. 5876–83'},{id:"B27",body:'Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9(8):1735–80'},{id:"B28",body:'Goldberg Y. Neural network methods for natural language processing. Synth lect hum lang technol. 2017;10(1):1–309'},{id:"B29",body:'Poria S, Cambria E, Gelbukh A, Bisio F, Hussain A. Sentiment data flow analysis by means of dynamic linguistic patterns. IEEE Comput Intell Mag. 2015;10(4):26–36'},{id:"B30",body:'Xue W, Li T. Aspect based sentiment analysis with gated convolutional networks. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Stroudsburg, PA, USA: Association for Computational Linguistics; 2018'},{id:"B31",body:'Fan C, Gao Q, Du J, Gui L, Xu R, Wong K-F. Convolution-based memory network for aspect-based sentiment analysis. In: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval - SIGIR ‘18. New York, New York, USA: ACM Press; 2018'},{id:"B32",body:'Xu L, Lin J, Wang L, Yin C, Wang J. Deep convolutional neural network-based approach for aspect-based sentiment analysis. In Science & Engineering Research Support soCiety; 2017'},{id:"B33",body:'Gu X, Gu Y, Wu H. Cascaded convolutional neural networks for aspect-based opinion summary. Neural Process Lett. 2017;46(2):581–94'},{id:"B34",body:'Goldberg Y. A primer on neural network models for natural language processing. J. Artif Intell Res. 2016;57:345–420'},{id:"B35",body:'Bengio Y. Deep Learning. London, England: MIT Press; 2016'},{id:"B36",body:'Tang D, Qin B, Liu T. Aspect level sentiment classification with deep memory network. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA, USA: Association for Computational Linguistics; 2016'},{id:"B37",body:'Cho K, van Merrienboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, et al. Learning phrase representations using RNN encoder–decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Stroudsburg, PA, USA: Association for Computational Linguistics; 2014'},{id:"B38",body:'Graves A. Supervised sequence labelling. In: Studies in Computational Intelligence. Berlin, Heidelberg: Springer Berlin Heidelberg; 2012. p. 5–13'},{id:"B39",body:'Fan, Yuchen. Qian, Yao. Xie, Feng-Long. Soong, Frank K. TTS synthesis with bidirectional LSTM based recurrent neural networks. In: INTERSPEECH-2014. 2014. p. 1964–8'},{id:"B40",body:'Chaudhuri A, Ghosh SK. Sentiment analysis of customer reviews using robust hierarchical bidirectional recurrent neural network. In: Advances in Intelligent Systems and Computing. Cham: Springer International Publishing; 2016. p. 249–61'},{id:"B41",body:'Chen T, Xu R, He Y, Wang X. Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN. Expert Syst Appl. 2017;72:221–30'},{id:"B42",body:'Luong T, Pham H, Manning CD. Effective approaches to attention-based neural machine translation. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA, USA: Association for Computational Linguistics; 2015'},{id:"B43",body:'Wang Y, Huang M, Zhu X, Zhao L. Attention-based LSTM for Aspect-level Sentiment Classification. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA, USA: Association for Computational Linguistics; 2016'},{id:"B44",body:'Zeng J, Ma X, Zhou K. Enhancing attention-based LSTM with position context for aspect-level sentiment classification. IEEE Access. 2019;7:20462–71'},{id:"B45",body:'He, R., Lee, W. S., Ng, H. T., & Dahlmeier, D. Effective attention modeling for aspect-level sentiment classification. In: Proceedings of the 27th International Conference on Computational Linguistics. 2018. p. 1121–31'},{id:"B46",body:'Wang, W., Pan, S. J., & Dahlmeier, D. Coupled Multi-Layer Attentions for Co-Extraction of Aspect and Opinion Terms. In: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI-17). 2017'},{id:"B47",body:'Cheng J, Zhao S, Zhang J, King I, Zhang X, Wang H. Aspect-level sentiment classification with HEAT (HiErarchical ATtention) network. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management - CIKM ‘17. New York, New York, USA: ACM Press; 2017'},{id:"B48",body:'Wang S, Mazumder S, Liu B, Zhou M, Chang Y. Target-sensitive memory networks for aspect sentiment classification. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Stroudsburg, PA, USA: Association for Computational Linguistics; 2018'},{id:"B49",body:'Chang Y-C, Ku C-H, Chen C-H. Using deep learning and visual analytics to explore hotel reviews and responses. Tour Manag. 2020;80(104129):104129'},{id:"B50",body:'Gao J, Yao R, Lai H, Chang T-C. Sentiment analysis with CNNs built on LSTM on tourists’ comments. In: 2019 IEEE Eurasia Conference on Biomedical Engineering, Healthcare and Sustainability (ECBIOS). IEEE; 2019'},{id:"B51",body:'Pontiki M, Galanis D, Pavlopoulos J, Papageorgiou H, Androutsopoulos I, Manandhar S. SemEval-2014 Task 4: Aspect Based Sentiment Analysis. In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014). Stroudsburg, PA, USA: Association for Computational Linguistics; 2014'},{id:"B52",body:'Pontiki M, Galanis D, Papageorgiou H, Manandhar S, Androutsopoulos I. SemEval-2015 Task 12: Aspect Based Sentiment Analysis. In: Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015). Stroudsburg, PA, USA: Association for Computational Linguistics; 2015'},{id:"B53",body:'Ganu, G., Elhadad, N., & Marian, A. (2009). Beyond the Stars: Improving Rating Predictions using Review Text Content [Internet]. Available from: Beyond the Stars: Improving Rating Predictions using Review Text Content. Twelfth International Workshop on the Web and Databases./http://spidr-ursa.rutgers.edu/resources/WebDB.pdf'},{id:"B54",body:'Moreno-Ortiz A, Salles-Bernal S, Orrequia-Barea A. Design and validation of annotation schemas for aspect-based sentiment analysis in the tourism sector. Inf Technol Tour. 2019;21(4):535–57'},{id:"B55",body:'Nitish Srivastava Geoffrey Hinton Alex Krizhevsky Ilya Sutskever Ruslan Salakhutdinov. Dropout: A Simple Way to Prevent Neural Networks from Overfitting. Journal of Machine Learning Research. 2014;15:1929–58'},{id:"B56",body:'Polyak BT. Some methods of speeding up the convergence of iteration methods. USSR Comput Math Math Phys. 1964;4(5):1–17'},{id:"B57",body:'Kingma DP, Ba J. Adam: A method for stochastic optimization [Internet]. arXiv [cs.LG]. 2014. Available from: http://arxiv.org/abs/1412.6980'},{id:"B58",body:'Zhuang J, Tang T, Ding Y, Tatikonda S, Dvornek N, Papademetris X, et al. AdaBelief optimizer: Adapting stepsizes by the belief in observed gradients [Internet]. arXiv [cs.LG]. 2020. Available from: http://arxiv.org/abs/2010.07468'}],footnotes:[],contributors:[{corresp:null,contributorFullName:"Weijun Li",address:null,affiliation:'
'}],corrections:null},book:{id:"10859",type:"book",title:"Data Mining",subtitle:"Concepts and Applications",fullTitle:"Data Mining - Concepts and Applications",slug:"data-mining-concepts-and-applications",publishedDate:"March 30th 2022",bookSignature:"Ciza Thomas",coverURL:"https://cdn.intechopen.com/books/images_new/10859.jpg",licenceType:"CC BY 3.0",editedByType:"Edited by",isbn:"978-1-83969-267-3",printIsbn:"978-1-83969-266-6",pdfIsbn:"978-1-83969-268-0",isAvailableForWebshopOrdering:!0,editors:[{id:"43680",title:"Prof.",name:"Ciza",middleName:null,surname:"Thomas",slug:"ciza-thomas",fullName:"Ciza Thomas"}],productType:{id:"1",title:"Edited Volume",chapterContentType:"chapter",authoredCaption:"Edited by"}}},profile:{item:{id:"31214",title:"Dr.",name:"Doina-Carmen",middleName:null,surname:"Manciuc",email:"dmanciuc@yahoo.com",fullName:"Doina-Carmen Manciuc",slug:"doina-carmen-manciuc",position:null,biography:null,institutionString:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",totalCites:0,totalChapterViews:"0",outsideEditionCount:0,totalAuthoredChapters:"3",totalEditedBooks:"0",personalWebsiteURL:null,twitterURL:null,linkedinURL:null,institution:null},booksEdited:[],chaptersAuthored:[{id:"22986",title:"Adolescence - A New Multilevel Approach on the HIV/AIDS Patient",slug:"adolescence-a-new-multilevel-approach-on-the-hiv-aids-patient",abstract:null,signatures:"Largu Maria Alexandra, Manciuc Doina Carmen and Dorobăţ Carmen",authors:[{id:"31214",title:"Dr.",name:"Doina-Carmen",surname:"Manciuc",fullName:"Doina-Carmen Manciuc",slug:"doina-carmen-manciuc",email:"dmanciuc@yahoo.com"},{id:"49014",title:"Ms.",name:"Maria Alexandra",surname:"Largu",fullName:"Maria Alexandra Largu",slug:"maria-alexandra-largu",email:"largualexandra@yahoo.com"},{id:"49015",title:"Prof.",name:"Carmen",surname:"Dorobăţ",fullName:"Carmen Dorobăţ",slug:"carmen-dorobat",email:"carmendorobat@yahoo.com"}],book:{id:"498",title:"Global Bioethics",slug:"global-bioethics-perspective-for-human-survival",productType:{id:"1",title:"Edited Volume"}}},{id:"73899",title:"The Psychological Impact on Families of Departed Patients with Infectious Diseases",slug:"the-psychological-impact-on-families-of-departed-patients-with-infectious-diseases",abstract:"Looking back into history, infectious diseases played an important role in human history being responsible, in terms of pathologies, for more deaths than any other disease. Considering that infectious diseases have a high rate of transmissibility, with an acute debut and sometimes with a fast evolution to exitus, the impact of the news on families of the departed patient diagnosed with an infectious disease can come as a shock. Processing the unexpected death of a family member needs not only the implication of the physician but also the counseling of a specialized psychologist which can help the families through all stages of loss and grief.",signatures:"Doina-Carmen Manciuc, Georgiana Alexandra Lacatusu, Cristina Vasilescu and Maria Alexandra Largu",authors:[{id:"31214",title:"Dr.",name:"Doina-Carmen",surname:"Manciuc",fullName:"Doina-Carmen Manciuc",slug:"doina-carmen-manciuc",email:"dmanciuc@yahoo.com"},{id:"49014",title:"Ms.",name:"Maria Alexandra",surname:"Largu",fullName:"Maria Alexandra Largu",slug:"maria-alexandra-largu",email:"largualexandra@yahoo.com"},{id:"332594",title:"Dr.",name:"Georgiana Alexandra",surname:"Lacatusu",fullName:"Georgiana Alexandra Lacatusu",slug:"georgiana-alexandra-lacatusu",email:"alexandra.lacatusu@gmail.com"},{id:"336610",title:"Dr.",name:"Cristina",surname:"Vasilescu",fullName:"Cristina Vasilescu",slug:"cristina-vasilescu",email:"cs_vasilescu@yahoo.com"}],book:{id:"9566",title:"Bioethics in Medicine and Society",slug:"bioethics-in-medicine-and-society",productType:{id:"1",title:"Edited Volume"}}},{id:"80296",title:"The HIV Positive Adolescent in a Pandemic Year: A Point of View",slug:"the-hiv-positive-adolescent-in-a-pandemic-year-a-point-of-view",abstract:"In the HIV/AIDS Regional Center from Iasi, Romania, over 1440 patients are closely followed-up. A small percent <1% (12 patients) of cases are represented by adolescences between 14 and 18 years old. The majority of those (10 cases) are adherent and compliant with the treatment. None of the patients is a drug abuser and one patient acquired the infection through vertical transmission. The COVID-19 pandemic, paradoxically, increased the adherence and compliance to treatment, mainly because it seems that the HIV infected adolescent acknowledge the fact that good health can shield them from an unknown enemy. In these pandemic times, they experienced anxiety and depression, but they kept a closer contact through telemedicine with their physician, and most importantly, they required a sustained session, also through telemedicine, with the psychologist. The red thread of their discussion was focused on their fear, insecurities, and lack of control and the fact that they experienced the feeling of abandonment caused by the absence of interpersonal interaction with their support group.",signatures:"Manciuc Carmen, Cristina Sapaniuc, Largu Alexandra and Lacatusu Georgiana Alexandra",authors:[{id:"31214",title:"Dr.",name:"Doina-Carmen",surname:"Manciuc",fullName:"Doina-Carmen Manciuc",slug:"doina-carmen-manciuc",email:"dmanciuc@yahoo.com"},{id:"49014",title:"Ms.",name:"Maria Alexandra",surname:"Largu",fullName:"Maria Alexandra Largu",slug:"maria-alexandra-largu",email:"largualexandra@yahoo.com"},{id:"332594",title:"Dr.",name:"Georgiana Alexandra",surname:"Lacatusu",fullName:"Georgiana Alexandra Lacatusu",slug:"georgiana-alexandra-lacatusu",email:"alexandra.lacatusu@gmail.com"},{id:"336610",title:"Dr.",name:"Cristina",surname:"Vasilescu",fullName:"Cristina Vasilescu",slug:"cristina-vasilescu",email:"cs_vasilescu@yahoo.com"}],book:{id:"10671",title:"Adolescences",slug:null,productType:{id:"1",title:"Edited Volume"}}}],collaborators:[{id:"31574",title:"Prof.",name:"Miguel",surname:"Kottow",slug:"miguel-kottow",fullName:"Miguel Kottow",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",biography:null,institutionString:null,institution:null},{id:"39651",title:"Prof.",name:"Brunetto",surname:"Chiarelli",slug:"brunetto-chiarelli",fullName:"Brunetto Chiarelli",position:null,profilePictureURL:"https://mts.intechopen.com/storage/users/39651/images/1843_n.jpg",biography:"Dr. Brunetto Chiarelli received his degree in Natural Sciences and Biology from the University of Florence in 1958. In 1961., after two-year stay at the Institute of Genetics of Pavia, he was nominated as professor at the University of Turin where up to 1979. he taught Anthropology, Primatology and Human Ecology . In 1979. he moved to the chair of Anthropology in Florence.\nFrom 1970. to 1975. he was a Visiting Prof. at the University of Toronto, where he taught Human Evolution and, as expert of human cytogenetics and genetics, took part in the UNESCO project the “Human Adaptability”, on the Eskimo population of Igloolik. He was past President of the European Anthropological Association, and present President of the European Association of Global Bioethics.\nHe is the author of 400 scientific publications concerning problems of genetics, cytogenetics, Primate taxonomy and evolution, biology of present and past human population, and Bioethics. Chiarelli is currently editor in chief for following journals: “ Human Evolution”; “International Journal of Anthropology” and for “Global Bioethics”, a specific journal dealing with the human impact on Nature.",institutionString:null,institution:null},{id:"40064",title:"Dr.",name:"Rolando",surname:"Jiménez-Domínguez",slug:"rolando-jimenez-dominguez",fullName:"Rolando Jiménez-Domínguez",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",biography:"Electronics Engineer, Physicist and Ph. D. in Solid State Physics. Teacher and researcher in Solid State Physics, Materials Science and History and Philosophy of Science and Technology. Currently working on Energetics and Science-Technology-Society relationships.",institutionString:null,institution:{name:"Instituto Politécnico Nacional",institutionURL:null,country:{name:"Mexico"}}},{id:"49014",title:"Ms.",name:"Maria Alexandra",surname:"Largu",slug:"maria-alexandra-largu",fullName:"Maria Alexandra Largu",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",biography:null,institutionString:null,institution:null},{id:"49015",title:"Prof.",name:"Carmen",surname:"Dorobăţ",slug:"carmen-dorobat",fullName:"Carmen Dorobăţ",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",biography:"Professional experience > 15 years \nExperience in Higher Education - 10 years. \n\nFull Professor; Head of Department; head of discipline (Infectious Diseases); The Gr T. Popa†University of Medicine and Pharmacy of Iasi.\n\nGeneral Manager -\tThe Clinical Hospital of Infectious Diseases of Iasi\n\n•\tMaintaining educational standards and increasing professional skills as an educator in the field of infectious diseases\n•\tPrograme of Licensed completed studies\n•\tResearch programs completed with a dissertation - MA \n•\tDoctoral degree program \n•\tResidency Program\n•\tContinuous Medical Education Program",institutionString:null,institution:{name:"Grigore T. Popa University of Medicine and Pharmacy",institutionURL:null,country:{name:"Romania"}}},{id:"49197",title:"Prof.",name:"Tineke",surname:"Abma",slug:"tineke-abma",fullName:"Tineke Abma",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",biography:null,institutionString:null,institution:null},{id:"49211",title:"Prof.",name:"Guy",surname:"Widdershoven",slug:"guy-widdershoven",fullName:"Guy Widdershoven",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",biography:null,institutionString:null,institution:null},{id:"50693",title:"Dr.",name:"Eudes",surname:"Oliveira Junior",slug:"eudes-oliveira-junior",fullName:"Eudes Oliveira Junior",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",biography:null,institutionString:null,institution:null},{id:"84271",title:"Dr.",name:"Seyyare",surname:"Duman",slug:"seyyare-duman",fullName:"Seyyare Duman",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",biography:null,institutionString:null,institution:{name:"Anadolu University",institutionURL:null,country:{name:"Turkey"}}},{id:"138254",title:"Dr.",name:"Onofre",surname:"Rojo-Asenjo",slug:"onofre-rojo-asenjo",fullName:"Onofre Rojo-Asenjo",position:null,profilePictureURL:"//cdnintech.com/web/frontend/www/assets/author.svg",biography:null,institutionString:null,institution:{name:"Instituto Valenciano de Investigaciones Económicas",institutionURL:null,country:{name:"Spain"}}}]},generic:{page:{slug:"publication-agreement-journals",title:"Publication Agreement - Journal Article",intro:'
IntechOpen aims to ensure that original material is published while at the same time giving significant freedom to our Authors. To that end we maintain a flexible Copyright Policy guaranteeing that there is no transfer of copyright to the publisher and Authors retain exclusive copyright to their Work.
',metaTitle:"Publication Agreement - Journals",metaDescription:"IntechOpen aims to ensure that original material is published while at the same time giving significant freedom to our Authors",metaKeywords:null,canonicalURL:"/page/publication-agreement-journals",contentRaw:'[{"type":"htmlEditorComponent","content":"
The Corresponding Author (acting on behalf of all Authors) and INTECHOPEN LIMITED, incorporated and registered in England and Wales with company number 11086078 and a registered office at 5 Princes Gate Court, London, United Kingdom, SW7 2QJ conclude the following Agreement regarding the publication of a Journal Article:
\\n\\n
1. DEFINITIONS
\\n\\n
Corresponding Author: The Author of the Article who serves as a Signatory to this Agreement. The Corresponding Author acts on behalf of any other Co-Author. Co-Author: All other Authors of the Article besides the Corresponding Author. IntechOpen: IntechOpen Ltd., the Publisher of the Journal.
\\n\\n
Journal: The publication as a collection of Articles compiled by IntechOpen .
\\n\\n
Article: The original literary work created by Corresponding Author and any Co Author that is the subject of this Agreement.
\\n\\n
2. CORRESPONDING AUTHOR'S GRANT OF RIGHTS
\\n\\n
2.1 Subject to the following Article, the Corresponding Author grants and shall ensure that each Co-Author grants, to IntechOpen, during the full term of copyright and any extensions or renewals of that term the following:
\\n\\n
• An irrevocable, worldwide, royalty-free, perpetual, transferable, sublicensable, non-exclusive right to publish, communicate to the public, reproduce, republish, transmit, sell, distribute and otherwise use and make available the Article in whole, partial or adapted from and/or incorporated in or in conjunction with other works, in electronic and print editions of the Publication and in derivative works and on any platform owned and/or operated by IntechOpen, throughout the world, in all languages, and in all media and formats now known or later developed.
\\n\\n
• An irrevocable, worldwide, royalty-free, perpetual, transferable, sublicensable, non-exclusive right to create and store electronic archival copies of the Article, including the right to deposit the Article in open access digital repositories.
\\n\\n
• An irrevocable, worldwide, royalty-free, perpetual, transferable, sublicensable, non-exclusive right to license others to reproduce, translate, republish, transmit and distribute the Article in whole, partial or adapted from and/or incorporated in or in conjunction with other works under the condition that the Corresponding Author and each Co-Author is attributed (currently this is carried out by publishing the Article under a Creative Commons 4.0 International Licence).
\\n\\n
The aforementioned licenses shall survive the expiry or termination of this Agreement for any reason.
\\n\\n
2.2 The Corresponding Author (on their own behalf and on behalf of any Co-Author) reserves the following rights to the Article but agrees not to exercise them in such a way as to adversely affect IntechOpen's ability to utilize the full benefit of this Publication Agreement: (i) reprographic rights worldwide, other than those which subsist in the typographical arrangement of the Article as published by IntechOpen; and (ii) public lending rights arising under the Public Lending Right Act 1979, as amended from time to time, and any similar rights arising in any part of the world. The Corresponding Author confirms that they (and any Co-Author) are and will remain a member of any applicable licensing and collecting society and any successor to that body responsible for administering royalties for the reprographic reproduction of copyright works.
\\n\\n
Subject to the license granted above, copyright in the Article and all versions of it created during IntechOpen's editing process (including the published version) is retained by the Corresponding Author and any Co-Author.
\\n\\n
Subject to the license granted above, the Corresponding Author and any Co-Author retains patent, trademark and other intellectual property rights to the Article.
\\n\\n
2.3 All rights granted to IntechOpen in this Article are assignable, sublicensable or otherwise transferrable to third parties without the Corresponding Author's or any Co-Author’s specific approval.
\\n\\n
2.4 The Corresponding Author (on their own behalf and on behalf of each Co Author) will not assert any rights under the Copyright, Designs and Patents Act 1988 to object to derogatory treatment of the Article as a consequence of IntechOpen's changes to the Article arising from translation of it, corrections and edits for house style, removal of problematic material and other reasonable edits.
\\n\\n
3. CORRESPONDING AUTHOR'S DUTIES
\\n\\n
3.1 When distributing or re-publishing the Article, the Corresponding Author agrees to credit the Journal in which the Article has been published as the source of first publication, as well as IntechOpen. The Corresponding Author warrants that each Co-Author will also credit the Journal in which the Article has been published as the source of first publication, as well as IntechOpen, when they are distributing or re publishing the Article.
\\n\\n
3.2 When submitting the Article, the Corresponding Author agrees to:
\\n\\n
• Comply with all instructions and guidelines provided by IntechOpen;
\\n\\n
• Produce the Article with all due skill, care and diligence, and in accordance with good scientific practice;
\\n\\n
• Submit all the corrections in due time as defined during the publishing process schedule.
\\n\\n
The Corresponding Author will be held responsible for the payment of the Article Processing Charge.
\\n\\n
All payments shall be due 30 days from the date of the issued invoice. The Corresponding Author or the payer on the Corresponding Author's and Co-Authors' behalf will bear all banking and similar charges incurred.
\\n\\n
3.3 The Corresponding Author shall obtain in writing all consents necessary for the reproduction of any material in which a third-party right exists, including quotations, photographs and illustrations, in all editions of the Article worldwide for the full term of the above licenses, and shall provide to IntechOpen upon request the original copies of such consents for inspection (at IntechOpen's option) or photocopies of such consents.
\\n\\n
The Corresponding Author shall obtain written informed consent for publication from people who might recognize themselves or be identified by others (e.g. from case reports or photographs).
\\n\\n
3.4 The Corresponding Author and any Co-Author shall respect confidentiality rights during and after the termination of this Agreement. The information contained in all correspondence and documents as part of the publishing activity between IntechOpen and the Corresponding Author and any Co-Author are confidential and are intended only for the recipient. The contents may not be disclosed publicly and are not intended for unauthorized use or distribution. Any use, disclosure, copying, or distribution is prohibited and may be unlawful.
\\n\\n
4. CORRESPONDING AUTHOR'S WARRANTY
\\n\\n
4.1 The Corresponding Author represents and warrants that the Article does not and will not breach any applicable law or the rights of any third party and, specifically, that the Article contains no matter that is defamatory or that infringes any literary or proprietary rights, intellectual property rights, or any rights of privacy. The Corresponding Author warrants and represents that: (i) the Article is the original work of themselves and any Co-Author and is not copied wholly or substantially from any other work or material or any other source; (ii) the Article has not been formally published in any other peer-reviewed journal or in a Journal or edited collection, and is not under consideration for any such publication; (iii) they themselves and any Co-Author are qualifying persons under section 154 of the Copyright, Designs and Patents Act 1988; (iv) they themselves and any Co-Author have not assigned and will not during the term of this Publication Agreement purport to assign any of the rights granted to IntechOpen under this Publication
\\n\\n
Agreement; and (v) the rights granted by this Publication Agreement are free from any security interest, option, mortgage, charge or lien.
\\n\\n
The Corresponding Author also warrants and represents that: (i) they have the full power to enter into this Publication Agreement on their own behalf and on behalf of each Co-Author; and (ii) they have the necessary rights and/or title in and to the Article to grant IntechOpen, on behalf of themselves and any Co-Author, the rights and licenses expressed to be granted in this Publication Agreement. If the Article was prepared jointly by the Corresponding Author and any Co-Author, the Corresponding Author warrants and represents that: (i) each Co-Author agrees to the submission, license and publication of the Article on the terms of this Publication Agreement; and (ii) they have the authority to enter into this Publication Agreement on behalf of and bind each Co-Author. The Corresponding Author shall: (i) ensure each Co-Author complies with all relevant provisions of this Publication Agreement, including those relating to confidentiality, performance and standards, as if a party to this Publication Agreement; and (ii) remain primarily liable for all acts and/or omissions of each such Co-Author.
\\n\\n
The Corresponding Author agrees to indemnify and hold IntechOpen harmless against all liabilities, costs, expenses, damages and losses and all reasonable legal costs and expenses suffered or incurred by IntechOpen arising out of or in connection with any breach of the aforementioned representations and warranties. This indemnity shall not cover IntechOpen to the extent that a cla