Open access peer-reviewed chapter

A Practical Way to ISO/GUM Measurement Uncertainty for Analytical Assays Including In-House Validation Data

Written By

Antonio Gustavo González, María Ángeles Herrador, Agustín García Asuero and Julia Martín

Submitted: 20 May 2017 Reviewed: 30 October 2017 Published: 20 December 2017

DOI: 10.5772/intechopen.72048

From the Edited Volume

Quality Control in Laboratory

Edited by Gaffar Sarwar Zaman

Chapter metrics overview

3,125 Chapter Downloads

View Full Metrics

Abstract

In this contribution, we outline the estimation of measurement uncertainty of analytical assays in a practical way, according to the so-called reconciliation paradigm, by considering the heritance of uncertainties according to the ISO Guide to the expression of uncertainty in measurement (ISO/GUM) approach and the accuracy (bias and precision) study coming from the in-house method validation. A cause and effect analysis is performed by using the Ishikawa diagram or fishbone plot, consisting of a hierarchical structure reaching a final outcome that is the analytical result. The procedure is illustrated with a case study. This procedure may be very suitable for processing data in accreditation of routine assays.

Keywords

  • ISO/GUM approach
  • method validation
  • uncertainty measurement

1. Introduction

The quality of analytical results is crucial because future decisions will be based on them. Uncertainty [1] is a good indicator of this quality. For example, two measurements made with the same ruler on different days by different people would be equivalent depending on their individual uncertainties.

Quality assurance measurements are a formal requirement in most of the analytical laboratories. As a consequence, to ensure that laboratories provide quality data, they are under continuous pressure to demonstrate their fitness for purpose, i.e., by giving confidence levels on the results. Measurement uncertainty will show the degree of agreement among results. This concept of measurement uncertainty will be applicable to many cases, besides of quality control and quality assurance in production, such as complying with and enforcing laws and regulations, conducting a basic research, calibrating standards and instruments or developing, maintaining, and comparing international and national physical reference standards.

The ISO Guide to the expression of uncertainty in measurement, also known as the ISO/GUM or “bottom-up” [1], is one of the best approaches to estimate the uncertainty of analytical procedures. This procedure, originally conceived for use in physical measurements, has been suitably adapted to chemical ones in the EURACHEM/CITAC (Cooperation on International Traceability in Analytical Chemistry) guide [2] “Traceability in Chemical Measurement.” However, this approach is tedious, time-consuming and unrealistic from the analytical viewpoint because their principles are significantly different from current procedures applied in analytical chemistry dealing with matrix effects, sampling operations and interferences [3, 4]. A strategy for reconciling the information requirements of ISO/GUM approach and the information coming from in-house method validation has been described by Ellison and Barwick [5]. The use of “cause” and “effect” analysis is the key for estimating the uncertainty of an analytical assay. In practice, this approach is performed by using a cause and effect diagram called Ishikawa or fishbone plot [6], consisting of a hierarchical structure that culminates in the “analytical result.” In order to carry out the cause and effect analysis, the specification equation for the result is of utmost importance. The factors appearing in the equation (that contribute to the uncertainty of the result) are the main branches of the fishbone plot. For each branch, secondary factors can be considered, and so on, until their contribution to the result uncertainty is negligible. Two additional main branches (Recovery and Precision) come from the method validation. Nevertheless, these approaches exhibit some risks. The blind consideration of uncertainties coming from different sources of variation may lead to “double counting” in some instances. The analysts have to clearly identify the relationships among the sources of uncertainty in order to avoid duplications. Also, some sources of uncertainty that can be evaluated in a unique set of experiments must be suitably combined.

The combined uncertainty of the analytical measurand is the heritance of the uncertainties of all contributing variables (xi) involved in the specification relationship where the value of measurand (Z) is defined as

Z=Fx1x2xnE1

Thus, the general expression for the combined uncertainty of measurand according to the law of propagation of uncertainty is given by

u2Z=i=1nFxi2u2xi+2i=1n1j=i+1nFxiFxjcovxixjE2

When the specification function consists of products or ratios only, and the factors are considered to be independent, then

uZZ2=i=1nuxixi2urel2Z=i=1nurel2xiE3

But this uncertainty does not consider the uncertainty contributions due to the intermediate precision of the assay and the trueness evaluated from recovery experiments. Nevertheless, it is possible to include these ones into the specification relationship either directly or by using unit-value factors fi=1±ufi which do not contribute to the measurand value, but do contribute to its uncertainty [7, 8]. Accordingly, the modified specification relationship turns to:

Z=Fx1x2xnRfprecE4

The new involved parameters are the recovery, R, and the intermediate precision of the assay, fprec. These contributions are issued from the data of method validation study. Accordingly, the uncertainty of measurand can be written as:

urel2Z=i=1nurel2xi+urel2R+RSDprec2E5

At this step, the considerations regarding to the sources of uncertainties have to be taken into account in order to avoid either under- or over-estimations of the result uncertainty.

The specification relationship involves a given set of parameters depending on the analytical procedure applied. Common factors are: mass determinations (obviously for sample weight and used standards), volumetric measurements (glassware and other devices delivering volume), analyte concentration coming from indirect calibration, and the precision and recovery of the analytical assay established in the validation study.

In the following, these factors will be outlined and their uncertainties will be discussed.

1.1. Uncertainty of sample mass

In a typical mass determination, the analytical balance is zeroed with the empty container on the pan, and the container is the filled and weighed. In this case, the uncertainty of mass measurements (without considering buoyancy) is given by [9]

um=Sr2+Senv2+23aL2+m2aT2ΔT29+uCAL2E6

where Sr2+Senv2 is the variance of replication (repeatability and environmental variances) expressed as an weighting intermediate precision, aL is the linearity specification of the balance, aT is the sensitivity temperature coefficient, ΔT is the difference between the room temperature and the calibration temperature (20°C) and ucal is the standard uncertainty for balance calibration.

Because the intermediate precision study is carried out for the entire analytical assay at the validation stage, individual contributions to the intermediate precision (here, weighting intermediate precision) cannot be taken into account for avoiding redundant counting of uncertainty. Thus, the uncertainty of mass will include the uncertainty contribution of lack of linearity of balance, the uncertainty due to temperature effect and the calibration uncertainty

um=23aL2+m2aT2ΔT29+uCAL2E7

1.2. Uncertainty of glassware volume

As R. Kadis pointed out [10], the evaluation of uncertainty of volumetric measurements consists of three kinds of contributions: specification limits for the glassware of a given class, repeatability of filling the glassware to the mark and temperature effects. Again, in order to avoid double counting and uncertainty redundancy, the precision of filling the flask is not considered here; thus, the uncertainty in the volume measurement is given by

uV=aTOL26+χ2V2ΔT23E8

where aTOL is the tolerance for a given class, χ is the dilatation coefficient for the filling liquid (2.1 × 10−4 K−1 for water), and ΔT as indicated earlier.

1.3. Uncertainty of concentration coming from calibration

Generally, in routine analysis, analytical determinations involve instrumental method where indirect calibration is applied. Common scenarios include external calibration, standard addition calibration (in case of matrix effects) and internal standard calibration (when intrinsic analytical signal variations appear or analyte losses may occur owing to sample preparation procedures [11]).

In case of linear calibration, the calibration straight line is established by preparing calibration standards. The primary stock standard solution is made by weighing the suitable mass of standard mstd, of a given purity P in the corresponding volume of solvent Vs

Cstd=mstdPVsE9

But this concentration has an uncertainty derived from the uncertainty in the weighting, in its purity and in the uncertainty of the glassware. The working standard solutions are prepared by diluting a volume Vi of the stock standard solution to a final volume Vf. So, the concentration of any calibration standard is given by

Ci=CstdViVf=mstdPViVsVfE10

and has an uncertainty that can be suitably calculated. However, when applying ordinary least-squares techniques (simple linear regression), three requisites have to be fulfilled [12]:

  • The independent variable x, is free from error εx=0 or at least, εx<<εY.

  • The error associated to Y variable, is normally distributed, N0σ2.

  • The variance of the Y variable, σ2, remains uniform in the whole range of x (homoscedasticity).

In our case, the independent variable is the concentration of standard Ci and the Y variable is the analytical signal. In a typical case of multipoint calibration (external or internal), the three requirements mentioned above applies, and the ordinary least-squares procedure gives the calibration straight line Ŷi=b0+b1Ci. The unknown analyte content is predicted from interpolation of the sample response signal Y0 according to

Ccal=Y0b0b1E11

whose uncertainty can be estimated from the variance propagation law:

u2Ccal=CcalY2u2Y0+Ccalb02u2b0+Ccalb12u2b1+2Ccalb0Ccalb1covb0b1=u2Y0b12+u2b0b12+Y0b02b14u2b1+Y0b0b13covb0b1=u2Y0b12+u2b0b12+Y0b02b14u2b1Y0b0b13C¯u2b1E12

where C¯=1NiNCi, N being the number of calibration points.

Eq. (10) can be rearranged to give the well-known formula recommended by EURACHEM [2]:

uCcal=sy/xb11m+1N+CcalC¯2i=1NCiC¯2E13

Here, sy/x is the residual standard deviation of the regression line, m is the number of replications measuring the sample signal and N the number of calibration points [13].

Aside from the calibration uncertainty, an additional uncertainty contribution can be considered from the preparation of standards as indicated in Eq. (8) and may be accounted separately in the uncertainty budget:

u2CiCi2=u2mstdmstd2+u2PP2+u2ViVi2+u2VsVs2+u2VfVf2E14

Thus, the uncertainty of concentration is given by the uncertainty on sample analyte concentration coming from calibration, and the uncertainty due to the preparation of standards.

1.4. Uncertainty of the analytical assay from the in-house data of method validation (precision and trueness)

Intralaboratory assessment of method accuracy encompasses both precision and trueness study.

As EURACHEM guide advices [2], “the precision should be estimated as far as possible over an extended period of time.” This may be accomplished by performing a between-day laboratory precision study. This precision study is carried out either by analyzing a typical sample, a quality control check sample or a validation standard [14] in “intermediate precision” conditions. Intermediate precision is the intralaboratory global precision under varied conditions as expected within a laboratory in a future assay. Accordingly, if a between-day precision study is carried out by spacing out the measurement days in such a way that the analysts, the apparatuses, glassware, stock solutions…really change, the precision estimation (from ANOVA) is a suitable “intermediate precision” estimation [14], leading to an evaluation of intermediate precision uncertainty, uIP.

Again, according to EURACHEM [2], the trueness (bias) study can be performed

  • by repeated analysis of a certified reference materials (CRM), using the complete measurement procedure;

  • by comparing the results of analyzed samples against a reference method; and

  • by applying recovery assays, using spiked placebos (validation standards) when available or spiked samples instead, and evaluating the recovery.

Thus, an estimation of the uncertainty of bias or recovery is calculated.

Both precision and trueness studies have to be carried out at least at three analyte concentration levels (low, medium and high) in order to cover the full range of analyte concentration indicated in the method scope.

In his excellent paper, Kadis [13] discussed the double counting risk in the uncertainty budget when calibration uncertainty is considered together with the precision uncertainty. The term sx/yb1m in Eq. 13 features the estimated precision of the analyte concentration in the calibration experiment. The estimated precision (from in-house validation) considers all the sources of variability, including calibration, therefore the contribution of sx/yb1m in the calibration uncertainty is redundant. Accordingly, the first term under the radical in Eq. (13) must be omitted to avoid double counting, or alternatively, the precision uncertainty can be omitted in the budget. Moreover, the recovery uncertainty includes the precision of the analyte mean value, which is used in the computation of recovery. Thus, some authors do not include the precision uncertainty together with the recovery uncertainty in the budget [13].

The use of cause and effect diagrams for designing the uncertainty budget including the in-house validation data is illustrated in the following worked example selected as case study.

Advertisement

2. Fluorimetric determination of quinine in tonic water

This working example has been prepared from the papers of O’Reilly [15] and González and Herrador [14], and deals with the determination of quinine in tonic water samples from fluorescence measurements. Solutions that contain quinine in acid medium (0.05 M sulfuric acid) show fluorescence with a maximum excitation wavelength at 350 nm and a maximum emission wavelength at 450 nm. The determination of quinine in tonic water samples is carried out according to the following procedure [16]: 1 mL of tonic water (previously degassed by 15 min sonication in an ultrasonic bath) was pipetted into a 100 mL volumetric flask and dilute to the mark with 0.05 M sulfuric acid. The fluorescence intensity of this solution is measured in a fluorescence spectrometer in 10 mm pathway quartz cells at 350 nm excitation wavelength and at 450 nm emission wavelength. The quinine concentration is interpolated in the corresponding calibration curve. All analytical operations were done at 20 ± 4°C.

The specification equation for estimating the quinine concentration (mg/L) in tonic water samples is given by

Z=CcalVV0RfprecE15

where Ccal is the value (mg/L of quinine) interpolated in the calibration curve from the measured fluorescence intensity of the assay, V is the volume of the assay (100 mL), V0 is the sample volume (1 mL), R is the recovery of the assay and fprec is the factor corresponding to the assay precision which has a value of 1, but an uncertainty equals to the precision standard deviation of the Z measurement. Recovery and precision data are taken from the in-house validation study of the method. The corresponding cause and effect Ishikawa diagram is depicted in Figure 1.

Figure 1.

Cause and effect diagram for the fluorimetric determination of quinine in tonic water.

According to the fishbone plot, the uncertainty budget is as follows:

urel2Z=urel2Ccal+i=15urel2Ci+urel2V+urel2V0+urel2R+RSDprec2E16

Now, each uncertainty contribution is studied and evaluated.

2.1. Uncertainty coming from calibration and standards

In order to establish the corresponding calibration curve, a stock solution of quinine was prepared by weighing 121.6 mg of quinine sulfate dihydrate with a minimum purity of 99% (or 99.5 ± 0.5%) and dissolving and diluting 0.05 M sulfuric acid to 1000 ml in a volumetric flask. The concentration of this stock solution corresponds to 100 mg/L of quinine base.

Six working standards solution covering from 0.2 to 1.2 mg/L quinine were prepared by pipetting 0.1, 0.2, 0.3, 0.4, 0.5 and 0.6 mL of the stock solution and diluting with 0.05 M sulfuric acid in a 50 mL volumetric flask, leading to concentrations of 0.2, 0.4, 0.6, 0.8, 1.0 and 1.2 mg/L quinine, respectively. The fluorescence intensity of each working standard at 350 nm excitation wavelength and at 450 nm emission wavelength was measured in triplicate. The results are shown in Table 1.

Working standard solution, mg/LFluorescence, AU
Trial 1Trial 2Trial 3
0.2171172171
0.4327328330
0.6484481481
0.8642640643
1.0800798799
1.2954958955

Table 1.

Fluorescence intensities (UA) for the five working standard solutions, measured in triplicate.

Fluorescence intensities show a linear behavior against the quinine concentration according to a calibration straight line with a correlation coefficient of about 0.999, and the following features:

b1=784.76,b0=13.67,sx/y=3.15,N=18,C¯=0.7,i=118CiC¯2=2.1

The corresponding calibration uncertainty assuming that the analytical signal is measured in triplicate (m = 3) from Eq. (11) is given by:

uCcal=4×10313+118+Ccal0.722.1E17

Uncertainty due to preparation of working calibration standards is computed from Eq. (12). The uncertainty of the standard mass can be evaluated according to Eq. (7). In our case, the balance specifications were: Linearity aL: 0.2 mg. Sensitivity temperature coefficient aT: 2.5 × 10−6 K−1. The calibration certificate indicates an expanded uncertainty of 8 × 10−4 g with a coverage factor, k = 2. Because the analytical operations are performed at 20° ± 4°C and ΔT = 4°. Thus, we have:

umstd=230.22+mstd22.5×1062429+0.42=0.187+1.11×1011mstd2;0.432mg

The uncertainty of purity is evaluated from the specification: 0.995 ± 0.005 and assuming a rectangular distribution. Thus, uP=0.0053=2.9×103. Uncertainty in volumes (from pipettes or volumetric flasks) are calculated from Eq. (8). The corresponding tolerances for glassware laboratory (Class A) are gathered in Table 2, except for the class A graduated pipette of 1 mL (for delivering volumes from 0.1 to 0.6 mL) which is ±0.006.

LevelTheoretical concentrationPredicted concentration
Day 1Day 2Day 3Day 4Day 5
16665.3366.8167.4465.7266.61
16665.3866.7967.4865.7066.36
16665.2266.7267.4865.8866.70
28384.4982.8382.6582.3083.74
28384.5382.7782.7082.5183.82
28384.6082.9282.5682.4883.65
3100100.25101.3699.9898.8499.60
3100100.20101.44100.0298.9399.77
3100100.32101.5099.8798.7599.82

Table 2.

Predicted concentration of the spiked placebos expressed in mg/L quinine.

In the case of working standards, Vi=0.1,0.2,0.3,0.4,0.5 and 0.6 mL for each working solution, Vs=1000mL and Vf=50mL. Accordingly, we get

uV1=0.00626+2.1×10420.12423=2.45×103uV2=0.00626+2.1×10420.22423=2.45×103uV3=0.00626+2.1×10420.32423=2.46×103uV4=0.00626+2.1×10420.42423=2.46×103uV5=0.00626+2.1×10420.52423=2.46×103uV6=0.00626+2.1×10420.62423=2.47×103uVs=0.326+2.1×104210002423=0.5uVf=0.0526+2.1×1042502423=0.0317

The total relative uncertainty of the working standards can be evaluated by avoiding multiple counting as follows:

urel2Ci=u2mstdmstd2+u2PP2+i=16u2ViVi2+u2VsVs2+u2VfVf2=0.4322121.62+2.9×10320.9952+2.45×10320.12+2.45×10320.22+2.46×10320.32+2.46×10320.42+2.47×10320.522.47×10320.62+0.5210002+0.03172502=9.18×104E18

2.2. Uncertainty of assay and sample volumes

The uncertainties of the assay and sample volume are also estimated from Eq. (8) and tolerances of Table 2:

uV=0.0826+2.1×10421002423=0.058urel2V=0.05821002=3.36×107uV0=0.00626+2.1×104212423=2.5×103urel2V0=2.5×103212=6.25×106E19

2.3. Uncertainty of precision and trueness from in-house validation

The study of precision (intermediate precision) and trueness (recovery of assay) for the fluorimetric determination of quinine in tonic water was performed by using validation standards (spiked placebos) as indicated by González and Herrador [16]. Validation standards of quinine in tonic water matrix were prepared at low (66 mg/L), medium (83 mg/L) and high level (100 mg/L), covering the whole range of analyte concentrations (from 80 to 120% of 83 mg/L of quinine that is the recommended value of quinine in tonic waters by the FAD [17]). Both precision and trueness study was performed by predicting the actual concentrations of the three spiked placebos according to the recommended fluorimetric procedure for quinine determination. Measurements were made on 5 days for each validation standard with three replications of the assay. The results obtained are presented in Table 3.

Class A glassware.Capacity, mLTolerance, mL
Burette50± 0.05
25± 0.03
10± 0.02
Pipette40–50±0.05
15–30±0.03
8–10±0.02
3–7± 0.01
1–2±0.006
Volumetric flask1000±0.3
500±0.15
100±0.08
50±0.05
25±0.03

Table 3.

Tolerances for class A laboratory glassware.

The best way to estimate both the uncertainty contribution of intermediate precision and the recovery (or bias) of the analytical assay when validation standards are available, is using ANOVA at a given concentration of the validation standard, namely T, considering p different conditions (5 days in this case) and n replications (3 days in this case). From the ANOVA results (within conditions variance, SW2, between conditions variance, SB2, and total mean, x¯¯), the values of variance due to the condition (here, days), Scondition2, the variance of repeatability, Sr2, the variance of intermediate precision, SIP2 as well as the bias and recovery together with their uncertainties can be easily computed [14, 18]:

Scondition2=SB2SW2n;Sr2=SW2;SIP2=Sr2+Scondition2;RSDIP2=SIP2x¯¯2R=x¯¯T;u2R=SIP2n1nSr2pT2;urel2R=SIP2n1nSr2px¯¯2E20

Thus, values of RSDIP2 and urel2R are obtained for each spiked placebo. These data are presented in Table 4. A significance test has been used to evaluate if the recovery is significantly different from unity for each spiked placebo:

t=1RuR
Nominal concentration (T, mg/L quinine)x¯¯RSDIP2Rurel2R
6666.381.65×1041.00573.28×105
8383.241.13×1041.00292.25×105
100100.048.87×1051.00041.77×105

Table 4.

Relative precision and uncertainty of recovery for the three validation standards in the fluorimetric determination of quinine in tonic water.

This value is then compared with the two-tailed critical value of tabulated Student-t statistic for np-1 degrees of freedom (14 in our case) at a 95% confidence level tcrit1495%=2.145. For the three studied validation standards, recoveries were significantly equal to unity, and we can set R=1 in all cases.

As can be seen in Eq. (20), the value of RSDIP2 contains urel2R and accordingly, as it was indicated above, we can neglect the contribution urel2R in the uncertainty budget. The value of relative precision for the determined quinine concentration is taken as RSDprec2=RSDIP2m (here, m = 3).

Now, all contributions of specification factors have been included in the budget. Consider now that a sample of tonic water (Schweppes) has been analyzed by following the recommended procedure. The response is measured in triplicate (m = 3), leading to a fluorescence intensity (AU) of 617.5, 618.1 and 616.7. The mean value is Y0=617.43 that corresponds to a quinine concentration of the assay of Ccal=617.4313.67784.76=0.76936. Accordingly, the value of calibration uncertainty from Eq. (17), but neglecting the radical term 1/3 in order to avoid double counting, gives uCcal=103 and urel2Ccal=1.7×106. The concentration of quinine in the sample according Eq. (15) with R=1 and fprec=1 is Z = 76.936 ppm. We can interpolate this value in Table 4 in order to estimate the corresponding RSDIP2=1.31×104 that leads to RSDprec2=1.31×1043=4.38×105. Then, by applying Eq. (16), disregarding the recovery contribution, we get

urel2Z=urel2Ccal+urel2Ci+urel2V+urel2V0+RSDprec2=1.7×106+9.18×104+3.37×107+6.25×106+4.38×105=0.00097

Thus, urelZ=0.03115 and uZ=76.936×0.03115=2.396. By assuming a Gaussian coverage factor of 95% confidence k = 2, the expanded uncertainty is UZ=4.792 and the quinine concentration of Schweppes tonic water sample is Z=77±5ppm.

Advertisement

3. Selected applications in tabular form

A more detailed picture of most recent selected papers about the “Guide to the Expression of Uncertainty in Measurement” is depicted in Table 5, giving an idea of the importance and relevance of the topic in different fields. Emphasis is stressed on reviews and taking into account the high number of references available, the authors apologize for those they may have overlooked or inadvertently omitted. Selected applications about the estimation of uncertainty in volumetric glassware, analytical balance and calibration curves, as well as the evaluation of the measurement uncertainty in classical and instrumental techniques are shown in Tables 6 and 7. Figure 2 shows the number of publications cited per year, whereas in Figure 3, the number of paper cited by journal for the most cited journals appears.

ContentAuthorsRef.
General overview about concepts, models, methods, and computations that are commonly used for the evaluation of measurement uncertainty, and their application in realistic examples drawn from multiple areas of science and technology.Possolo and Iyer, 2017[19]
A complete procedure to encompass an uncorrected bias into the expanded uncertainty with a fixed coverage probability.Synek, 2017[20]
Reported scientific uncertainties by analyzing 41,000 measurements of 3200 quantities from medicine, nuclear and particle physics, and interlaboratory comparisons ranging from chemistry to toxicology.Bailey, 2016[21]
The GUM revision: the Bayesian view toward the expression of measurement uncertainty.Lira, 2016[22]
Comparing methods for evaluating measurement uncertainty given in the Joint Committee for Guides in Metrology ‘Evaluation of Measurement Data’ documents.Stant et al., 2016[23]
In pursuit of a fit-for-purpose uncertainty guide: the move away from a frequentist treatment of measurement error to a Bayesian treatment of states of knowledge is misguided.White, 2016[24]
Three controversies faced in the development of GUM document: (i) the acceptance of the existence of ‘true values’, (ii) the association of variances with systematic influences and (iii) the representation of fixed but unknown quantities by probability distributions.Willink, 2016[25]
A new way to express uncertainty of measurement is proposed that allows for the fact that the distribution of values attributed to the measurand is sometimes approximately lognormal and therefore asymmetric around the measurement value.Ramsey and Ellison, 2015[26]
Revision of the GUM: reasons why the Guide needed a revision, and why that revision could not go in a direction different from the one that it has been taken.Bich, 2014[27]
Validating the applicability of the GUM procedure.Cox and Harris, 2014[28]
Evolution in thinking and its impact on the terminology that accompanied the development of the GUMEhrlich, 2014[29]
The developments in uncertainty concepts and practices that led to the third edition of the Eurachem Guide on uncertainty evaluation.Ellison, 2014[30]
A review of monte carlo simulation using microsoft excel for the calculation of uncertainties through functional relationships, including uncertainties in empirically derived constants.Farrance and Frenkel, 2014[31]
Evaluation of mass measurements in accordance with the GUM. The importance of reporting calibration results in a compact way that is easily propagated down the traceability chain is also discussed.Nielsen, 2014[32]
Overview about statistical models and computation to evaluate measurement uncertainty.Possolo, 2014[33]
Discussion about recent situation in measurement science, and how to obtain a reliable measurement result using the expression of metrological traceability together with measurement uncertainty.Imai,2013[34]
A new strategy for the analytical validation based on the uncertainty profile as a graphical decision-making tool, and to exemplify a novel method to estimate the measurement uncertainty.Saffaj et al., 2013[35]
Monte Carlo approach for estimating measurement uncertainty using standard spreadsheet software.Chew et al., 2012[36]
General overview of the GUM and to show how the calculation of uncertainty in the measurand may be achieved through a functional relationship.Farrance and Frenkel, 2012[37]
Estimation of the measurement uncertainty in quantitative determination of ketamine and norketamine in urine using a one-point calibration method.Ma et al., 2012[38]
EURACHEM/CITAC workshop on recent developments in measurement uncertainty. Contains a selection of the contributed papers at this workshop and show how the evaluation of uncertainty is now being applied to a wide range of analyses.Williams, 2012[39]
Highlight some of the differences between the two concepts of total error and uncertainty but also to stress their main similarities.Rozet et al., 2011[40]
The assurance as a result of blood chemical analysis by ISO-GUM and Quality Engineering.Iwaki, 2010[41]
Managing quality vs. measuring uncertainty in the medical laboratory. The paper argues that total error provides a practical top-down estimate of measurement uncertainty in the laboratory, and that the ISO/GUM model should be primarily directed to and applied by manufacturers.Westward, 2010[42]
Comparison of the approach to measure uncertainties proposed in ISO 5725 and GUM from a statistician point of view.Deldossi and Zappa, 2009[43]
Utilizing the correlations between the N individual results, an equation is derived to combine the N individual uncertainties of N measurements. Using the newly derived equation including the correlation coefficient, three measurement uncertainties of three measurement results are combined as an example.Nam et al., 2009[44]
From GUM to alternative methods for measurement uncertainty evaluation.Priel, 2009[45]
Critical debate about the revision of the Guide to the expression of uncertainty in measurement.Bich, 2008[46]
Course aimed at developing understanding of measurement and uncertainty in the introductory physics laboratory. The course materials, in the form of a student workbook, are based on the probabilistic framework for measurement as recommended by the International Organization for Standardization in their publication GUM.Buffler et al., 2008[47]
Scientific discussion about measurement uncertainty and chemical analysis.Kadis, 2008[48]
Treatment of uncorrected measurement bias in uncertainty estimation for chemical measurements.Magnusson and Ellison, 2008[49]
A critical overview of the current doubtful practice on presentation of correlated data in the physics literature and in the scientific and technological databases.Ezhela, 2007[50]
A detailed step-by-step guide to analytical method validation, considering the most relevant procedures for checking the quality parameters of analytical methods.González and Herrador, 2007[9]
Development of the concept of uncertainty in measurement and the methods for its quantification from the classical error analysis to the modern approaches based on the GUM.Kacher et al., 2007[51]
Measurement uncertainty: top-down and bottom-up approach, tools for its determination uncertainty sources and practical examples.Meyer, 2007[52]
Critical review about calibration-, uncertainty-, and recovery-related documents from 10 consensus-based organizations.Vanatta and Coleman, 2007[53]
Evolution of the GUM: documents relating to the GUM planned by Joint Committee for Guides in Metrology.Bich et al., 2006[54]
Calculating uncertainty of measurement for serology assays by use of precision and bias.Dimech et al., 2006[55]
Comparison of ISO-GUM, draft GUM Supplement 1 and Bayesian statistics using simple linear calibration.Kacher et al., 2006[56]
Estimation of the measurement uncertainty of analytical assays based on the LGC/VAM protocol from validation data in the light of the study of precision, trueness and robustness.González et al., 2005[57]
Philosophy behind the GUM, and demonstrates, with a medical physics measurement example of how the GUM recommends uncertainties be calculated and reported.Gregory et al., 2005[58]
The limitations of the GUM for evaluating the uncertainty of indirect measurements. The propagation of distributions as the best way to evaluate the measurement. Uncertainty and the use of Monte-Carlo method for performing the propagation of distributions is outlined and discussed.Herrador et al., 2005[59]
Comparison of six commercial programs devoted to the estimation of measurement uncertainty for feasibility in order to be applied in routine chemical analysis.Jurado and Alcázar, 2005[60]
Treatment of bias in estimating measurement uncertainty.O’Donnell and Hibbert, 2005[61]
Statistical analysis of Consultative Committees of the International Committee of Weights and Measures (CIPM) key comparisons based on the ISO Guide.Kacker et al., 2004[62]
General overview of the uncertainty of measurement concept, with minimal metrological terminology, and also practical guidelines to assist pathology laboratories comply with this accreditation requirement.White and Farrance, 2004[63]
Approach to determine the overall uncertainty by combining the uncertainties of the individual results when the difference is statistically significant by GUM.Choi et al., 2003[64]
An appraisal on the guide to expression of uncertainty in measurement approach for estimating uncertainty.Kristiansen, 2003[65]
Critique of the Guide to the expression of uncertainty in measurement method of estimating and reporting uncertainty in diagnostic assays.Krouwer, 2003[66]
Effect of non-significant proportional bias in the final measurement uncertainty.Maroto et al., 2003[67]
Background of the GUM. The knowledge of the respective measurement and other fundamental aspects which have been included in the EA-4/02 requirements document published by the European co-operation for accreditation.Kessel, 2002[68]
Operational definitions of uncertainty taking into account the differences in the ways in which truth, uncertainty and error are conceived.Hund et al., 2001[69]
Approaches to the evaluation of uncertainties associated with recoveryBarwick and Ellison, 1999[70]
Review of the concepts and practices of data quality in analytical chemistry in relation to uncertainty. It is addressed primarily to the bodies that will be responsible for the introduction of uncertainty into routine practice.AMC, 1995[71]
Future trends in analytical quality assurance, the evaluation of the quality of analytical results by estimation of their uncertainties. The present state-of-the-art is described, and the impact caused by the declaration of uncertainties in chemical results is foreseen.Cortez, 1995[72]
Critical reflexion about the uncertainty concept and its method for estimation.Thompson, 1995[73]
Guidelines for evaluating and expressing the uncertainty of NIST measurement results.Taylor and Kuyatt, 1994[74]

Table 5.

Selected papers about the “Guide to the Expression of Uncertainty in Measurement (GUM)”.

ContentReferenceRef.
Volumetric glassware
Uncertainty on using graduated volumetric glassware for the concentration of samples (concentration tube) and its effect on measurement accuracy.Matsuda et al., 2015[75]
Experimental study on evaluation of uncertainty in volumetric measurement: pipettes, graduated pipettes, graduated burettes, volumetric flasks and micropipettes used in various analytical and biological studies.Mukund et al., 2015[76]
Influencing factors in uncertainty measurement that affect mass and volume determination. Technical specification of an analytical balance such as: readability, repeatability, linearity, off-center loading and hysteresis and for volumetric glassware: repeatability, readability, temperature coefficient of sensitivity, temperature scattering, meniscus reading and environmental conditions (temperature and humidity) are considered.Rahman et al., 2015[77]
Analysis of the results obtained in the calibration of electronic analytical balances.Valcu and Baicu, 2012[78]
Influence quantities for the uncertainty of a volumetric operation with glass instruments: Calibration, handling repeatability, and the maximum permissible error.Meyer et al., 2010[79]
Comparison of two different approaches in the uncertainty calculation of gravimetric volume calibration: mainstream GUM and Monte Carlo method.Batista et al., 2009[80]
Ranking of the contributions to the uncertainty of titrimetric results.Wampfler and Rösslein, 2009[81]
Volume calibration of 1000 μl micropipettes. Inter-laboratory comparison between six national metrology institutes.Batista et al., 2008[82]
Primer on weighing uncertainties in radionuclidic metrology.Collé, 2008[83]
Measurement and uncertainty evaluation of nanofluid particle concentration using volumetric flask method.Kostic et al., 2006[84]
Detailed analysis of relevant uncertainty sources with two different procedures for evaluating the uncertainty identified: one of them relies on the prescribed tolerance while the other is based on the experimental estimation of the actual performance in the user’s hand. The uncertainty budget for each of these two approaches is evaluated, analyzed and illustrated with a numerical example.Kadis, 2004[85]
Sources for both the gravimetric and spectrophotometric pipette calibration methods.Clark and Shull, 2003[86]
Sampling variance of ultra-dilute solutions.Efstathiou, 2000[87]
Experimental study using gravimetry in order to measure the variances observed in aliquot volumes delivered by graduated burettes operating with various flow-rates and surface tensions and with the burette tip immersed and not immersed in the receiving liquid.Schwartz, 1990[88]
Statistical methodology required for rigorous calibration of devices that are designed to deliver a fixed aliquot volume without having to read volume graduations lines.Schwartz, 1989[89]
Minimizing relative error in the preparation of standard solutions by judicious choice of volumetric glassware.Lam and Isenhour, 1980[90]
Practical guide to estimates of uncertainty of the calibration of balances.Anonymous[91]
Analytical balance
Calculating measurement uncertainty of the “conventional value of the result of weighing in air”.Flicker and Tran, 2016[92]
Weighing uncertainties in quantitative source preparation for radionuclide metrology.Lourenço and Bobin, 2015[93]
Influencing factors in uncertainty measurement that affect mass and volume determination. Technical specification of an analytical balance: readability, repeatability, linearity, off-center loading and hysteresis and for volumetric glassware: repeatability, readability, temperature coefficient of sensitivity, temperature scattering, meniscus reading and environmental conditions (temperature and humidity).Rahman et al., 2015[77]
Procedure for evaluating the uncertainty of mass measurements when using electronic balances based on the internal quality-control routine, the calibration process, the specification data sheet, and the considered weighing scenario.González and Herrador, 2007[9]
Influence factors that affect in uncertainty measurement of a mass determination. Technical specifications of a balance: Readability, repeatability, non-linearity, sensitivity tolerance, temperature coefficient of sensitivity and effects of environmental factors such as: air humidity, air pressure and air buoyancy.Salahinejad and Aflaki, 2007[94]
The influence of atmospheric pressure, air temperature, and relative air humidity on weighing results was determined in a long-term experiment.Pozivil et al., 2006[95]
The uncertainty evaluation of mass measurements when using “in-house” calibrated analytical balances is revisited according to the GUM.González et al., 2005[96]
Good practice guide is intended as a useful reference for those involved in the practical measurement of mass and weight.Davidson et al., 2004[97]
Influence factors which are part of the combined measurement uncertainty of a mass determination and their interplay, namely the technical specifications of the balance (repeatability, nonlinearity, sensitivity tolerance, and temperature coefficient of the sensitivity) and the effect of air buoyancy.Reichmuth et al., 2004[98]
A new method to correct for the largest systematic influence in mass determination – air buoyancy. Full description of the most relevant influence parameters and the combined measurement uncertainty is evaluated according to the ISO–GUM approach.Wunderli et al., 2003[99]
Evaluation of methods for estimating the uncertainty of electronic balance measurements. Terminology used to describe measurement quality, i.e., “accuracy,” “precision,” “linearity,” “hysteresis,” “measurement uncertainty” (MU), and the various contributors to MU, and will discuss the advantages and limitations of various methods for estimating MU.Clark and Shull, 2001[100]
The influence of variations in atmospheric pressure on the uncertainty budget of weighing results.Kehl et al., 2000[101]
Comprehensive mass metrology: A survey of the current problems surrounding mass determination that is comprehensive but does not purport to be complete.Kochsiek and Gläser, 2000[102]
Calibration curve
Common mistakes in evaluating the uncertainty when pursuing that strategy, as revealed in current chromatographic literature.Kadis, 2017[13]
The quality coefficient as performance assessment parameter of straight line calibration curves in relationship with the number of calibration points.de Beer et al., 2012[103]
Comparison in the evaluation of measurement uncertainty in analytical chemistry testing between the use of quality control data and a regression analysis.Sousa et al., 2012[104]
Application of various methodologies concerning the estimation of the standard uncertainty of a calibration curve used for the determination of sulfur mass concentration in fuels.Theodorou et al., 2012[105]
The evaluation of uncertainty for linear calibration curves generation in analytical laboratories.Nezhikhovskiy et al., 2006[106]
Uncertainty functions: a way of summarizing or specifying the behavior of analytical systems.Thompson, 2011[107]
Calibration in atomic spectrometry: a tutorial review dealing with quality criteria, weighting procedures and possible curvatures.Mermer, 2010[108]
Critical review on the usual procedures for testing the accuracy of analytical methods.Kemény et al., 2009[109]
Three different techniques for fitting straight lines to experimental data and evaluation of uncertainty: (i) traditional fitting by least-squares, (ii) a Bayesian linear-regression analysis and (iii) an analysis according to the propagation of probability density functions attributed to the points measured.Willink, 2008[110]
New method for propagating uncertainty, based on interpolation theory, to solve the problem in linear interpolating equations. The method is extended to nonlinear equations, and to over-determined linear or nonlinear equations fitted by least-squares methods.White and Saunders, 2007[111]
Propous theory to calculate the confidence intervals of calibration lines in the above situations. Analyses made up of sample weighing, dilution, High Performance Liquid Chromatography measurement and calibration with the linear least-squares fitting are taken as examples.Hayashi and Matsuda, 2006[112]
Commonly used expression for the standard error of a result obtained from a straight line calibration is extended to a quadratic calibration, and the case where weighted regression is necessary.Hibbert, 2006[113]
The use of Crystal-Ball is illustrated with two working examples dealing with specification models of non-linear features and with correlated variables (such as the slope and intercept of calibration straight lines).González et al., 2005[114, 115]
Introduction of a novel approach on actual calibration data for the determination of Pb by inductively coupled plasma-atomic emission spectroscopy. The improved calibration uncertainty was verified from independent measurements of the same sample by demonstrating statistical control of analytical results and the absence of bias.Heydorn and Anglov, 2002[116]
Evaluation of measurement uncertainty for analytical procedures
using a linear calibration function: the uncertainty deduced from repeated observations of the sample vs. the uncertainty deduced from the standard residual deviation of the regression.
Brüggemann and Wennrich, 2002[117]
Evaluation of the most conflicting points concerning linear regression. Confidence bands and a discussion about the use of a line through the origin are also included. In addition, the simplest expressions for expressing parameters to the appropriate significant figures from built-in calculator programs are also provided.Giordano, 1999[118]
Strategy for the validation of the calibration procedure in atomic absorption spectrometry. In order to accomplish this, the suitability of different experimental designs and statistical tests, to trace outliers, to examine the behavior of the variance and to detect a lack-of-fit, was evaluated. Parametric as well as randomization tests were considered.Penninckx et al., 1996[119]
The “precision pattern space” is introduced in order to find the general expression for the law of random error propagation. A new approach to the determination of the optimum working range in spectrophotometric procedures has been developed. The method involves the use of the calibration curve and the application of the Laplacian operator to concentration.Asuero et al., 1988[120]

Table 6.

Selected papers about the estimation of uncertainty in volumetric glassware, analytical balance and calibration curves.

ContentReferenceRef.
Gravimetry
Evaluation of purity with its uncertainty value in high purity lead stick by conventional and electro-gravimetric methods.Singh et al., 2013[121]
The determination of barium by the gravimetric method, in which the precipitation of BaSO4 was formed and weighed, coupled with instrumental measurement of trace constituents was studied. Sources of uncertainty were assessed thoroughly.Li et al., 2002[122]
Titrimetry
Measurement procedure for precisely determining hypochlorite in commercial bleaches, with established traceability and full description of its uncertainty using automatic potentiometric titration.Barbieri Gonzaga and Rodrigues Cordeiro, 2014[123]
Calculation of measurement uncertainty in the determination of the concentration of a freshly prepared solution of sodium hydroxide using potassium hydrogen phthalate as the primary standard.Mettler Toledo, 2014[124]
Evaluation of measurement uncertainty components associated with the results of complexometric determination of calcium in ceramic raw materials using EDTA.Basak and Kundu, 2013[125]
Target measurement uncertainty as a tool for validation of uncertainties estimated by different approaches: determination of total hardness in drinking and natural waters.Calisto et al., 2013[126]
An easy uncertainty evaluation of the chemical oxygen demand titrimetric analysis in correlation with quality control and validation data.Amanatidou et al., 2012[127]
Uncertainty estimation in measurement of pKa values in nonaqueous media: a case study on basicity scale in acetonitrile medium.Sooväli et al., 2006[128]
Uncertainty of chemical oxygen demand determination in wastewater samples. The major sources of uncertainty of the result of measurement were identified as the purity of reagents, volumetric operations, gravimetric operations, bias, and the repeatability of the method.Drolc et al., 2003[129]
Analytical procedure for the determination of the concentration of hydrochloric acid by titration against a standardized sodium hydroxide solution. The expanded uncertainty of the final result is expressed, endeavoring, in particular to evaluate covariances and to take into account the chemical behavior of the specific reagent.Pueyo and Vilalta, 1996[130]
Potentiometry: Ion Selective Electrode
Uncertainty evaluation in the chloroquine phosphate potentiometric titration: Application of three different approaches: The famous error-budget approach, the analytical method committee top-down and the last method chosen was the one proposed by Barwick and Ellison.Rodomonte et al., 2006[131]
Procedure to estimate the uncertainty of measurement applied to the fluoride determination of waters and wastewaters matrices by selective electrode potentiometry based on Eurachem Guide. The major sources of uncertainty were identified as the calibration standard solutions, fluoride concentration obtained by potential interpolation of the regression line and the precision.Sousa and Trancoso, 2005[132]
Estimation of uncertainty in measurement of the pKa of a weak acid by potentiometric titration. The procedure is based on the ISO GUM.Koort et al., 2004[133]
Amperometry
Tutorial review on measurement uncertainty estimation in amperometric sensors.Helm et al., 2010[134]
Electron probe microanalysis
Case study of ISO GUM-based estimation of measurement uncertainty of quantitative surface elemental analysis by electron probe microanalysis.Virro et al., 2008[135]
Ultraviolet Spectrophotometry
Procedure to estimate measurement uncertainty of a validated UV spectrophotometric method for quantification of desloratadine in tablet formulation.Takano et al., 2017[136]
Uncertainty in spectrophotometric analysis – “Error propagation break up”, a novel statistical method for uncertainty management. For the assessment of the computations, different approaches are discussed, such as the contribution to the Combined Standard Uncertainty of the reproducibility, the repeatability, the total bias, the calibration curve, and the type of the measurand.Amanatidou et al., 2011[137]
Eevaluation of the uncertainty and metrological reliability of material concentration measurement considering sample preparation and chemical–physical transformation of spectrometric analysis.Dobiliene et al., 2010[138]
Uncertainty in modern spectrophotometers: An up-to-date view of UV–vis molecular absorption instruments and measurements.Galbán et al., 2007[139]
Overview of the most important uncertainty sources that affect analytical UV–Vis spectrophotometric measurements. Altogether, eight uncertainty sources are discussed that are expected to have influence in chemical analysis.Sooväli et al., 2006[128]
Procedure for estimation of measurement uncertainty of photometric analyis based on the ISO GUM method. Two variations of the procedure, for the calibration graph and the standard addition method, are discussed.Traks et al., 2005[140]
Evaluation of the uncertainty of measurement in the determination of manganese by spectrophotometric analysis. The standard uncertainty is evaluated for each input quantity. These are then appropriately combined to get the combined uncertainty of measurement.Ramachandran and Rashmi, 1999[141]
X-Ray Fluorescence Spectrometry
Evaluation of uncertainty in the energy dispersive X-ray fluorescence determination of platinum in alumina.Remya Devi et al., 2015[142]
Uncertainty measurement evaluation of wavelength dispersive and energy dispersive X-ray fluorescence techniques for the Si and Utotal determination in U3Si2 nuclear fuel.Scapin et al., 2011[143]
Uncertainty calculations for the measurement of in vivo bone lead by X-ray fluorescenceO’Meara and Fleming, 2009[144]
Effect of the sample matrix on measurement uncertainty in X-ray fluorescence analysis.Morgenstern et al., 2005[145]
Atomic Absorption Spectrometry
Determination and uncertainty analysis of inorganic arsenic in husked rice by solid phase extraction and atomic absorption spectrometry with hydride generation.Saxena et al., 2017[146]
Optimization and measurement uncertainty estimation of hydride generation–cryogenic trapping–gas chromatography–cold vapor atomic fluorescence spectrometry for the determination of methylmercury in seawater.Živković et al., 2017[147]
Approach for the estimate of the uncertainty in measurement considering the individual sources related to the different steps of the method under evaluation as well as the uncertainties estimated from the validation data for the determination of mercury in seafood by using thermal decomposition/amalgamation atomic absorption spectrometry.Torres et al., 2015[148]
Methodology of evaluating the uncertainty of measurement of chemical composition using atomic absorption spectrometry.Mahajan et al., 2012[149]
Comparison of ISO-GUM and Monte Carlo methods for the evaluation of measurement uncertainty: Application to direct cadmium measurement in water by graphite furnace atomic absorption spectrometry.Theodorou et al., 2011[150]
Evaluation of measurement uncertainties for the determination of total metal content in soils by atomic absorption spectrometry.Alves et al., 2009[151]
Uncertainty statement of a mercury speciation analytical method using the relationships fixed by GUM (Guide to the Expression of Uncertainty in Measurement).Jokai and Fodor, 2009[152]
UV–Vis spectrophotometric and flame atomic absorption spectrometric analysis for iron determination in a pharmaceutical product were compared in terms of uncertainty budgets.Jürgens et al., 2007[153]
How to validate the calibration function is dealt with in detail using as an example based on measurements obtained for nickel determination by flame atomic absorption spectrometry. Assessing uncertainties related to linear calibration curves is also discussed.Chui, 2007[154]
Three approaches are compared for the evaluation of the combined uncertainty in the determination of mercury in aquatic sediments by an aqua regia extraction procedure.Guevara-Riba et al., 2006[155]
Full validation of a cold vapor atomic absorption spectrometry method for mercury determination in fishery products.Haouet et al., 2006[156]
Uncertainty of atomic absorption spectrometer.Hirano et al., 2005[157]
Estimate of uncertainty of measurement from a single-laboratory validation study: application to the determination of lead in blood.Patriarca et al., 2004[158]
Total uncertainty budget calculation for the determination of mercury in incineration ash (BCR 176R) by atomic fluorescence spectrometry.Tirez et al., 2002[159]
Uncertainty of measurement of the analysis of lead in blood by graphite furnace atomic absorption spectrometry calibrating with a commercial available standard.O ‘Donnell, 2000[160]
The major sources of uncertainty of a method for determination of Pb in whole blood by atomic absorption spectrometry. The combined uncertainty was compared to the experimentally determined variation and a satisfactory agreement was found, indicating that no significant sources of uncertainty have been overlooked and that the method is in a state of statistical control.Kristiansen et al., 1996[161]
Nuclear Magnetic Resonance Spectroscopy
Uncertainty budget for the results of measurements of purity of the agrochemical glyphosate using 1H and 31P quantitative nuclear magnetic resonance spectroscopy. The budget combines intralaboratory precision from repeated independent measurements of a batch, and other Type A and Type B effects.Al-Deen et al., 2004[162]
Inductively Coupled Plasma
Results of prominent technologies of inductively coupled plasma mass spectrometry, for determination of chloride-isotope ratios (35Cl/37Cl) and inductively coupled plasma optical emission spectrometry for determination of sodium, were evaluated in terms of the true level of uncertainty and revealed a genuine problem for science that was not addressed in VIM3 and QUAM.Andersen et al., 2016[163]
Application of the GUM approach to estimate the measurement results uncertainty for the quantitative determination of Al, Ba, Fe, Mg, Mn, Pb, Sr. and Zn from document paper samples using Inductively Coupled Plasma Mass Spectrometer. The measurement uncertainty estimation was done based on identifying, quantifying and combining all the associated sources of uncertainty separately.Tanase et al., 2015[164]
Development, validation, and evaluation of measurement uncertainty of a method for quantitative determination of essential and nonessential elements in medicinal plants and their aqueous extracts by using inductively coupled plasma optical emission spectrometry.Senila et al., 2014[165]
Uncertainty budget for multi-elemental analysis of plant nutrients in conifer foliar material using inductively coupled plasma atomic emission spectrometry.Ohlsson, 2012[166]
Method for simultaneous inductively coupled plasma mass spectrometer determination of 13 elements in three types of honey from Poland. The method was validated, and the uncertainty budget was set up.Chudzinska et al., 2012[167]
Evaluation of the combined measurement uncertainty in isotope dilution by a multi-collector inductively coupled plasma mass spectrometer and the use of high-purity reference materials.Fortunato and Wunderli, 2003[168]
Validation of the determination of lead in whole blood by inductively coupled plasma mass spectrometer. Uncertainty of the centroid of the calibration graph was preferred to the evaluation of the linearity with ANOVA to validate the calibration procedure.Bonnefoy et al., 2002[169]
The measurement uncertainty associated with the determination of Ni in aqueous samples by inductively coupled plasma mass spectrometer has been calculated using a cause-and-effect approach. A cause-and-effect diagram was constructed to aid in the identification of the sources of uncertainty associated with the method.Barwick et al., 1999[170]
Mass spectrometry
The application of the GUM to calculate standard uncertainties for routine uranium isotope mass spectrometry measurements for nuclear safeguards and nuclear metrology.Bürguer et al., 2010[171]
Chromatography
Study to estimate a reasonable uncertainty for the measurement of the identified measurand, which is the mass concentration of ethanol, methanol, acetone, and isopropanol determined through dual capillary column headspace gas chromatograph (GC): GC calibration adjustment slope, GC analytical, and certified reference material.Hwang et al., 2017[172]
Development, validation and different approaches for the measurement uncertainty of a multi-class veterinary drugs residues liquid chromatography-mass spectrometry method for feeds.Valese et al., 2017[173]
Critical challenges regarding the validation of a quantitative multi-residue method for pharmaceuticals in wastewater making use of modern solid phase extraction-liquid chromatography-orbitrap high-resolution mass spectrometry. Particular attention is given to study in detail response linearity, to realistically estimate detection limits, and to express the measurement precision of the analyte concentration, obtained by external calibration.Vergeynst et al., 2017[174]
Validation and uncertainties evaluation of an isotope dilution-solid phase extraction-liquid chromatography–tandem mass spectrometry for the quantification of drug residues in surface waters.Brieudes et al., 2016[175]
Rapid determination of residues of pesticides in honey by gas chromatography–electron capture detector and gas chromatography–tandem mass spectrometry: Method validation and estimation of measurement uncertainty according to document No. SANCO/12571/2013.Paoloni et al., 2016[176]
A fast and simple liquid chromatography–tandem mass spectrometry method for detecting pyrrolizidine alkaloids in honey with full validation and measurement uncertainty.Valese et al., 2016[177]
Comparison of different methods to estimate the uncertainty in composition measurement by chromatography: two of them (guide to the expression of uncertainty in measurement method and prediction method) were compared with the Monte Carlo method.Ariza et al., 2015[178]
The role of uncertainty regarding the results of screening immunoassays in blood establishments.Pereira et al., 2015[179, 180]
Determination of polybrominated diphenyl ethers in water by a simple dispersive liquid–liquid microextraction–gas chromatography–mass spectrometry method. Validation parameters, including the calculation of the expanded uncertainty associated to the results in the range of quantification is included.Santos et al., 2015[181]
Establishing measurement of uncertainty for simultaneous bio-analytical determination of L-Carnitine and Metformin in human plasma by liquid chromatography–tandem mass spectrometry.Terish Bino et al., 2015[182]
Contribution of each stage in the developed procedure on the uncertainty measurement of the determination of volatile aromatic hydrocarbons in surface and underground water. The uncertainty sources were identified and illustrated in an effect diagram.Pavlova et al., 2014[183]
Evaluation of the sources of uncertainty in the determination of repaglinide in human plasma using liquid chromatography–tandem mass spectrometry.Li et al., 2013[184]
Measurement uncertainty of food carotenoid determination. The ISO guide was interpreted for analytical chemistry by EURACHEM. Measurement uncertainty was estimated based on laboratory validation data, including precision and method performance studies, and also, based on laboratory participation in proficiency tests.Dias et al., 2012[185]
Comparison of measurement uncertainty component estimations for three methods using the high-performance liquid chromatography techniques: determination of the type and content of aromatic hydrocarbons in diesel fuels and petroleum distillates by normal phase high-performance liquid chromatography, determination of nitrates in water samples by ion chromatography, and determination of molecular weights of polystyrene by size exclusion chromatography technique.Tomić et al., 2012[186]
The estimation and use of measurement uncertainty for a drug substance test procedure validated according to USP <1225>.Weitzel, 2012[187]
Estimation of the global uncertainty associated to the determination of pentachlorophenol in aqueous samples, by gas chromatography with mass spectrometric detection, after solid phase microextraction.Brás et al., 2011[188]
A high-performance technique that was originally developed for inductively coupled plasma optical emission spectrometry has been successfully translated to ion chromatography to enable analyses with extremely low uncertainty (0.2% Relative Expanded Uncertainty).Brennan et al., 2011[189]
Estimating the uncertainty related to GC-MS analysis of organo-chlorinated pesticides from water.Pana et al., 2011[190]
Development of a model system of uncertainty evaluations for multiple measurements by isotope dilution mass spectrometry: determination of folic acid in infant formula.Kim et al., 2010[191]
Basic terms, sources of uncertainty, and methods of calculating the combined uncertainty.Konieczka and Namieśnik, 2010[192]
Evaluation of uncertainty of measurement from method validation data: An application to the simultaneous determination of retinol and -tocopherol in human serum by high performance liquid chromatography.Semeraro et al., 2009[193]
Estimating the measurement uncertainty in forensic breath-alcohol analysis.Gullberg, 2006[194]
Uncertainty budget for final assay of a pharmaceutical product based on reverse phase high performance liquid chromatography.Anglov et al., 2003[195]
Analytical method to verify the accuracy of the natural abundance butyltin standard concentrations that are needed for their subsequent use in the reverse spike isotope dilution quantitation of enriched species-specific spikes. A full combined uncertainty calculation, accounting for all possible sources of uncertainty in the measurement process.Yang et al., 2002[196]
Propagation of uncertainty in high-performance liquid chromatography with UV–VIS detection.Hibbert et al., 2001[197]

Table 7.

Selected papers on evaluation of the measurement uncertainty in classical and instrumental techniques.

Figure 2.

Number of publications cited per year.

Figure 3.

Number of papers cited by journals.

Advertisement

4. Final comments

Uncertainty is a measure of the quality of a measurement. It is of vital importance in many sectors of analytical chemistry to introduce quality control and quality assurance in production, complying with and enforcing laws and regulations; calibrating standards and instruments or developing and comparing international and national reference standards among others.

One of the best-known approaches to estimate the uncertainty of analytical procedures is the ISO/GUM. However, from an analytical viewpoint, this approach is sometimes tedious, time-consuming and unrealistic. One way to overcome these limitations is the procedure for evaluating uncertainty of analytical assays in routine analysis using the GUM approach together with the data from in-house validation based on the cause and effect diagram coming from the analytical specification function. Expressions to calculate the different contributions of uncertainty have to be carefully adapted in order to avoid double counting. The procedure is illustrated with a case study on fluorimetric determination of quinine in tonic water showing that it is very suitable for evaluating the uncertainty of the analyte content of future samples in routine analysis.

Finally, a summary including modern reviews on the estimation of measurement uncertainty of analytical assays by GUM is outlined in tabular form, which can be a useful guide for those interested in the subject. Moreover, selected application ranging from volumetric glassware, analytical balance, calibration curves, as well as the evaluation of the measurement uncertainty in classical and instrumental techniques in a wide variety of fields are given. Graphs on the number of references cited (over 200) per year and the number of papers by most cited journals are also included.

References

  1. 1. Evaluation of measurement data. Guide to the Expression of Uncertainty in Measurement. Joint Committee for Guides in Metrology–JCGM 100. 2008 (ISO/IEC Guide 98–3). http://www.iso.org/sites/JCGM/GUM-introduction.htm
  2. 2. EURACHEM/CITAC Guide, Quantifying Uncertainty in Analytical measurement, 3rd edition, 2012. https://www.eurachem.org/images/stories/Guides/pdf/QUAM2012_P1.pdf
  3. 3. Ellison SLR. Uncertainty in chemical measurement. In: Ciarlini P, Cox MG, Pavese F, Richter D, editors. Advanced Mathematical Tools in Metrology III. Singapore: World Scientific; 1997. pp. 56-67
  4. 4. Ellison SLR, Wegscheider W, Williams A. Measurement uncertainty. Analytical Chemistry. 1997;1:607-613
  5. 5. Ellison SLR, Barwick VJ. Using validation data for ISO measurement uncertainty estimation. Part 1. Principles of an approach using cause and effect analysis. The Analyst. 1998;123:1387-1392
  6. 6. Tague NR. The Quality Toolbox. 2nd ed. Milwaukee, Winsconsin: American Society for Quality, Quality Press; 2005. p. 584
  7. 7. Hässelbarth W. Measurement uncertainty procedures revisited: Direct determination of uncertainty and bias handling. Accreditation and Quality Assurance. 1998;3:418-422
  8. 8. Hässelbarth W. Accounting for bias in measurement uncertainty estimation. Accreditation and Quality Assurance. 2004;9(8):509-514
  9. 9. González AG, Herrador MA. The assessment of electronic balances for acuracy of mass measurements in the analytical laboratory. Accreditation and Quality Assurance. 2007;12:21-19
  10. 10. Kadis R. Evaluating uncertainty in analytical measurements: The pursuit of correctness. Accreditation and Quality Assurance. 1998;3:237-241
  11. 11. González AG. Practical considerations on indirect calibration in analytical chemistry. In: Hessling JP, editor. Uncertainty Quantification and Model Calibration. Rijeka: Intech; 2017. pp. 197-215
  12. 12. Agterdenbos J. Calibration in quantitative analysis. 1. General considerations. Analytica Chimica Acta. 1979;108:315-323
  13. 13. Kadis R. Evaluation of the measurement uncertainty: Some common mistakes with a focus on the uncertainty from linear calibration. Journal of Chromatography. A. 2017;1499:226-229
  14. 14. González AG, Herrador MA, Asuero AG. Intra-laboratory assessment of method accuracy (trueness and precision) by using validation standards. Talanta. 2010;82:1995-1998
  15. 15. O’Reilly J. Fluorescence experiments with quinine. Journal of Chemical Education. 1975;52:610-612
  16. 16. González AG, Herrador MA. Accuracy profiles from uncertainty measurements. Talanta. 2006;70:896-901
  17. 17. U.S. Food & Drug Administration (FDA). Code of Federal Regulations Title 21, volume 3, 21CFR172.575. Revised in 01-04-2016. URL: https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfCFR/CFRSearch.cfm?fr=172.575. Last access: 21-07-2017
  18. 18. González AG, Herrador MA. A practical guide to analytical method validation, including measurement uncertainty and accuracy profiles. Tr. Anal. Chem. 2007;26:227-238
  19. 19. Possolo A, Iyer HK. Invited article: Concepts and tools for the evaluation of measurement uncertainty. The Review of Scientific Instruments. 2017;88(1):1-33
  20. 20. Synek V. How to encompass an uncorrected bias into the expanded uncertainty with a fixed coverage probability: Calculation procedures. Accreditation and Quality Assurance. 2017;22:177-179
  21. 21. Bailey DC. Not normal: The uncertainties of scientific measurements. Royal Society Open Science. 2016;7:1-17
  22. 22. Lira I. The GUM revision: the Bayesian view toward the expression of measurement uncertainty. European Journal of Physics. 2016;37(2):1-16
  23. 23. Stant LT, Aaen PH, Ridler NM. Comparing methods for evaluating measurement uncertainty given in the JCGM “evaluation of measurement data” documents. Meas. J. Int. Meas. Confed. 2016;94:847-851
  24. 24. White DR. In pursuit of a fit-for-purpose uncertainty guide. Metrologia. 2016;53(4):S107-S124
  25. 25. Willink R. What can we learn from the GUM of 1995? Measurement: Journal of the International Measurement Confederation. 2016;91:692-698
  26. 26. Ramsey MH, Ellison SLR. Uncertainty factor: An alternative way to express measurement uncertainty in chemical measurement. Accreditation and Quality Assurance. 2015;20(2):153-155
  27. 27. Bich W. Revision of the ‘guide to the expression of uncertainty in measurement’. Why and how? Metrologia. 2014;51(4):S155-S158
  28. 28. Cox MG, Harris PM. Validating the applicability of the GUM procedure. Metrologia. 2014;51(4):S167-S175
  29. 29. Ehrlich C. Terminological aspects of the Guide to the Expression of Uncertainty in Measurement (GUM). Metrologia. 2014;51(4):S145-S154
  30. 30. Ellison SLR. Implementing measurement uncertainty for analytical chemistry: The Eurachem Guide for measurement uncertainty. Metrologia. 2014;51(4):S199-S205
  31. 31. Farrance I, Frenkel R. Uncertainty in measurement: A review of monte carlo simulation using microsoft excel for the calculation of uncertainties through functional relationships, including uncertainties in empirically derived constants. Clinical Biochemist Reviews. 2014;35(1):37-61
  32. 32. Nielsen L. Evaluation of mass measurements in accordance with the GUM. Metrologia. 2014;51(4):S183-S190
  33. 33. Possolo A. Statistical models and computation to evaluate measurement uncertainty. Metrologia. 2014;51(4):S228-S236
  34. 34. Imai H. Expanding needs for metrological traceability and measurement uncertainty. Measurement: Journal of the International Measurement Confederation. 2013;46(8):2942-2945
  35. 35. Saffaj T, Ihssane B, Jhilal F, Bouchafra H, Laslami S, Sosse SA. An overall uncertainty approach for the validation of analytical separation methods. The Analyst. 2013;138(16):4677-4691
  36. 36. Chew G, Walczyk T. A Monte Carlo approach for estimating measurement uncertainty using standard spreadsheet software. Analytical and Bioanalytical Chemistry. 2012;402(7):2463-2469
  37. 37. Farrance I, Frenkel R. Uncertainty of measurement: A review of the rules for calculating uncertainty components through functional relationships. Clinical Biochemist Reviews. 2012;33(2):49-75
  38. 38. Ma YC, Wang CW, Hung SH, Chang YZ, Liu CR, Her GR. Estimation of the measurement uncertainty in quantitative determination of ketamine and norketamine in urine using a one-point calibration method. Journal of Analytical Toxicology. 2012;36(7):515-522
  39. 39. Williams A. EURACHEM/CITAC workshop on recent developments in measurement uncertainty. Accreditation and Quality Assurance. 2012;17(2):111-113
  40. 40. Rozet E, Marini RD, Ziemons E, Hubert P, Dewé W, Rudaz S, et al. Total error and uncertainty: Friends or foes? Trends in Analytical Chemistry. 2011;30(5):797-806
  41. 41. Iwaki Y. The assurance as a result of blood chemical analysis by ISO-GUM and QE. 13th IMEKO International Meas Confed TC1-TC7 Jt Symp. 2010;238. Available from: http://www.scopus.com/inward/record.url?eid=2-s2.0-78651083146&partnerID=40&md5=5a43eb7545f59a3cacc969ad7bb6a9a3
  42. 42. Westgard JO. Managing quality vs. measuring uncertainty in the medical laboratory. Clinical Chemistry and Laboratory Medicine. 2010;48(1):31-40
  43. 43. Deldossi L, Zappa D. ISO 5725 and GUM: Comparison and comments. Accreditation and Quality Assurance. 2009;14(3):159-166
  44. 44. Nam G, Kang CS, So HY, Choi J. An uncertainty evaluation for multiple measurements by GUM, III: Using a correlation coefficient. Accreditation and Quality Assurance. 2009;14(1):43-47
  45. 45. Priel M. From GUM to alternative methods for measurement uncertainty evaluation. Accreditation and Quality Assurance. 2009;14(5):235-241
  46. 46. Bich W. How to revise the GUM? Accreditation and Quality Assurance. 2008;13(4–5):271-275
  47. 47. Buffler A, Allie S, Lubben F. Teaching measurement and uncertainty the GUM way. Physics Teacher. 2008;46(9):539-543
  48. 48. Kadis RL. Measurement uncertainty and chemical analysis. Journal of Analytical Chemistry. 2008;63(1):95-100
  49. 49. Magnusson B, Ellison SLR. Treatment of uncorrected measurement bias in uncertainty estimation for chemical measurements. Analytical and Bioanalytical Chemistry. 2008;390(1):201-213
  50. 50. Ezhela V. A Multimeasurand ISO GUM supplement is urgent. Data Science Journal. 2007;6:S676-S689
  51. 51. Kacker R, Sommer K-D, Kessel R. Evolution of modern approaches to express uncertainty in measurement. Metrologia. 2007;44(6):513-529
  52. 52. Meyer VR. Measurement uncertainty. Journal of Chromatography. A. 2007;1158(1–2):15-24
  53. 53. Vanatta LE, Coleman DE. Calibration, uncertainty, and recovery in the chromatographic sciences. Journal of Chromatography. A. 2007;1158(1–2):47-60
  54. 54. Bich W, Cox MG, Harris PM. Evolution of the ‘guide to the expression of uncertainty in measurement’. Metrologia. 2006;43(4):S161-S166
  55. 55. Dimech W, Francis B, Kox J, Roberts G. Calculating uncertainty of measurement for serology assays by use of precision and bias. Clinical Chemistry. 2006;52(3):526
  56. 56. Kacker R, Toman B, Huang D. Comparison of ISO-GUM, draft GUM supplement 1 and Bayesian statistics using simple linear calibration. Metrologia. 2006;43(4):S167-S177
  57. 57. González AG, Herrador MA, Asuero AG. Practical digest for evaluating the uncertainty of analytical assays from validation data according to the LGC/VAM protocol. Talanta. 2005;65(4):1022-1030
  58. 58. Gregory K, Bibbo G, Pattison JE. A standard approach to measurement uncertainties for scientists and engineers in medicine. Australasian Physical & Engineering Sciences in Medicine. 2005;28(2):131-139
  59. 59. Herrador MA, Asuero AG, González AG. Estimation of the uncertainty of indirect measurements from the propagation of distributions by using the Monte-Carlo method: An overview. Chemometrics and Intelligent Laboratory Systems. 2005;79(1–2):115-122
  60. 60. Jurado JM, Alcázar A. A software package comparison for uncertainty measurement estimation according to GUM. Accreditation and Quality Assurance. 2005;10(7):373-381
  61. 61. O’Donnell GE, Hibbert DB. Treatment of bias in estimating measurement uncertainty. Analyst. 2005;130(5):721-729
  62. 62. Kacker RN, Datla RU, Parr AC. Statistical analysis of CIPM key comparisons based on the ISO guide. Metrologia. 2004;41:340-352
  63. 63. White GH, Farrance I. Uncertainty of measurement in quantitative medical testing. A laboratory implementation guide. Australasian Association of Clinical Biochemists. Clinical Biochemist Reviews. 2004;25:1-24
  64. 64. Choi J, Kim D, Kim D, Hwang E, Hwang E, et al. An uncertainty evaluation for multiple measurements by GUM, II. Accreditation and Quality Assurance. 2003;8:205-207
  65. 65. Kristiansen J. The guide to expression of uncertainty in measurement approach for estimating uncertainty: An appraisal. Clinical Chemistry. 2003;49(11):1822-1829
  66. 66. Krouwer JS. Critique of the guide to the expression of uncertainty in measurement method of estimating and reporting uncertainty in diagnostic assays. Clinical Chemistry. 2003;49(11):1818-1821
  67. 67. Maroto A, Boqué R, Riu J, Rius FX. Effect of non-significant proportional bias in the final measurement uncertainty. The Analyst. 2003;128(4):373-378
  68. 68. Kessel W. Measurement uncertainty according to ISO/BIPM-GUM. Thermochimica Acta. 2002;382(1–2):1-16
  69. 69. Hund E, Massart DL, Smeyers-Verbeke J. Operational definitions of uncertainty. Trends in Analytical Chemistry. 2001;20(8):394-406
  70. 70. Barwick VJ, Ellison SLR. Measurement uncertainty: Approaches to the evaluation of uncertainties associated with recovery. The Analyst. 1999;124(7):981-990
  71. 71. Analytical Methods Committee (AMC). Uncertainty of measurement: Implications of its use in analytical science. Analyst. 1995;120:2303-2308
  72. 72. Cortez L. Future trends in analytical quality assurance - the estimation of uncertainty. Mikrochimica Acta. 1995;328:323-328
  73. 73. Thompson M. Uncertainty in an uncertain world. The Analyst. 1995;120:117N-118N
  74. 74. Taylor BN, Kuyatt CE. Guidelines for evaluating and expressing the uncertainty of NIST measurement results. NIST Technical Note. 1994:1297
  75. 75. Matsuda S, Ihara Y, Miyagawa H, Komori T. The uncertainty on using graduated volumetric glassware for the concentration of samples (concentration tube) and its effect on measurement accuracy. Journal of Environmental Chemical Engineering. 2015;25(2):105-107
  76. 76. Mukund N, Arun S, Ajay B, Girish P. A study and evaluation of uncertainty in volumetric measurement. Asian Journal of Research in Chemistry. 2015;8(9):553-560
  77. 77. Rahman MA, Afroze M, Mazumdar RM, Moniruzzaman M, Bhuiyan MTH, Razu MH, et al. Source of uncertainties in uncertainty estimation of analytical balance and volumetric glassware calibration. World Applied Sciences Journal. 2015;33(11):1740-1745
  78. 78. Valcu A, Baicu S. Analysis of the results obtained in the calibration of electronic analytical balances. International Conference and Exposition on Electrical and Power Engineering 2012;1(0):861-866
  79. 79. Meyer VR, Pfohl J, Winter B. Calibration, handling repeatability, and the maximum permissible error of single-volume glass instruments. Accreditation and Quality Assurance. 2010;15(12):705-708
  80. 80. Batista E, Almeida N, Filipe E, Alves J, Regional L, Civil DE. Comparison of two diferent approaches in the uncertainty calculation of gravimetric volume calibration. XIX IMEKO World Congress Fundamental and Applied Metrology, Lisbon, Portugal, September 6–11, 2009;C:2343–1345
  81. 81. Wampfler B, Rösslein M. Uncertainty due to volumetric operations is often underestimated. Talanta. 2009;78(1):113-119
  82. 82. Batista E, Filipe E, Mickan B. Volume calibration of 1000 μl micropipettes. Inter-laboratory comparison. Accreditation and Quality Assurance. 2008;13(4–5):261-266
  83. 83. Collé R. A Primer on weighing uncertainties in radionuclidic metrology. Comparisons and uncertainties workshop, Bureau International de Poids et Mesures, France. 2008
  84. 84. Kostic M, Sankaramadhi VK, Simham KC. New educational lab: measurement and uncertainty evaluation of nanofluid particle concentration using volumetric flask method. American Society for Engineering Education. March 31–01-04-2006. Indiana University Purdue University Fort Wayne (IPFW). p. 10
  85. 85. Kadis R. Evaluation of measurement uncertainty in volumetric operations: The tolerance-based approach and the actual performance-based approach. Talanta. 2004;64(1):167-167
  86. 86. Clark J, Shull A. Gravimetric & spectrophotometric errors impact on pipette calibration certainty. Cal Lab. 2003;1:31-38
  87. 87. Efstathiou CE. On the sampling variance of ultra-dilute solutions. Talanta. 2000;52:711-715
  88. 88. Schwartz LM. Variance study of burette aliquot volumes. The Analyst. 1990;115:1581-1587
  89. 89. Schwartz LM. Calibration of pipets: A statistical view. Analytical Chemistry. 1989;61(10):1080-1083
  90. 90. Lam RB, Isenhour TL. Minimizing relative error in the preparation of standard solutions by judicious choice of volumetric glassware. Analytical Chemistry. 1980;52(7):1158-1161
  91. 91. Anonymous. Estimates of Uncertainty of the Calibration of Balances. p. 1–7
  92. 92. Flicker CJ, Tran HD. Calculating measurement uncertainty of the “conventional value of the result of weighing in air”. NCSLI Measure. 2016;5775:26-37
  93. 93. Lourenço V, Bobin C. Weighing uncertainties in quantitative source preparation for radionuclide metrology. Metrologia. 2015;52(3):S18-S29
  94. 94. Salahinejad M, Aflaki F. Uncertainty measurement of weighing results from an electronic analytical balance. Measurement Science Review. 2007;7(6):1-9
  95. 95. Pozivil M, Winiger W, Wunderli S, Meyer VR. The influence of climate conditions on weighing results. Microchimica Acta. 2006;154(1–2):55-63
  96. 96. González AG, Herrador ÁM, Asuero AG. Estimation of the uncertainty of mass measurements from in-house calibrated analytical balances. Accreditation and Quality Assurance. 2005;10(7):386-391
  97. 97. Davidson S, Perkin M, Buckley M, Davidson S, Perkin M, Buckley M. Good Practice Guide The Measurement of Mass and Weight. NPL No 71. National Physical Laboratory Teddington, Middlesex, United Kingdom, TW11 0LW. ISSN 1368–6550. www.npl.co.uk
  98. 98. Reichmuth A, Wunderli S, Weber M, Meyer VR. The uncertainty of weighing data obtained with electronic analytical balances. Microchimica Acta. 2004;148(3–4):133-141
  99. 99. Wunderli S, Fortunato G, Reichmuth A, Richard P. Uncertainty evaluation of mass values determined by electronic balances in analytical chemistry: A new method to correct for air buoyancy. Analytical and Bioanalytical Chemistry. 2003;376(3):384-391
  100. 100. Clark JP, Shull AH. Methods for estimating the uncertainty of electronic balance measurements. In: Kowalski T, editor. Chapter 8,Calibration in the Pharmaceutical Laboratory. Taylor and Francis, CRC; 2001. pp. 257-371
  101. 101. Kehl KG, Weirauch K, Wunderli S, Meyer VR. The influence of variations in atmospheric pressure on the uncertainty budget of weighing results. The Analyst. 2000;125(5):959-962
  102. 102. Kochsiek M, Gläser M, editors. Comprehensive Mass Metrology. Berlin (Federal Republic of Germany): WILEY-VCH Verlag Berlin GmbH; 2000. p. 549 ISBN: 3-527-29614-X
  103. 103. de Beer JO, Naert C, Deconinck E. The quality coefficient as performance assessment parameter of straight line calibration curves in relationship with the number of calibration points. Accreditation and Quality Assurance. 2012;17(3):265-274
  104. 104. Sousa JA, Reynolds AM, Ribeiro ÁS. A comparison in the evaluation of measurement uncertainty in analytical chemistry testing between the use of quality control data and a regression analysis. Accreditation and Quality Assurance. 2012;17(2):207-214
  105. 105. Theodorou D, Zannikou Y, Zannikos F. Estimation of the standard uncertainty of a calibration curve: Application to sulfur mass concentration determination in fuels. Accreditation and Quality Assurance. 2012;17(3):275-281
  106. 106. Nezhikhovskiy GR, Zvyagin ND, Chunovkina AG. The evaluation of uncertainty for linear calibration curves generation in analytical laboratories. Ivan Kozhedub Kharkiv National Air Force University (Системи обробки інформації). 2011;1(4):103–109
  107. 107. Thompson M. Uncertainty functions, a compact way of summarising or specifying the behaviour of analytical systems. Trends in Analytical Chemistry. 2011;30(7):1168-1175
  108. 108. Mermet JM. Calibration in atomic spectrometry: A tutorial review dealing with quality criteria, weighting procedures and possible curvatures. Spectrochimica Acta Part B: Atomic Spectroscopy. 2010;65(7):509-523
  109. 109. Kemény S, Deák A, Bánfai B. Testing accuracy of analytical methods by regression. Journal of Chemometrics. 2009;23(4):211-216
  110. 110. Willink R. Estimation and uncertainty in fitting straight lines to data: Different techniques. Metrologia. 2008;45(3):290-298
  111. 111. White DR, Saunders P. The propagation of uncertainty with calibration equations. Measurement Science and Technology. 2007;18(7):2157-2169
  112. 112. Hayashi Y, Matsuda R. An expression of uncertainty in calibration using stepwise or separate dilution of a stock solution. Analytical Sciences. 2006;22(6):889-894
  113. 113. Hibbert DB. The uncertainty of a result from a linear calibration. The Analyst. 2006;131(12):1273-1278
  114. 114. Gonzalez AG, Herrador MA, Asuero AG. Uncertainty evaluation from Monte-Carlo simulations by using crystal-ball software. Accreditation and Quality Assurance. 2005;10(4):149-154
  115. 115. Gonzalez AG, Herrador MA, Asuero AG. Erratum “uncertainty evaluation from Monte-Carlo simulations by using crystal-ball software.” Accreditation and Quality Assurance. 2005;10(4):324
  116. 116. Heydorn K, Anglov T. Calibration uncertainty. Accreditation and Quality Assurance. 2002;7(4):153-158
  117. 117. Brüggemann L, Wennrich R. Evaluation of measurement uncertainty for analytical procedures using a linear calibration function. Accreditation and Quality Assurance. 2002;7(7):269-273
  118. 118. Giordano JL. On reporting uncertainties of the straight-line regression parameters. European Journal of Physics. 1999;20:343-349
  119. 119. Penninckx W, Hartmann C, Massart DL, Smeyers-Verbeke J. Validation of the calibration procedure in atomic absorption spectrometric methods. Journal of Analytical Atomic Spectrometry. 1996;11:237-246
  120. 120. Asuero AG, González G, De Pablo F, Gómez Ariza JL. Determination of the optimum working range in spectrophotometric procedures. Talanta. 1988;35(7):531-537
  121. 121. Singh N, Singh N, Tripathy SS, Soni D, Singh K, Gupta PK. Evaluation of purity with its uncertainty value in high purity lead stick by conventional and electro-gravimetric methods. Chemistry Central Journal. 2013;7(1):108-118
  122. 122. Li Y, Tian G, Shi N, Lu X. Study of the uncertainty in gravimetric analysis of the Ba ion. Accreditation and Quality Assurance. 2002;7(3):115-120
  123. 123. Barbieri Gonzaga F, Rodrigues CL. Precise determination of hypochlorite in commercial bleaches with established traceability using automatic potentiometric titration. Accreditation and Quality Assurance. 2014;19(4):283-287
  124. 124. Toledo M. Calculation of Measurement Uncertainty. An Example for Titration. Switzerland: Mettler-Toledo AG Global MarCom/Lab Division Marketing; 2014 www.mt.com/gp
  125. 125. Basak S, Kundu D. Evaluation of measurement uncertainty components associated with the results of complexometric determination of calcium in ceramic raw materials using EDTA. Accreditation and Quality Assurance. 2013;18(3):235-241
  126. 126. Calisto SC, Esquível MM, Trancoso MA. Target measurement uncertainty as a tool for validation of uncertainties estimated by different approaches: Determination of total hardness in drinking and natural waters. Accreditation and Quality Assurance. 2013;18(6):501-510
  127. 127. Amanatidou E, Trikoilidou E, Samiotis G, Benetis NP, Taousanidis N. An easy uncertainty evaluation of the cod titrimetric analysis in correlation to quality control and validation data. Method applicability region. Analytical Methods. 2012;1:4204-4212
  128. 128. Sooväli L, Rõõm EI, Kütt A, Kaljurand I, Leito I. Uncertainty sources in UV-Vis spectrophotometric measurement. Accreditation and Quality Assurance. 2006;11(5):246-255
  129. 129. Drolc A, Cotman M, Roš M. Uncertainty of chemical oxygen demand determination in wastewater samples. Accreditation and Quality Assurance. 2003;8(3–4):138-145
  130. 130. Pueyo M, Vilalta E. Expression of uncertainty of an acid-base. Analytical Communications. 1996;33:205-208
  131. 131. Rodomonte AL, Montinaro A, Bartolomei M. Uncertainty evaluation in the chloroquine phosphate potentiometric titration: Application of three different approaches. Journal of Pharmaceutical and Biomedical Analysis. 2006;42(1):56-63
  132. 132. Sousa AR, Trancoso MA. Uncertainty of measurement for the determination of fluoride in water and wastewater by direct selective electrode potentiometry. Accreditation and Quality Assurance. 2005;10(8):430-438
  133. 133. Koort E, Herodes K, Pihl V, Leito I. Estimation of uncertainty in pK a values determined by potentiometric titration. Analytical and Bioanalytical Chemistry. 2004;379(4):720-729
  134. 134. Helm I, Jalukse L, Leito I. Measurement uncertainty estimation in amperometric sensors: A tutorial review. Sensors. 2010;10(5):4430-4455
  135. 135. Virro K, Mellikov E, Volobujeva O, Sammelselg V, Asari J, Paama L, et al. Estimation of uncertainty in electron probe microanalysis: Iron determination in manuscripts, a case study. Microchimica Acta. 2008;162(3–4):313-323
  136. 136. Takano DEN, de Souza Reis PR, Singh AK, Lourenco FR. Estimation of uncertainty for measuring desloratadine in tablets formulation using UV spectrophotometry. Measurement: Journal of the International Measurement Confederation. 2017;101:40-44
  137. 137. Amanatidou E, Trikoilidou E, Tsikritzis L, Foteini K. Uncertainty in spectrophotometric analysis – “Error propagation break up”, a novel statistical method for uncertainty management. Talanta. 2011;85(5):2385-2390
  138. 138. Dobiliene J, Raudiene E, Zilinskas RP. Uncertainty of measurement in spectrometric analysis: A case study. Measurement. 2010;43(1):113-121
  139. 139. Galbán J, De Marcos S, Sanz I, Ubide C, Zuriarrain J. Uncertainty in modern spectrophotometers. Analytical Chemistry. 2007;79(13):4763-4767
  140. 140. Traks J, Sooväli L, Leito I. Uncertainty in photometric analysis: A case study. Accreditation and Quality Assurance. 2005;10(5):197-207
  141. 141. Ramachandran R, Rashmi. Uncertainty of measurement in spectrophotometric analysis: A case study. The Analyst. 1999;124:1099-1103
  142. 142. Remya Devi PS, Trupti AC, Nicy A, Dalvi AA, Swain KK, Wagh DN, Verma R. Evaluation of uncertainty in the energy dispersive X-ray fluorescence determination of platinum in alumina. Analytical Methods. 2015;7(12):5345-5351
  143. 143. Scapin MA, Salvador VLR, Cotrim MEB, Pires MAF, Sato IM. Uncertainty measurement evaluation of WDXRF and EDXRF techniques for the Si and Utotal determination in U3Si2 nuclear fuel. Journal of Radioanalytical and Nuclear Chemistry. 2011;287(3):807-811
  144. 144. O’Meara JM, Fleming DEB. Uncertainty calculations for the measurement of in vivo bone lead by x-ray fluorescence. Physics in Medicine and Biology. 2009;54(8):2449-2461
  145. 145. Morgenstern P, Brüggemann L, Wennrich R. Effect of the sample matrix on measurement uncertainty in X-ray fluorescence analysis. Spectrochimica Acta Part B: Atomic Spectroscopy. 2005;60(9–10):1373-1379
  146. 146. Saxena SK, Raju Karipalli A, Krishnan AA, Singh VK. Determination and uncertainty analysis of inorganic arsenic in husked rice by solid phase extraction and atomic absorption spectrometry with hydride generation. Journal of AOAC International. 2017;100(3):598-602
  147. 147. Živković I, Fajon V, Tulasi D, Obu Vazner K, Horvat M. Optimization and measurement uncertainty estimation of hydride generation–cryogenic trapping–gas chromatography–cold vapor atomic fluorescence spectrometry for the determination of methyl mercury in seawater. Marine Chemistry. 2017;1:1-5
  148. 148. Torres DP, Olivares IRB, Queiroz HM. Estimate of the uncertainty in measurement for the determination of mercury in seafood by TDA AAS. Journal of Environmental Science and Health, Part B. 2015;50(8):622-631
  149. 149. Mahajan NS, Mandavgade NK, Jaju SB. Analysis of uncertainty measurement in atomic absorption. International Journal of Engineering, Science and Technology. 2012;4(5):2139-2145
  150. 150. Theodorou D, Meligotsidou L, Karavoltsos S, Burnetas A, Dassenakis M, Scoullos M. Comparison of ISO-GUM and Monte Carlo methods for the evaluation of measurement uncertainty: Application to direct cadmium measurement in water by GFAAS. Talanta. 2011;83(5):1568-1574
  151. 151. Alves S, Correia Dos Santos MM, Trancoso MA. Evaluation of measurement uncertainties for the determination of total metal content in soils by atomic absorption spectrometry. Accreditation and Quality Assurance. 2009;14(2):87-93
  152. 152. Jokai Z, Fodor P. Evaluation of the uncertainty statement in the case of mercury speciation analysis. Journal of Analytical Atomic Spectrometry. 2009;24(9):1229-1236
  153. 153. Jürgens J, Paama L, Leito I. The uncertainty of UV-Vis spectrophotometric and FAAS analysis for the determination of iron in pharmaceutical products. Accreditation and Quality Assurance. 2007;12(11):593-601
  154. 154. Chui QSH. Uncertainties related to linear calibration curves: A case study for flame atomic absorption spectrometry. Journal of the Brazilian Chemical Society. 2007;18(2):424-430
  155. 155. Guevara-Riba A, Sahuquillo A, López-Sánchez JF, Rubio R. Comparison of three strategies to evaluate uncertainty from in-house validation data. A case study: Mercury determination in sediments. Analytical and Bioanalytical Chemistry. 2006;385(7):1298-1303
  156. 156. Haouet MN, Chessa G, Fioroni L, Galarini R. Estimation of uncertainty for the determination of mercury in food by CVAAS. Accreditation and Quality Assurance. 2006;11(1–2):17-22
  157. 157. Hirano Y, Imai K, Yasuda K. Uncertainty of atomic absorption spectrometer. Accreditation and Quality Assurance. 2005;10(5):190-196
  158. 158. Patriarca M, Castelli M, Corsetti F, Menditto A. Nh TX-, Po H, et al. estimate of uncertainty of measurement from a single-laboratory validation study: Application to the determination of lead in blood. Clinical Chemistry. 2004;1405:1396-1405
  159. 159. Tirez K, Beutels F, Brusten W, Noten B, De Brucker N. Total uncertainty budget calculation for the determination of mercury in incineration ash (BCR 176R) by atomic fluorescence spectrometry. Analytical and Bioanalytical Chemistry. 2002;374(6):990-997
  160. 160. O ‘donnell G. Uncertainty of measurement of the analysis of lead in blood by graphite furance AAS calibrating with a commercial available standard version 1. 2000;1–9
  161. 161. Kristiansen J, Christensen JM, Nielsen JL. Uncertainty of atomic absorption spectrometry: Application to the determination of lead in blood. Mikrochimica Acta. 1996;249:241-249
  162. 162. Al-Deen TS, Hibbert DB, Hook JM, Wells RJ. An uncertainty budget for the determination of the purity of glyphosate by quantitative nuclear magnetic resonance (QNMR) spectroscopy. Accreditation and Quality Assurance. 2004;9(1–2):55-63
  163. 163. Andersen JET, Glasdam S-M, Larsen DB, Molenaar N. New concepts of quality assurance in analytical chemistry: Will they influence the way we conduct science in general? Chemical Engineering Communications. 2016;203(12):1582-1590
  164. 164. Tanase IG, Popa DE, Udriştioiu GE, Bunaciu AA, Aboul-Enein HY. Estimation of the uncertainty of the measurement results of some trace levels elements in document paper samples using ICP-MS. RSC Advances. 2015;5(15):11445-11457
  165. 165. Senila M, Drolc A, Pintar A, Senila L, Levei E. Validation and measurement uncertainty evaluation of the ICP-OES method for the multi-elemental determination of essential and nonessential elements from medicinal plants and their aqueous extracts. Journal of Analytical Science and Technology. 2014;5(1):37-46
  166. 166. Ohlsson KEA. Uncertainty budget for multi-elemental analysis of plant nutrients in conifer foliar material using inductively coupled plasma atomic emission spectrometry (ICP-AES). Accreditation and Quality Assurance. 2012;17(3):301-313
  167. 167. Chudzinska M, Debska A, Baralkiewicz D. Method validation for determination of 13 elements in honey samples by ICP-MS. Accreditation and Quality Assurance. 2012;17:65-73
  168. 168. Fortunato G, Wunderli S. Evaluation of the combined measurement uncertainty in isotope dilution by MC-ICP-MS. Analytical and Bioanalytical Chemistry. 2003;377(1):111-116
  169. 169. Bonnefoy C, Menudier A, Moesch C, Lachâtre G, Mermet J-M. Validation of the determination of lead in whole blood by ICP-MS. Journal of Analytical Atomic Spectrometry. 2002;17(9):1161-1165
  170. 170. Barwick VJ, Ellison SLR, Fairman B. Estimation of uncertainties in ICP-MS analysis: A practical methodology. Analytica Chimica Acta. 1999;394(2–3):281-291
  171. 171. Bürger S, Essex RM, Mathew KJ, Richter S, Thomas RB. Implementation of guide to the expression of uncertainty in measurement (GUM) to multi-collector TIMS uranium isotope ratio metrology. International Journal of Mass Spectrometry. 2010;294(2–3):65-76
  172. 172. Hwang R-J, Beltran J, Rogers C, Barlow J, Razatos G. Measurement of uncertainty for blood alcohol concentration by headspace gas chromatography. Canadian Society of Forensic Science Journal. 2017;5030:1-11
  173. 173. Valese AC, Molognoni L, de Souza NC, de Sá Ploêncio LA, Costa ACO, Barreto F, Daguer H. Development, validation and different approaches for the measurement uncertainty of a multi-class veterinary drugs residues LC-MS method for feeds. Journal of Chromatography, B: Analytical Technologies in the Biomedical and Life Sciences. 2017;1053:48-59
  174. 174. Vergeynst L, K’oreje K, De Wispelaere P, Harinck L, Van Langenhove H, Demeestere K. Statistical procedures for the determination of linearity, detection limits and measurement uncertainty: A deeper look into SPE-LC-Orbitrap mass spectrometry of pharmaceuticals in wastewater. Journal of Hazardous Materials. 2017;323:2-10
  175. 175. Brieudes V, Lardy-Fontan S, Lalere B, Vaslin-Reimann S, Budzinski H. Validation and uncertainties evaluation of an isotope dilution-SPE-LC-MS/MS for the quantification of drug residues in surface waters. Talanta. 2016;146:138-147
  176. 176. Paoloni A, Alunni S, Pelliccia A, Pecorelli I. Rapid determination of residues of pesticides in honey by μGC-ECD and GC-MS/MS: Method validation and estimation of measurement uncertainty according to document no. SANCO/12571/2013. Journal of Environmental Science and Health, Part B. 2016;51(3):133-142
  177. 177. Valese AC, Molognoni L, de Sá Ploêncio LA, de Lima FG, Gonzaga LV, Górniak SL, et al. A fast and simple LC-ESI-MS/MS method for detecting pyrrolizidine alkaloids in honey with full validation and measurement uncertainty. Food Control. 2016;67:183-191
  178. 178. Ariza AAA, Ayala Blanco E, García Sánchez LE, García Sánchez CE. Comparison of different methods to estimate the uncertainty in composition measurement by chromatography. Journal of Separation Science. 2015;38(11):1907-1915
  179. 179. Pereira P, Westgard JO, Encarnação P, Seghatchian J, de Sousa G. Quality management in European screening laboratories in blood establishments: A view of current approaches and trends. Transfusion and Apheresis Science. 2015;52(2):245-251
  180. 180. Pereira P, Westgard JO, Encarnação P, Seghatchian J, de Sousa G. The role of uncertainty regarding the results of screening immunoassays in blood establishments. Transfusion and Apheresis Science. 2015;52(2):252-255
  181. 181. Santos MSF, Moreira JL, Madeira LM, Alves A. Determination of polybrominated diphenyl ethers in water at ng/L level by a simple DLLME–GC–(EI) MS method. Journal of Analytical Chemistry. 2015;70(11):1390-1400
  182. 182. Terish Bino JD. Kannappan, Jith S, Kumar S. Establishing measurement of uncertainty for simultaneous bio-analytical method by LC-MS/MS. Der Pharmacia Sinica. 2015;6(2):45-51
  183. 183. Pavlova A, Stoyanova O, Ivanova P, Dimova T. Uncertainty estimation related to analysis of volatile aromatic hydrocarbons by static headspace gas chromatography. Journal of Chromatographic Science. 2014;52(7):567-572
  184. 184. Li JK, Li Y, Chen M, Yang J, Song Y, Wang C, et al. Uncertainty evaluation for the determination of repaglinide in human plasma by LC-MS/MS. Accreditation and Quality Assurance. 2013;18(1):61-70
  185. 185. Dias MG, Camões MF, Oliveira L. Measurement uncertainty of food carotenoid determination. Accreditation and Quality Assurance. 2012;17(2):183-189
  186. 186. Tomić T, Nasipak NU, Babić S. Estimating measurement uncertainty in high-performance liquid chromatography methods. Accreditation and Quality Assurance. 2012;17(3):291-300
  187. 187. Weitzel MLJ. The estimation and use of measurement uncertainty for a drug substance test procedure validated according to USP <1225>. Accreditation and Quality Assurance. 2012;17(2):139-146
  188. 188. Brás I, Ratola N, Alves A. Uncertainty in the quantification of pentachlorophenol in wood processing wastewaters by SPME-GC-MS. Journal of Analytical Chemistry. 2011;66(8):756-762
  189. 189. Brennan RG, Butler TA, Winchester MR. Achieving 0.2% relative expanded uncertainty in ion chromatography analysis using a high-performance methodology. Analytical Chemistry. 2011;83(10):3801-3807
  190. 190. Pana M, Pana A, Rau G, dan Mogosanu G. Estimating the uncertainty related to GC-MS analysis of organo-chlorinated pesticides from water. Farmácia. 2011;59(6):830-841
  191. 191. Kim B-J, Hwang E-J, So H-Y, Son E-K, Kim Y-S. Development of a model system of uncertainty evaluations for multiple measurements by isotope dilution mass spectrometry: Determination of folic acid in infant formula. Bulletin of the Korean Chemical Society. 2010;31(11):3139-3144
  192. 192. Konieczka P, Namieśnik J. Estimating uncertainty in analytical procedures based on chromatographic techniques. Journal of Chromatography. A. 2010;1217(6):882-891
  193. 193. Semeraro A, Altieri I, Patriarca M, Menditto A. Evaluation of uncertainty of measurement from method validation data: An application to the simultaneous determination of retinol and α-tocopherol in human serum by HPLC. Journal of Chromatography, B: Analytical Technologies in the Biomedical and Life Sciences. 2009;877(11–12):1209-1215
  194. 194. Gullberg RG. Estimating the measurement uncertainty in forensic breath-alcohol analysis. Accreditation and Quality Assurance. 2006;11(11):562-568
  195. 195. Anglov T, Byrialsen K, Karkov J, Finn C, Steen C, Stjernholm Madsen B, Sørensen E, Sørensen JE, Toftegård K, Winther H, Heydorn K. Uncertainty budget for final assay of a pharmaceutical product based on RP-HPLC. Accreditation and Quality Assurance. 2003;8(5):225-230
  196. 196. Yang L, Mester Z, Sturgeon RE. Species-specific isotope dilution-based calibration for trace element speciation and its combined uncertainty evaluation: Determination of tributyltin in sediment by HPLC-ICPMS. Analytical Chemistry. 2002;74(13):2968-2976
  197. 197. Hibbert DB, Jiang J, Mulholland MI. Propagation of uncertainty in high-performance liquid chromatography with UV-VIS detection. Analytica Chimica Acta. 2001;443(2):205-214

Written By

Antonio Gustavo González, María Ángeles Herrador, Agustín García Asuero and Julia Martín

Submitted: 20 May 2017 Reviewed: 30 October 2017 Published: 20 December 2017