Density values.
Abstract
The Analytic Hierarchy Process (AHP) is a popular method for solving multi-criteria problems. Many researchers emphasize the simplicity and naturalness of the AHP procedure for evaluating alternatives. However, many scholars believe that the AHP is flawed and therefore cannot be applied in practice. Such a scattering of opinions requires an explanation. The method of AHP uses pairwise comparisons of alternatives. And it is based on the assumption that the alternatives can be measured on the scale of relations. Fechner’s psychophysical law is used as justification for the existence of method of measurement with ratio scales. But there are not one but two psychophysical laws. The existence of two psychophysical laws is a problem of psychophysics. This problem has been solved quite recently. It was shown that the basic psychophysical laws are equivalent. In order to solve this problem, an adjustment of Stevens’ direct measurement model was required. It is suggested that a direct measurement model be used to overcome the shortcomings of the Analytic Hierarchy Process. In this case, the fundamental AHP measurement scale can be used. The adjusted AHP method contains a direct measurement model and a built-in mechanism for checking the adequacy of measurement results. An example of direct measurement of alternatives is analyzed.
Keywords
- Fechner’s law
- Stevens’ law
- analytic hierarchy process (AHP)
- rating
- theory of measurement
1. Introduction
The Analytic Hierarchy Process (AHP) evaluates alternatives using pairwise comparisons based on expert judgments [1, 2]. The AHP methodology involves the measurement of alternatives and the transformation of measurement results [3]. Using AHP methods, it is possible to construct a mathematical model of decision-making [4, 5]. Since the AHP method does not have a strict mathematical justification, there are various modifications to the method [6, 7, 8]. The Multiattribute Utility Theory (MAUT) [9, 10, 11] and specially created methods [12, 13] can be used instead of the AHP method.
In the monograph [14], numerous examples of AHP applications were considered. The authors of the monograph concluded that, despite its popularity, AHP is incapable of solving complex problems. The popularity of AHP is because the AHP method gives the researcher the feeling that he or she is actually solving a complex problem based on his or her preferences. Therefore, many AHP users consider that this method can be applied to any scenario. The authors of the monograph believe that, even when solving trivial problems, AHP is based on questionable procedures. There are references to the works of more than 100 scientists who support this view.
J. Barzilai is the author of a New Theory of measurement [15]. J. Barzilai set the conditions for using the mathematical operations of linear algebra and calculus. The failure to meet the conditions for the application of arithmetic operations in the mathematical foundations of measurement theory, utility theory, and decision theory caused fundamental errors [16]. J. Barzilai believes that T. Saaty did not define what was meant by the terms “importance of criteria” or “relative importance” of criteria. Moreover, criterion importance coefficients cannot be interpreted as a measure of the relative importance of criteria. “In fact, the AHP is plagued by many flaws, and these flaws are fundamental” [17]. There are many examples of the method not working correctly [18]. However, the AHP method is still popular. This can be explained by the fact that the AHP contains a direct measurement model, which is absent in axiomatic theories of measurement. In addition, the AHP measurement model considers the psychological features of the person.
The purpose of this paper is to propose a modification of the AHP that retains the AHP measurement scale. In this case, the decision-making model is free from fundamental errors. The possibility of such modification is explained by the fact that the justification of the AHP method derives from Fechner’s psychophysical law. It should be emphasized that there are not one but two psychophysical laws in psychophysics: Fechner’s law and Stevens’ law. The existence of two psychophysical laws was until recently considered a problem [19, 20, 21]. A solution to this problem was obtained in [22, 23, 24] through the application of the Stevens measurement model. In this paper, this measurement model is used to adjust the AHP method. For a specialist, the AHP correction comes down to small changes in the calculation scheme.
At the beginning of the article, the AHP measurement model, which is the basis of the AHP method, is briefly described. An analysis of the measurement model indicates that the model needs to be adjusted. The Stevens measurement model is then discussed, and the multifactor model is justified. The application of the new measurement model is then described. As an illustration, the paper considers an example of a proper evaluation of alternatives using the AHP scale. Finally, the advantages of the proposed approach are presented.
2. A critique of the analytic hierarchy process as a method of measurement with ratio scales
The measurement model was defined by T. Saaty using the results of Fechner’s works [1]. Fechner (1860) investigated the reactions that arise when paired comparisons of stimuli are made. For example, in an experiment, participants are offered two objects of a certain weight. The weight of one object is changed until the participants notice a difference. Fechner called such a difference “just noticeable.”
Fechner believed that for a sequence of “just noticeable differences” in stimuli, the relation
where
If the result of the measurement is the difference of values, the values are determined to be the additive constant. Assume
A similar modeling error is observed when forming a matrix of pairwise comparisons using the AHP method. A matrix of pairwise comparisons is the basic element of the AHP [1]. Consider a set of alternatives
If a matrix of pairwise comparisons is given, the weights of the alternatives are not uniquely defined. For example, let
The aim of the work is to modify the AHP method based on the correct model for measuring alternatives. To this end, the paper considers a mathematical model of the empirical system (J. Bazilai [15]) and a model of direct measurement.
3. The correction of Stevens’ scales of measurement (direct measurement model)
Let the empirical system be a straight line with a set of points and a set of vectors [15]. For any ordered pair of points
Thus, the model of the empirical system is a one-dimensional affine space. J. Barzilai calls this space homogeneous because, in this case, it is possible to compare vectors with each other [15]. For example, according to Figure 1, the vector
Following A. Friedman (1922), let us axiomatically define an “exceptional group of objects” admitting a special estimation [25]. Let us assume that objects
A.A. Friedman called such special estimation “measurement.” Then
when
The equality
is then satisfied, where
Thus, two ways of measuring the value are obtained. In the first case, the result of the measurement is the difference
Similar models were used by C. S. Stevens to classify measurement scales. The choice of four measurement scales was made by S.S. Stevens back in 1946 [26]. S.S. Stevens later added a fifth scale to them, the scale of logarithmic intervals, but it was later recognized as useless [27]. At first glance, Stevens’ concept of measurement looks convincing, and only the presence of an “extra” fifth scale violates the logic of the presentation. According to S.S. Stevens, the scale of logarithmic intervals is mathematically interesting but, like many mathematical models, empirically useless. Let us use an example to demonstrate why such a claim is controversial. To do this, let us measure a non-additive quantity using the Stevens model.
Density is an example of a non-additive value. For example, if the density values of two samples are 3 kg/m3 and 2 kg/m3, it is not clear what the sum of these values would mean. But the division operation is defined for density; specifically, 3 kg/m3 is 1.5 times greater than 2 kg/m3. Let the densities of five samples
The density values
1 | 2 | 3 | 4 | 5 | |
---|---|---|---|---|---|
2 | 22 | 23 | 24 | 25 |
The example confirms that for arbitrary objects
The ratio scale is the highest level of measurement in Stevens’ classification of levels of measurement (nominal, ordinal, interval, and ratio) [26, 27, 28]. The ratio scale is invariant over transformations in which the numerals on the scale are multiplied by a constant. From the analyzed example, it follows that the result of direct measurement is the scale of intervals or the scale of log intervals (Table 1). Therefore, the ratio scale is not a scale of direct measurement. But S.S. Stevens believed that the log-interval scale was useless [27] and carried out direct measurements on the ratio scale. This point of view was considered correct for a long time and was the cause of numerous errors, including those in the AHP method.
4. Adjusted model of direct measurement
From equalities (3) and (5), it follows that the values of the quantity on the scale of intervals and log intervals are related by the formula
where
Equality (6) means that the mapping
Let in the process of measurement, each pair of objects is assigned a difference
where
It is possible to check directly that the rating values
In [22, 23, 24], the compatibility condition (9) is axiomatically defined, and the theoretical model of direct measurement is formulated.
The values of a quantity are obtained on a scale of intervals if they are the solution of the system of Eq. (7), and on a scale of log intervals if they are the solution of the system of Eq. (8). For example, if the respondent believes that the criterion
Various measurement models have been widely used for a long time, but the direct measurement model includes isomorphism (equivalence condition (6)) of scales. From the equivalence condition, follow Fechner’s law in the form of paired comparisons [22], Stevens’ law in the form of paired comparisons [22], and Rush’s model [30, 31].
Stevens’ experimental law (1947) was proposed instead of Fechner’s experimental law (1848). There is now a paradoxical contradiction in psychophysics between Fechner’s and Stevens’ laws, in that the two basic laws contradict each other. The harmonization of these two laws has been the subject of much discussion, but a solution that would satisfy all involved has never been found [19]. The fact that the direct measurement model under consideration solves the complex problem of psychophysics confirms its theoretical and practical importance. Using the direct measurement model, it is possible to introduce the notion of independent variables.
5. Independence of variables
Let
For a fixed point,
The problem of finding the total increment of a function based on partial increments has no solution in the general case. In the special case where the variables are independent, the problem is solved quite simply. In this case, the total increment of a function is equal to the sum of the partial increments
Let
where
is satisfied, where
6. Modified analytical hierarchy process (example)
Let three main factors influence the favorable sociopolitical development of the state:
The project is a point
where
6.1 Influence of factors
The projects that need to be considered here are
1 | 5 | 3 | |
1/5 | 1 | 1/2 | |
1/3 | 2 | 1 |
The first row of Table 2 contains the number 5. This means that the equality
To find the influence coefficients
0 | −6 | −2 | −2 | |
6 | 0 | 4 | 2 | |
2 | −4 | 0 | −1 | |
−2 | 1 | 0 |
The result of the pairwise comparison of projects
Columns
0 | 0 | 0 | 0 | 0.00 | |
6 | 6 | 6 | 4 | 5.50 | |
2 | 2 | 2 | 1 | 1.75 | |
2 | 4 | 3 | 2 | 2.75 |
If the rating estimates
6.2 Influence of factor levels
Let
0 | −1 | −3 | |
1 | 0 | −2 | |
4 | 2 | 0 |
The number 4 in the first column of the data in Table 5 means that the level of
Columns
0 | 0 | 0 | 0.00 | 0.00 | |
1 | 1 | 1 | 1.00 | 0.30 | |
4 | 3 | 3 | 3.33 | 1.00 |
The correlation coefficient is denoted by
0 | −4 | −8 | |
4 | 0 | −4 | |
8 | 4 | 0 |
Columns
0 | 0 | 0 | 0 | 0,0 | |
4 | 4 | 4 | 4 | 0,5 | |
8 | 8 | 8 | 8 | 1,0 |
In this case, all three vectors
6.3 Project assessment
The linear model (18) allows us to evaluate various social development projects. Let
0.00 | 0.00 | 0.00 | 0.00 | |
1.00 | 0.00 | 0.00 | 4.40 | |
0.00 | 1.00 | 0.00 | 1.40 | |
0.00 | 0.00 | 1.00 | 2.20 | |
0.30 | 1.00 | 1.00 | 4.92 | |
1.00 | 0.50 | 0.00 | 5.10 | |
1.00 | 0.50 | 1.00 | 7.30 | |
1.00 | 1.00 | 1.00 | 8.00 |
The outcome of measuring a project’s impact on society is its project rating. Rating values, differences, and ratios of rating values have an empirical meaning. In contrast to the AHP method, the rating has a quantitative structure. For example, the task is to choose the best project among
7. Conclusions and future research directions
The theoretical foundations of the AHP are currently being criticized, in particular, the correctness of the mathematical model. This paper proposes an adjustment to the mathematical model of the AHP using the Stevens direct measurement model. This allows the AHP method’s measurement scale to be used to evaluate alternatives. Statistical criteria can be applied to check the adequacy of the measurement results. The corrected algorithm is no more complicated than the AHP method.
The AHP method uses a variant of the pairwise comparison method. At present, the theoretical foundations of the AHP are being criticized, and in particular, the possibility of measuring preferences on the ratio scale is being questioned. Moreover, the criticism of the AHP method looks quite reasonable. For example, the method of pairwise comparisons has long been used by psychologists, but the values are found to be on an interval scale. The paper shows why the method of pairwise comparisons cannot be used to find values on the ratio scale.
The direct measurement model of psychologist S. Stevens was proposed to measure preferences. The article considers two methods of measurement. The first way is to find the difference between values, and the second way is to find the ratio of values. The algorithm for processing measurement results does not change significantly in this case. In this paper, only the first method, which uses the AHP scale, was considered in detail. The values of the quantity in the interval scale were discovered by the method of pairwise comparisons. This approach has certain advantages. In this case, you can use the measurement scale of the AHP method.
The method of pairwise comparisons considered in this paper is fully compatible with the modern theory of measurement by J. Barzilai. Moreover, standard statistical criteria can be used to check the adequacy of the model. As a result, many of the comments made by opponents of the AHP method have been removed. Measurement results obtained by the method of pairwise comparisons can be used to find coefficients of the multiple linear regression model.
It is relevant to continue further research on the corrected AHP method. Future research could include the use of two measurement methods as well as a test of the regression equation’s adequacy with measurement results.
References
- 1.
Saaty TL. The Analytic Hierarchy Process. 3rd ed. New York: McGraw-Hill; 1980 - 2.
Saaty TL. Fundamentals of the analytic hierarchy process. In: The Analytic Hierarchy Process in Natural Resource and Environmental Decision Making. Pittsburgh: RWS Publications; 2000. pp. 15-35 - 3.
Vaidya OS, Sushil K. Analytic hierarchy process: An overview of applications. European Journal of Operational Research. 2006; 169 (1):1-29 - 4.
Saaty TL. Decision making with the analytic hierarchy process. International Journal of Services Sciences. 2008; 1 (1):83-98 - 5.
Khan AU, Ali Y. Analytical hierarchy process (AHP) and analytic network process methods and their applications: A twenty year review from 2000-2019. International Journal of the Analytic Hierarchy Process. 2020; 12 (3):369-459. DOI: doi.org/10.13033/ijahp.v12i3.822 - 6.
Leal JE. AHP-express: A simplified version of the analytical hierarchy process method. MethodsX. 2020; 7 :100748 - 7.
Millet I, Saaty TL. On the relativity of relative measures–accommodating both rank preservation and rank reversals in the AHP. European Journal of Operational Research. 2000; 121 (1):205-212 - 8.
Tung SL, Tang SL. A comparison of the Saaty’s AHP and modified AHP for right and left eigenvector inconsistency. European Journal of Operational Research. 1998; 106 (1):123-128 - 9.
Dyer JS. Multiattribute Utility Theory (MAUT). Multiple Criteria Decision Analysis. New York: Springer; 2016. p. 285 - 10.
Von Winterfeldt D, Fischer GW. Multi-attribute utility theory: models and assessment procedures. Utility, Probability, and Human Decision Making: Selected. In: Proceedings of an Interdisciplinary Research Conference. Rome: Springer Netherlands; 1975. pp. 47-85 - 11.
Figueira J et al. MAUT- multiattribute utility theory. Multiple Criteria Decision Analysis: State of the Art Surveys. 2005; 2005 :265-292 - 12.
De Felice F, Antonella P. Absolute measurement with analytic hierarchy process: A case study for Italian racecourse. International Journal of Applied Decision. 2013; 6 (3):209-227 - 13.
Zanakis SH et al. Multi-attribute decision making: A simulation comparison of select methods. European Journal of Operational Research. 1998; 107 (3):507-529 - 14.
Munier N et al. Uses and Limitations of the AHP Method. Berlin: Springer; 2021 - 15.
Barzilai J. On the foundations of measurement. In: 2001 IEEE International Conference on Systems. Man and Cybernetics. Tucson, AZ: e-Systems and e-Man for Cybernetics in Cyberspace; 2001. pp. 401-406 - 16.
Barzilai J. Preference function modelling: The mathematical foundations of decision theory. Trends in Multiple Criteria Decision Analysis. 2010; 2010 :57-86 - 17.
Barzilai J. Notes on the analytic hierarchy process. In: Proceedings of the NSF Design and Manufacturing Research Conference. Tampa, USA; 2001. pp. 1-6 - 18.
Podinovski VV, Podinovskaya OV. On the theoretical incorrectness of the analytic hierarchy process. Problemy upravleniya. 2011; 1 :8-13 - 19.
Lubashevsky I. Psychophysical laws as reflection of mental space properties. Physics of Life Reviews. 2019; 31 :276-303 - 20.
Krueger LE. Reconciling Fechner and Stevens: Toward a unified psychophysical law. Behavioral and Brain Sciences. 1989; 12 (2):251-267 - 21.
Dehaene S. The neural basis of the Weber–Fechner law: a logarithmic mental number line. Trends in Cognitive Sciences. 2003; 7 (4):145-147 - 22.
Romancak VM. Measurement of non-physical quantity. System Analysis and Applied Informatics. 2017; 4 :39-44 - 23.
Romanchak VM. On the equivalence of Fechner’s and Stevens’ laws. Journal of the Belarusian State University. Philosophy and Psychology. 2019; 3 :97-102 - 24.
Romanchak VM, Serenkov PS. Non-additive quantity measurement model. Приборы и методы измерений. 2022; 13 (3):208-215 - 25.
Friedmann AA. The World as Space and Time. 2nd ed. Moscow: Nauka; 1965. p. 112 - 26.
Stevens SS. On the theory of scales of measurement. Science. 1946; 103 (2684):677-680 - 27.
Stevens SS. On the psychophysical law. Psychological Review. 1957; 64 (3):153-181. DOI: 10.1037/h0046162 - 28.
Michell J. Stevens's theory of scales of measurement and its place in modern psychology. Australian Journal of Psychology. 2002; 54 (2):99-104 - 29.
Vinberg ĖB. A course in Algebra. American Mathematical Society. 2003; 56 :511 - 30.
Bond TG, Christine MF. Applying the Rasch Model: Fundamental Measurement in the Human Sciences. 2nd ed. New York: Routledge; 2020. p. 348 - 31.
Tennant A, McKenna SP, Hagell P. Application of Rasch analysis in the development and application of quality of life instruments. Value in Health. 2004; 7 :S22-S26