Open access peer-reviewed chapter - ONLINE FIRST

Using Multi-Criteria Optimization in Decision Support under Risk

By Andrzej Łodziński

Submitted: February 12th 2019Reviewed: August 24th 2020Published: October 8th 2020

DOI: 10.5772/intechopen.93705

Downloaded: 16

Abstract

The chapter presents an extension of a previous method for decision support under risk. The decision-making process is modeled by a multi-criteria optimization problem, in which the individual evaluation functions represent the results of decisions in several possible scenarios with associated risks. The decision support method is an interactive decision-making process. The choice is made by solving the problem depending on the control parameters that define the aspirations of the decision maker as well as on an evaluation of the obtained solutions. The decision maker selects a set of parameters representing various risks’ impacts that influences a solution, and then he/she evaluates the obtained solution by accepting or rejecting it. In another case, the decision maker selects a new value and the problem is solved again for the new parameter. In this chapter, an example of supporting decision-making under risk is presented.

Keywords

  • decision under risk
  • multi-criteria optimization
  • symmetrically efficient decision
  • scalarizing function
  • method of decision selection

1. Introduction

In real decision-making problems, the evaluation of a decision is usually nondeterministic, because each problem concerns future activities and is evaluated in terms of future results. A significant portion of the parameters determining the decision conditions and assessment of the results may change, for example, raw material prices, product prices, currency exchange rates, and the sales potential of a given product.

The paper [1] presents a method of modeling decisions under risk in the form of a multi-criteria optimization problem. In this chapter, this approach is developed to apply multi-criteria optimization to supporting decision-making under risk.

As pointed out in [1], when making a decision, the decision maker must take into account both the choice of decisions and the risk’s conditions that may occur in his/her environment. Depending on the degree of knowledge of the decision-making situation (features of the problems being solved and the nature of the environment), decisions can be made in a situation of certainty, uncertainty, or risk. This chapter extends the previous work to represent three types of decision-making under risk. The first type of decision-making: decisions are made under conditions of certainty when the decision maker has accurate and reliable information on which to base his/her actions. The effects of the actions can be predicted with high accuracy. The second type of decision-making: a decision maker has a situation of uncertainty when he can determine what factors will affect the decision-making situation, but he cannot determine the probabilities of their occurrence and therefore also the risks’ impacts of the decisions taken. The other type of decision-making is a decision in risk conditions that applies to situations where the decision maker can determine what factors will affect the decision situation and determine the probabilities of their occurrence. The decision maker, using his experience and information from the environment, can determine with known or estimated probability the effects of decisions as well as the circumstances surrounding them.

Decision-making under risk is a process in which the results of actions taken by the decision maker are uncertain due to the potential of unforeseen circumstances, factors interfering with these circumstances, or disruptive factors, for example, ambient conditions, called scenarios. These, in turn, are caused by factors independent of the decision maker and have a significant impact on the results of the decision. Examples of scenarios can be: good or bad weather in the future; decline, stabilization, or rising stock values on the stock exchange in the future; and different price values and order volumes for a company operating in the future. Each such variant is a scenario. At the same time, each scenario clearly defines the implementation of results for individual decisions. Only the past is known from experience; we observe the present and try to predict the future. Such predictions are related to the construction of probable scenarios based on statistical analysis of the past data in order to find indications about the future and to anticipate it as accurately as possible. The decision maker is not able to determine with certainty which actions will lead to a result, but he can calculate the probability that a given result will occur. Specific scenarios correspond to the appropriate implementation of the assessment function. For each scenario, we are interested in the best evaluation value [1, 2].

As pointed out in [1], the theory of decision-making under risk refers to utility function and two-criterion techniques (Markowitz-type models). The utility function of the decision maker ensures complete order. If it is known, then the optimal decision is one that maximizes the expected utility [3, 4, 5].

This chapter shows an extension of [1] on how the decision problem under risk can be modeled with the multi-criteria optimization, that is, simultaneous minimization of a vector evaluation function whose particular coordinates represent the result of the decision when the given scenario is under risk occurred. The traditional approach [1] to solving a multi-criteria optimization problem requires the introduction of a single scalar objective function valuating individual y vectors and hence the decision vectors x. The solution of the decision problem is then reduced to determining the solution of the optimal single-criteria optimization problem. This approach implies the assumption that the preference relationship can be described using the utility function, u. The major difficulty in solving multi-criteria decision problems is due to the inability to determine a single aggregate quality indicator a priori, while the utility function is just such an indicator. Multi-criteria optimization techniques allow you to solve such a problem without using utility function models. This provides to the interactive multi-criteria techniques for decision support under risk. There are tools of the interactive analysis to define decision support process. They depend on additional preference information gained interactively from the decision maker, allowing simultaneously the decision maker to learn the problem during the process with possible evolvement of the preferences. The effective decision support is using the reference point method. Using the multi-criteria optimization approach, there is no need to identify the utility function of the decision maker. This approach is good for any decision maker who makes decisions under risk conditions (in a cost problem where less is better) for which less is better. This is consistent with first-order stochastic dominance.

The chapter is organized as follows:

  • Section 2 presents a modeling approach of decision under risk.

  • Section 3 defines a symmetrically effective decision that resolves the decision problem under risk conditions.

  • Section 4 discusses the technique of generating symmetrically effective decisions and the method of supporting the decision maker.

  • Section 5 gives an example of the application of the proposed decision support approach to a discrete problem.

  • Section 6 provides a conclusion of this chapter.

2. Modeling of decision under risk

This section discusses how multi-criteria optimization methods can be used to model decisions under risk. The problem of multi-criteria optimization in the decision space and in the assessment of decision space is formulated.

Decision-making under risk is modeled by introducing scenarios, which represent possible states of the environment. Scenarios are factors that influence the outcome of a decision but are beyond the influence of the decision maker. For example, the risk factors can be raw material prices, product prices, currency exchange rates, deposit rates, and demand (e.g., sales opportunities for a given product) which may change. There may also be a catastrophic event changing the situation, for example, closing of the sales or supply market (e.g., due to embargo), customer insolvency, loss of license, etc.

The scenarios representing the risk factors are presented according to their probability distribution. If we assume that the probability of each scenario is a rational number, then by repeating relevant scenarios, it is possible to approach a situation where the probability of each scenario is the same, for example, selection between random variables Yand Y:

PY=x=1/2x=21/2x=4PY=x=1/4x=13/4x=5

is equivalent to the problem of choosing between two lotteries y=2 2 4 4and y=(1, 1?, 5, 5)with equally probable outcomes, where the order of outcomes is not important.

The number of occurrences of a specific scenario corresponds to the probability assigned to it. The specific set of scenarios Si,i=1,,mcorresponds to the appropriate realization environment conditions associated with the evaluation function fix,i=1,,m, where xX0,adecision set that belongs to the set of admissible decision. There is an assessment function associated with each scenario. At the same time, each scenario clearly defines the implementation of results for the individual evaluation function. For each scenario, a lesser value of the evaluation function is preferred [4, 6, 7].

They are given as:

  • the feasible decision set X0Rn;

  • the set of scenarios S1,S2,,Smand the set of probabilities p1,p2,,pmof occurrence of each scenario, and these probabilities are assumed to be known to the decision maker; and

  • the decision assessment function, x, at the scenario fix,i=1,,m, where there is one evaluation function, fix,associated with each scenario.

The problem of decision under risk is modeled in the form of some kind of multi-criteria optimization problem:

minx{f1xfmx:xX0}E1

This is a special problem of multi-criteria optimization in the sense that all assessment functions are expressed in the same units. This differs from the standard multi-criteria optimization problem, where evaluation functions can be expressed in different units. In the case of modeling decisions in risk conditions, individual assessments, although generated by different functions, are all expressed on the same scale, which allows comparison of their values.

There are as many assessment functions in a multi-criteria problem as there are scenarios. Each scenario has a different assessment function. You want to have the best score for all scenarios.

In the problem of multi-criteria optimization, all values for all scenarios are taken into account and by not looking at the values in each scenario (and not looking at individual coordinates). The result of the decision is the grade vector. You want to have the best score for all scenarios. One grading vector that gives the best score for all scenarios is sought.

The function, f, assigns to each decision variable vector, xX0, an evaluation vector, y=fx, which measures the quality of decisions, x, from the point of view of the determined system of evaluation functions, f1,,fm. For each individual assessment at a given scenario, the lower rating means a better evaluation. The formulation of the multi-criteria optimization problem is expressed in the decision space. This is a way for representating the decision problem, where the goal is to choose the right decision, given a set of criteria associated with decision’s risk.

There is a transformation f=f1f2fmof a set of feasible decisions, X0, into a set of achievable assessment vectors, Y0. The problem of choosing the best decision arises naturally. The choice of decision only considers grade vectors and decisions with identical grade vectors that are equally good. Thus, the problem of determining the best decision can be limited to the issue of choosing the best grade vector in the set of achievable grades (achievable grade vectors):

Y0=y:y=fxxX0

This leads to a multi-criteria model in the assessment space:

minxy=y1ym:yi=fixixX0E2

where grades are directly specified as individual variables.

Each vector xin the set X0corresponds to the vector yfor the set Y0. The vector from the set Y0is selected and one sees the decision from the set X0.

3. Symmetrically efficient solutions

This chapter extended the way of defining a symmetrically effective decision compared to the work [1]. This chapter provides the basic definition of a symmetrically effective decision. It is a decision that is a solution to a specific multi-criteria optimization problem, a problem used to support decisions under risk. Decision assessments must meet an additional condition—the condition of anonymity of preference relationships.

The model of the decision problem under risk in the form of a multi-criteria optimization problem imposes additional properties of preference relations and, consequently, limits the choice of decisions to an appropriate subset of the entire set of effective decisions. In the problem of making decisions under risk, minimizing all assessments is equally important.

Decision problems under risk are, when the decision is based on minimization of a vector outcome with various realizations under several scenarios. The preference model leads to the Pareto efficiency with respect to the realizations under scenarios understood as multiple criteria. The case of equally probable scenarios leads to the concept of symmetric optimization (efficiency) of multi-criteria corresponding to realizations under scenarios. The solution should have the feature of anonymity: no distinction is made between results that differ in their orientation coordinates. This solution of the problem, called a symmetrically efficient decision, is an efficient decision that possesses an additional property, that is, that of preference relation anonymity.

Nondominated solutions (optimum Pareto) are defined with the use of preference relations which answer the question of which one of a given pair of evaluation vectors y1,y2Rmis better. This is the following relation:

y1y2yi1i2i=1,,mjy<j1yj2E3

The vector of evaluation ŷY0is called the nondominated vector, provided there is no vector yY0such that ŷis dominated by y. The domination structure is shown in Figure 1.

The set of nondominated solutions is defined as follows:

Figure 1.

Dominance structure in R 2 .

Ŷ0=ŷY0:ŷ+D˜Y0=}E4

where D˜is a positive cone without the top. The positive cone can be D˜=R+m.

The set Ŷ0is shown in Figure 2.

Figure 2.

Nondominated solutions.

A decision x̂X0is called an efficient decision (Pareto optimal) if there is no x¯such that yi=fix¯ŷi=fix̂for i=1,,mwith strict inequality for at least one i [5, 8].

In the problem with homogeneous and equally important assessments, the relation of the decision maker preferences should be impartial due to individual assessment functions. That is, for a given set of evaluation functions, only the distribution of the values achieved by these functions for a given decision is important, and it is not important which function it took. This requirement is formulated mathematically as a property of the anonymity of preference relationships. The risk assessment vector should meet the property of anonymity.

The relation is called an anonymous (symmetric) relation if, for every vector y=y1y2ymRmand for any permutation, P, of the set 1m, the following is true:

yP1yP2yPmy1y2ymE5

We look at the whole with the help of an anonymous preference relationship, and all scenarios are considered rather than on individual results for given scenarios. Anonymous preference relationship is a superstructure over a preference relationship—an additional condition of anonymity is added.

A nondominated vector satisfying the anonymity property is called a symmetrically nondominated vector. The set of symmetrically nondominated solutions is marked as follows: Ŷos. In the decision space, symmetrically efficient decisions are specified. The decision x̂X0is called a symmetrically efficient decision, if the corresponding evaluation vector ŷ=fx̂is a symmetrically nondominated vector. The set of symmetrically efficient decisions is marked as follows: X̂os[9, 10].

The domination structure of symmetric dominance depends on the location of an evaluation vector, y, relative to the line y1=y2==ym. The domination structure is shown in Figure 3.

Figure 3.

Symmetric dominance structure in R 2 .

The relation of symmetric domination can be expressed as the domination of evaluation vectors with coordinates ordered in no decreasing order. This can be formalized with the map T:RmRmsuch that Ty=T1yT2yTmy, where T1y,T2y,,Tmyand a permutation, P, of the set 1mexists such that Tiy=yPifor i=1,..,m.

The evaluation vector ysymmetrically dominates the vector yif the following condition is satisfied:

y1ay2Ty1Ty2E6

The relation of symmetrical domination ais a simple vector domination for evaluation vectors with no decreasing coordinates of evaluation vector [9, 10].

For the problem of decisions under risk expressed in the form of a multi-criteria optimization problem, the solution is a set of symmetrically effective decisions.

4. Technique of generating symmetrically efficient decisions

This chapter extended the way of defining a symmetrically effective decision compared to the work [1]. This chapter discusses how to support decisions under risk. It is an interactive IT system that processes relevant data for a given decision situation and assists the decision maker in recognizing the decision problem in the sense of understanding his own preferences. The decision maker’s role is paramount. The system is not a substitute for the decision maker at any stage of decision-making. Such a system is to support, not replace in the final selection of the decision maker.

In multi-criteria decision problems, the relation of preferences is not known a priori, and therefore the final choice of solution can be made only by the decision maker. Given the numerous set of solutions, this selection is made using the appropriate interactive information system—the decision support system. Such a system processes important data for a given decision situation but also supports the decision maker in recognizing the decision problem in the sense of understanding his own preferences. The decision maker’s role is paramount. The system is not a substitute for the decision maker at any stage of decision-making. Decision support system is to support, not replace in the final selection of the decision maker. In the problem of multi-criteria optimization, you cannot impose an optimal solution on the decision maker, you should support it—give the decision maker the opportunity to review such solutions that give the best results—symmetrically nondominated solutions. The decision maker chooses the decision by looking at the symmetrically nondominated set. This system enables a controlled review of the set of symmetrically efficient solutions. On the basis of the values of certain control parameters given by the decision maker, the system presents various solutions that are symmetrically efficient for analysis.

Solutions of a symmetrically efficient multi-criteria problem can be determined by solving the optimization of a multi-criteria problem:

miny1ym:xX0E7

with the scalarizing function y:RmRdefining the preference relation:

y1ay2sy1>sy2E8

If the relation fulfills the condition of anonymity, the efficient solution generated by this scalarization is also a symmetrically efficient solution to the multi-criteria problem (1).

Symmetrically efficient decisions for a multiple criteria problem (1) are obtained by solving a special problem in multi-criteria optimization, that is, a problem with coordinates of the vector of evaluation arranged in a no decreasing order. This problem is as follows:

miny{T1yT2yTmy:yY0}E9

where y=y1y2ykis an evaluation vector,

Ty=T1yT2yTmy, where T1y,T2y,,Tmyis an ordered evaluation vector,

Y0is the set of evaluation vectors.

An efficient solution of multi-criteria optimization problem (9) is a symmetrically efficient solution of the multi-criteria problem (1).

The method of determining individual symmetrically efficient decisions involves the solution of a parametric scalarization of a multi-criterion problem. This is a problem of single objective optimization using a specially created scalarizing function of two variables: the evaluation vector, yY, and control parameter, y¯ΩRm; thus, we have s:Y0×ΩR1:

minx{sy1ym:xX0}E10

The parameter y¯=y¯1y¯2y¯mis available to the decision maker, enabling him or her to review the set of symmetrically efficient solutions.

To ensure the anonymity of the relationship, it is necessary and sufficient that the scalarizing function is symmetrical, that is,

syP1yP2yPmsy1y2ymE11

for any permutation, P, of the set 1m.

Complete and sufficient parameterization of the set of symmetrically efficient solutions can be achieved, using the method of the reference point for problem (9). In this method, aspiration levels are applied as control parameters. An aspiration level is a value of the evaluation function that satisfies the decision maker.

The scalarizing function defined in the method of the reference point is as follows:

syy¯=min1imTiyTiy¯i+εi=1mTiyTiy¯iE12

where y=y1y2ymis an evaluation vector,

Ty=T1yT2yTmy, where T1y,T2y,,Tmyis a no decreasing ordered evaluation vector,

y¯=y¯1y¯2y¯kis a vector of aspiration levels,

Ty¯=T1y¯T2y¯Tmy¯, where T1y¯T2y¯,,Tmy¯is a no decreasing order vector levels of aspiration,

εis an arbitrary small, positive adjustment parameter.

This kind of scalarizing function is called a function of achievement. The aim is to find the solution closest to the specific requirements, that is, the aspiration levels. Maximizing this function determines the symmetrically efficient solution, ŷ, and the symmetrically efficient decision, x̂. Note that the symmetrically efficient solution, x̂, depends on the aspiration level, y¯[9, 11].

The solution to the multi-criteria optimization problem is a set of efficient solutions. The choice of solution should be made by the decision maker using an IT system. Such a system allows him to browse the entire set of solutions and make choices freely. The final choice of the solution among the set of efficient solutions can only take place based on the user’s preferences. A tool for searching the set of solutions is the function (12). The maximum of this function depends on the parameter, y¯, which is used by the decision maker to select a solution. The method of supporting decision selection is an iterative method consisting of the alternating performance of:

  • calculations, that is, finding another symmetrically efficient solutions;

  • interaction with the system, that is, dialog with the decision maker, which is a source of additional information about his or her preferences.

The method of supporting decision selection is shown in Figure 4.

Figure 4.

The method of supporting decision selection.

This method of supporting decision-making, which does not impose a rigid scenario for the analysis of the decision-making problem upon the decision maker, enables modification of his or her preferences during the analysis of the problem. The decision maker plays a key role in the decision-making process.

5. Example: selecting a decision

The problem of selecting a decision is shown in order to illustrate the method of supporting a decision under risk [12]. The costs of 10 alternatives in three scenarios are presented in Table 1.The probabilities of particular scenarios are as follows: P1 = 0.3, P2 = 0.6, and P3 = 0.1.

DecisionS1S2S3
Decision x1596575
Decision x2505871
Decision x3687260
Decision x4697262
Decision x5536063
Decision x6515965
Decision x7687177
Decision x8565775
Decision x9625880
Decision x10625570

Table 1.

Scenarios of 10 decisions.

The decision maker’s problem is to select one of 10 decisions with three possible future scenarios. Since the configuration of conditions that will apply during the decision is unknown, this problem is a selection decision under risk [13].

The problem of decision-making under risk is modeled as a multi-criteria optimization problem:

minxxy1y2y3y4y5y6y7y8y9y10:xx1x2,x3x4,x5x6x7x8x9x10,E13

where the results of particular decisions are the following vectors:

y1=596575for decisionx1,y2=505871for decisionx2,y3=687260for decisionx3,y4=697262for decisionx4,y5=536063for decisionx5,y6=515965for decisionx6,y7=687177for decisionx7,y8=565775for decisionx8,y9=625880for decisionx9,y10=625570for decisionx10,

in which particular coordinates of evaluation vectors occur with probabilities: P1=0.3, P2=0.6, and P3=0.1.

The problem consists in selecting a decision for which the evaluation vector has the minimum value in the sense of symmetrical dominance.

The repeating of relevant scenarios results in a situation in which the probability of each scenario is the same and, that is, P=1/10. The result is a problem equivalent to the starting problem in which the results for each decision, namely: x1,x2,x3,x4,x5,x6,x7,x8,x9,x10are the following evaluation vectors with equally probable coordinates:

y1=59595965656565656575,y2=50505058585858585871,y3=68696872727272727260,y4=69696972727272727262,y5=53535360606060606063,y6=51515159595959595965,y7=68686871717171717177,y8=56565657575757575775,y9=62626258585858585880,y10=62626255555555555570.

In order to compare the vectors in the sense of symmetrical dominance, the coordinates of vectors are ordered in no decreasing order and the results are the following evaluation vectors for each decision:

Ty1=75656565656565595959,Ty2=71585858585858505050,Ty3=72727272727268696860,Ty4=72727272727269696962,Ty5=63606060606060535353,Ty6=65595959595959515151,Ty7=77717171717171686868,Ty8=75575757575757565656,Ty9=80626262585858585858,Ty10=70626262555555555555.

The set of symmetrically nondominated vectors is as follows: Ŷos=y2y5y6y8y10. Five decisions x2,x5,x6,x8,andx10are symmetrically efficient decisions. When making a selection, one should choose from among them and the decisions x1,x3,x4,x7,andx9should be rejected regardless of individual preferences. These five decisions are incommensurate with respect to a symmetrical preference relation. The choice between them depends on the individual preferences of the decision maker.

The method of the reference point for the problem with coordinates of the evaluation vector arranged in no decreasing order is used to determine the solution of the problem (13). The decision maker controls the selection of an investment project through the levels of aspiration by specifying the desired values of the aspiration vector for each scenario: y¯=y¯1y¯2,y¯3, where y¯1is a level of the aspiration value for scenario 1, y¯2is a level of the aspiration value for scenario 2, and y¯3is a level of the aspiration value for scenario 3.

The multiple-criteria analysis is presented in Table 2.

Iteration
1. Aspiration level y¯
Solution x̂
y¯=505560
Decision x6
2. Aspiration level y¯
Solution x̂
y¯=556060
Decision x5
3. Aspiration level y¯
Solution x̂
y¯=555668
Decision x2
4. Aspiration level y¯
Solution x̂
y¯=555674
Decision x8
5. Aspiration level y¯
Solution x̂
y¯=625668
Decision x10

Table 2.

Interactive analysis of the search for a decision.

Source: own calculations.

At the beginning of the selection, the decision maker identifies the aspiration levels as the best values that can be achieved separately for each scenario, and in subsequent iterations, he or she changes the aspiration levels depending on his or her preferences.

In the first iteration, the decision maker determines the preferences as an aspiration level equal to the vector y¯=505560and obtains the decision solution, x6, as the solution. In the second iteration, the decision maker reduces the requirements for scenarios 1 and 2 without changing the requirement for scenario 3, states the vector y¯=556060as the aspiration level, and obtains decision x5as the solution. In the third iteration, the decision maker does not change the requirements for scenario 1, increases them for scenario 2, and reduces them for scenario 3, and he or she states the vector y¯=555668as the aspiration level and obtains decision x2as the solution. In the fourth iteration, the decision maker does not change the requirements for scenarios 1 and 2 and reduces the requirement for scenario 3. He or she states the vector y¯=555674as the aspiration level and obtains decision x8as the solution. In the fifth iteration, the decision maker reduces the requirements for scenario 1 leaves the requirements for scenario 2 unchanged, and increases the requirements for scenario 3. He or she states the vector y¯=625668as the aspiration level and obtains decision x10as the solution.

The final selection of a specific solution depends on the decision maker’s preferences. The example given here shows that the method enables the decision maker to discover his or her decision-making capabilities in the course of interactive analysis and obtain a satisfactory solution.

6. Conclusions

In the decision-making process, risk plays a significant role, influencing the final result of the decision. The decision maker should be able to analyze them when making decisions. Using his experience and information from the environment, he should make such decisions that will not bring unnecessary threat (risk) to the effects of the decision. Despite the use of objectified tools optimizing decision-making processes in the choice of solution, ultimately the decision maker takes responsibility for the decisions taken.

The chapter presents a method for the decision made under risky situations. The risk is introduced to the model with a set of scenarios with specified probabilities. The choice is made by solving the problem of multi-criteria optimization. This provides a systematic procedure to help a decision maker choose the most desirable and satisfactory decision under risk situations. Therefore, using this way, a decision can be made according to the decision maker’s preference. This method is characterized by:

  • The use of reference point method, that is, the concepts of aspiration levels and minimization of the achievement function to organize interaction with the decision maker.

  • The assumption that the decision maker’s preferences are not fully formed changes during the decision-making process, while the main problem of the decision support system is to support the decision maker’s learning rather than the final act of choice.

  • The method gives a whole set of solutions symmetrically effective decisions and allows the decision maker a free choice. This procedure does not replace the decision maker in making decisions. The whole decision-making process is controlled by the decision maker.

How to cite and reference

Link to this chapter Copy to clipboard

Cite this chapter Copy to clipboard

Andrzej Łodziński (October 8th 2020). Using Multi-Criteria Optimization in Decision Support under Risk [Online First], IntechOpen, DOI: 10.5772/intechopen.93705. Available from:

chapter statistics

16total chapter downloads

More statistics for editors and authors

Login to your personal dashboard for more detailed statistics on your publications.

Access personal reporting

We are IntechOpen, the world's leading publisher of Open Access books. Built by scientists, for scientists. Our readership spans scientists, professors, researchers, librarians, and students, as well as business professionals. We share our knowledge and peer-reveiwed research papers with libraries, scientific and engineering societies, and also work with corporate R&D departments and government entities.

More About Us