Climate change has been widely investigated by the scientific community, and its potential impacts are expected to affect the world’s economy, ecosystem services, and societal structures within a few decades. To reduce the undesirable consequences of climate change, adaptation and mitigation technologies and policies have to be implemented. Analyzing technological advances to address sustainable development, through integrated systems level methods and approaches, is needed to predict future vulnerability to climate change and continued ecosystem deterioration [1-4]. The incorporation of sustainability notion into all sub-systems of our global society has come into full swing and must be continued to be pursued by any entity, both in private as well as public sectors. However, these challenges require integrative and transdisciplinary computational tools and methods to aid in embedding sustainability goals into corporate and government policy decision making processes [5-8]. United States Environmental Protection Agency (USEPA) has been reshaping its strategies and programs in conjunction with incorporating the triple dimensions of sustainability .
In the U.S. bioenergy development, recent innovations in biotechnology, genomics and complexity science have contributed to the renewed interest in converting (ligno) cellulosic biomass to valuable fuels and other bioproducts . The U.S. Department of Agriculture (USDA) and Department of Energy (USDOE) are actively supporting projects to make biofuels and bioproducts economically, socially and environmentally sustainable and viable. U.S. Bioenergy Research Centers work on accelerating genomics-based systems biology research to achieve the transformational breakthroughs in basic science needed for the development of cost-effective technologies to make production of next-generation biofuels from lignocellulose, or plant fiber, commercially viable on a national scale . Figure 1 shows the many potential production pathways to biomass hydrocarbons. Features of these alternative pathways include diversity in feedstocks, fuel composition, and byproducts. Integrated decision-making tools are urgently needed to support choices among these alternatives. Developing these tools effectively requires a life-cycle and dynamic perspective. Life Cycle Assessment (LCA) follows internationally accepted methods (ISO 14040 and ISO 14044) and practices to evaluate requirements and impacts of technologies, processes, and products so as to determine their propensity to consume resources and generate pollution.
Mckone et al.  have identified 7 grand challenges that we must address to enable life cycle assessment (LCA) to effectively evaluate the environmental “footprint” of biofuel alternatives and to support the evolving bioeconomy. According to their work, the grand challenges for applying life cycle assessment to biofuels are:
Understanding feedstock growers, options, and land use;
Predicting biofuel production technologies and practices;
Characterizing tailpipe emissions and their health consequences;
Incorporating spatial heterogeneity in inventories and assessments;
Temporal accounting in impact assessments;
Assessing transitions and end states; and
Dealing with uncertainty and variability.
The above challenges have already been addressed and analyzed in disaggregated and piecemeal fashion in several papers in various disciplines.
Thus, an in-depth analysis is needed to critically understand the re-emergence of biofuels in conjunction with sustainable development. Most of the research projects on cellulosic biofuels have not given due attention to social acceptability and economic feasibility, besides not considering the competing interests of various stakeholders [2- 3]. The interactions between environmental, social and economic impacts of biorefinery development must be analyzed in a comprehensive and integrated manner to ensure the sustainable development of a bio-industry (such as the increasing interest in “drop-in” biofuels). Concerns related to biomass harvest and its impact on soil erosion, nutrient losses, biodiversity losses, land use changes, water consumption, eutrophication and environmental impacts of auxiliaries inputs must be weighted with the benefits of cellulosic biofuels [2, 12]. Several studies (e.g. [11, 13-15]) have been conducted to identify biomass potential, assess technological efficiency and understand the environmental implications of biofuels. However, a complete and comprehensive evaluation of biofuels supply chain from a holistic and systems perspective has been lacking. Several authors [2-3; 6-8] have argued the need for further research for large scale deployment of second-generation and third generation biomass crops including their effects on land use, biodiversity and hydrology. Technological researches have focused on using cheap and easily available feedstock (e.g. woody biomass, harvest residues, agricultural residues) to advance lignocelluloses feedstock bio-refinery [16 - 17], whereas environmental concerns of biofuels have focused on carbon dioxide emissions only . Though integrated forest products bio-refinery systems may result to additional revenues by producing co-products like biofuels and other biomass based chemicals in addition to the main products [16, 19], uncertainties prevail regarding the capital investments required as well as the social impacts for large-scale production [2-3].
With the above challenges in implementing bioenergy policies while carefully considering stakeholders’ interests, dynamic integrated system methodologies are urgently needed to analyze the sustainability of biofuels supply chain and to better understand the overall impacts of introducing (ligno) cellulosic ethanol [5-7; 11] or even to support the development of “drop-in” biofuels.
In the subsequent sections of this paper, we elaborate on how we might support the conduct of integrated sustainability analysis and modeling of biofuel supply chains.
2.1. Understanding stakeholders and resource requirements
The future feedstocks for biofuels may come from farms, rangelands, or forests. Because of transportation costs, harvested feedstocks are likely to be stored and processed at small- to intermediate-scale (distributed) facilities. Unlike oil companies and government agencies that have a hierarchical structure for decision-making, the first stages of biomass production might involve hundreds to thousands of decision-makers (stakeholders). Using life cycle perspective approach to influence policies that would alter the behaviors of these distributed decision-makers poses different challenges than when the decision-making authority is more highly concentrated. One expects that feedstock growers utilize land to maximize profits.
Having a large number of potential feedstocks with different characteristics in a system of distributed decision-making presents substantial challenges for current LCA approaches because of the vast scope of information needed to address so many alternatives. Multi-criteria decision analysis (MCDA), such as the Analytic Hierarchy Process (AHP), can aid in determining the most critical criteria, variables and indicators to stakeholders, which can represent their conflicting interests with respect to economic, environmental, technological and social dimensions of systems sustainability [4-5, 7-8]. The critical criteria and indicators can be ranked and identified by AHP’s eigenvalues, which are calculated from stakeholders’ inputs .
2.1.1. Multi-criteria Decision Analysis (MCDA) for Stakeholders’ analysis
MCDA is a decision support system that is suitable for addressing complex problems featuring high uncertainty, conflicting objectives, different forms of data and information, multiple interests and perspectives, and including complex evolving bio-physical and socio-economic problem [21-26]. MCDA approaches have long been widely applied to economic, social, and industrial systems. An MCDA in general involves
Wang et al.  present a review of MCDA methods to aid in sustainable energy decision making. In their review, the corresponding methods in different stages of multi-criteria decision-making (i.e., criteria selection, weighting, evaluation and final aggregation) are discussed. The criteria are classified into four major aspects: (i) technical (e.g., efficiency, primary energy ratio, etc.), (ii) economic (e.g., investment cost, net present value, etc.), (iii) environmental (e.g., CO2 emission, NOx emission), and (iv) social (e.g., social acceptability, job creation, etc.). The weighting methods of the criteria are classified into three categories: (i) subjective weighting (e.g., pair-wise comparison, analytical hierarchy process (AHP), etc.), (ii) objective weighting (entropy method, technique for order preference by similarity to ideal solution, etc.), and (iii) combination method.
Different MCDA approaches have been applied to support different decisions including environmental and sustainable energy decision making [28-30]. We can use any of MCDA methods to aid stakeholders’ analysis to find out the “most critical” criteria, indicators and metrics that represent stakeholders’ interests. A combination of AHP and LCA has been used for evaluating environmental performance of pulp and paper manufacturing . Halog  and Halog et al  proposed the use of analytic hierarchy process (AHP), one of MCDA methods [32-34] in stakeholders’ analysis for identifying the critical criteria, indicators and metrics which represent multi-stakeholder’s interests. This will provide ranking of different criteria, indicators and metrics which are important holistically. MCDA opens great applicability to support sustainability assessment of existing and emerging multi-attribute systems. For instance, AHP allows stakeholders to weigh different criteria, indicators, and metrics by calculating Eigen values. In biofuels system, where energy efficiency, investment cost, GHG emissions, land use change and social impacts are the most common criteria, MCDA is certainly applicable. Through MCDA, we can focus first on the critical ones that account stakeholder’ inputs.
However, the existing life cycle thinking and MCDA methods are considered steady-state methods whereby they provide snapshots of hotspots based on historical data. They do not provide projections or trends in the future. They do not take into account the interactions of different metrics, outputs and parameters over time. To make the results more useful for decision and policy makers, we need to model the dynamic interrelationships of these variables over time. Additionally, we can explore the use of Geographic Information Systems (GIS) to assist spatial analysis when needed.
2.2. Biofuel production technologies and practices
Much of the variability among LCA results for biofuels arises from lack of knowledge about how biomass production operations and fuel production from biomass will evolve. Many alternatives exist both for production processes and for final products. An important challenge is to understand the energy, biomass, pollutant, and product mass balances of production facilities: To what extent will they be self-sufficient or even net producers of electricity? Will the facilities deliver a single product (fuel) or have multiple product streams (fuel, food, electricity, chemical commodities)? What are their waste products, air emissions, and water demands? A related challenge is accurately predicting scales of future biofuel production. For biofuels, the feedstocks are more dispersed and less dense than petroleum, which will induce biorefineries to be smaller than petroleum refineries. Ultimately, the scale of biorefining will depend on feedstock and production process choices, technological efficiency in converting feedstock to fuel, productivity of local land for feedstock production, and costs associated with feedstock production and transport, and biorefinery construction and operation. Much is unknown about this system at large scale and will remain uncertain until the system is created. Larger biorefineries may economize on refining-related impacts, but will increase transport-related impacts. Biorefinery scale has important ramifications for life-cycle impacts including the nature and the location of impacts. We can use the scenario analysis capability of the methods of agent based modeling (ABM) and system dynamics (SD) to predict potential performance of various biofuel production technologies and practices.
2.2.1. Agent Based Modeling (ABM)
Agent based model is a computer representation of the considered system (e.g. biofuels supply chain) that is comprised of multiple, interacting actors (i.e., stakeholders) . ABM systems possess two distinct properties: (1) the system is composed of interacting agents; and (2) the system exhibits emergent properties, that is, properties arising from the interaction of the agents/stakeholders that cannot be deduced simply by aggregating the properties of the agents [36- 37]. ABM can be used to model the interactions of agents or sub-systems in biofuels supply chain using the metrics, variables and indicators as performance measures. Figure 3 provides schematic illustration of an agent-based system: each of the four circles represents a sub-system of agents (e.g., companies/entities) denoted by small dots and the whole arrows show how agents and sub-system of agents are interacting with each other. Interacting agents and sub-systems, though driven by only a small set of rules which govern their behavior, account for complex system behavior whose emergent dynamic properties cannot be explained by analyzing its component parts .
ABM aims to look at global consequences of individual or local interactions in a given geographical (e.g. regional) area. Parker et al  have categorized existing literatures on agent-based land use models into five categories—(i) policy analysis and planning; (ii) participatory modeling; (iii) explaining spatial patterns of land use or settlement; (iv) testing social science concepts; and (v) explaining land use functions. Fox et al  argue that optimization of supply chain performance is only possible when the impacts of decisions made by one agent onto another agents are understood. A systems model that captures all important interactions among different units of a supply chain would contribute to effective decision making. Julka et al  use petroleum refinery integrated supply chain modeler and simulator to mimic a crude refinery’s supply chain to develop procurement strategies. Thus, ABM can be used to look at the global consequences in developing biofuels supply chain/network considering the individual interactions of stakeholders across all life cycle stages.
2.2.2. System Dynamics (SD)
SD is a well-established systems perspective/complexity science method which is originally developed by Jay Forrester at MIT [41- 42]. This has been applied in different corporate, industrial and government decisions worldwide which have the intention of modeling and understanding the interrelationships (i.e., feedbacks) of variables, indicators and metrics over time. This has been useful in modeling the interrelationships between or among sub-systems which are linked by variables and aids to see how their interlinkages will produce specific overall system behavior. Before using appropriate modeling software package, it is important to draw causal loop diagrams. A causal loop diagram is a visual representation of the feedback loops in a system whereby the stocks and flows (i.e., involving different variables, parameters, indicators) are connected by either positive and negative loops. A stock (e.g., biomass, GHG, revenue, unemployment) is the term for any entity in the system that accumulates or depletes over time. A flow is the rate of change in a stock. A flow changes the rate of accumulation of the stock. The real power of system dynamics is utilized through simulation and in showing the inter-linkages between micro-, meso-, and macro-systems. SD involves computational modeling for framing, understanding, and discussing complex issues and problems [43-45]. It is recognized that the structure of any emerging system—the many circular, interlocking, sometimes time-delayed relationships among its components—is often just as important in determining its behavior as the individual components themselves. There are often properties of the whole which cannot be found among the properties-of-the-elements. The feedback loops as well as the use of stocks and flows can represent and model the critical sustainability variables, indicators, and metrics to describe how seemingly simple sub-systems display baffling nonlinearity for the whole system . The modeling can be developed by sub-dividing the whole system into sub-models but we need to remember that they are interconnected by variable, parameter or a metric [4, 47]. Through SD we can create a prototype dynamic system model for the system being considered.
In SD, a system is modeled mathematically in a nonlinear, first-order differential (or integral) equation such as:
SD typically goes further and utilizes simulation to study the behavior of systems and the impacts of alternative policies [44-46]. Running “
Once a system model is validated, the procedural steps can be done iteratively depending on the scenario defined. This will also provide information about the trends of important variables over time which will give us insights and guidance on what decisions and policies to take. Eventually, this modeling procedure can support the selection and implementation of sustainable biofuel systems.
2.3. Characterizing emissions and their health consequences
LCAs of transportation fuel systems report that the fuel combustion stage makes the largest contributions to pollutant emissions and associated disease burdens. Credible and reliable impact estimates for biofuel combustion are needed. Another aspect of LCA’s tailpipe challenge is the need for accurate emission factors for future fleets that cover a range of fuel alternatives and vehicle technologies. Enormous technological progress has been made in controlling motor vehicle emissions, and there is strong momentum for continuing progress. In what ways and to what extent will shifts from petroleum-based fuels to biofuels affect the combustion-phase emissions of air pollutants? One historical approach to answer similar questions has been to conduct laboratory-based emissions testing. However, this approach is relatively expensive and lacks reliability for characterizing fleet-wide emissions from real drivers on real roads, and so is unlikely to provide accurate information in a timely manner. An alternative approach, used in LCA tools such as GREET  which assumes that vehicle emissions meet federal and state emissions standards regardless of the fuel used, and that emissions targets are the best estimate of what will happen in future years.
Since the concept of sustainability insinuates temporal and spatial connotations, it is important that variables, indicators, metrics and parameters representing stakeholders’ interests are modeled over time within a geographical location, which can be done using dynamic system modeling.
2.4. Incorporating spatial heterogeneity in integrated assessment
A key challenge for integrated sustainability assessment of biofuels is to rationally select appropriate spatial scales for different impact categories without adding unnecessary complexity and data management challenges. Though methods such as LCA can address net changes across large geographical areas, it must also address how the impacts will be experienced at local or regional scales. Accurate assessments must not only capture spatial variation at appropriate scales (from global to farm-level), but also provide a process to aggregate spatial variability into impact metrics that can be applied at all geographical scales. We can use geographic information system (GIS) to support regionalized LCA. GIS has a powerful analytical ability to assess data spatially. It stores different layers of information. GIS is a tool that links location and attribute information to enable a person to visualize patterns, relationships, and trends for different parameters of a system. Previous literature and organizational reports have suggested using GIS as a tool to link the aspatial data with spatial data [54-56]. This offers at least two important contributions to the modeling of land use changes impacts on biodiversity and ecosystem goods and services caused by biofuels production. It permits analysis of spatially explicit datasets of land use and land cover, which can be used in the assessment of the areas affected by increased land occupation. It also offers an understanding of land use dynamics. The insight can aid in the predictions of land use changes caused by increased demand for biofuels .
2.5. Temporal accounting in integrated sustainability assessment
Similar to spatial resolution when conducting integrated sustainability analysis, selecting appropriate time scales poses challenges for biofuels system modeling efforts. Time allocations are important for comparing impacts, yet the time distribution of impacts is rarely made clear in studies such as LCAs. Many factors in systems analysis vary significantly in time. Therefore, time-based assumptions must be clearly noted and evaluated. Among the “moving targets” are population distributions, technology options, regulatory requirements, and the degree of biofuel penetration in the overall energy mix. Moreover, the inputs one uses in integrated sustainability assessments to characterize biomass and fuel production technologies as well as transportation infrastructure must capture how these systems are evolving. Different natural time scales associated with different impacts pose challenges for effective comparisons among climate-change, human health, and water use consequences. The impacts of GHG emissions are distributed over decades using integrated assessment models and are commonly discounted. Assumptions about the rate of discounting influence judgments about the relative importance of current year versus future year emissions. Similarly, impacts on water resources and soil can play out over decades. We can use dynamic system modeling and simulation.
2.6. Assessing transitions and end states in sustainability analysis
Both advocates and critics of biofuels often focus on a restricted set of scenarios that appear to reinforce their
To account for transitions, LCA requires much collaboration between economists and systems engineers to address what happens during the transition phase when large-scale changes occur in many components of a complex, market driven, technological system. For example, one of many key issues is whether fuel changes will affect the performance and lifetime of vehicles or the infrastructure transporting that fuel in ways that significantly increase climate forcing, water, health, and other externalities during transition. Technology investments are needed, and these activities could cause GHG emissions to rise in the near-term as part of a longer-term effort to attain a more carbon-efficient end state. In addressing transitions, there should be recognition that emerging technologies could profoundly change the assumptions that underlie biofuel LCAs. This issue makes clear the need to support life cycle thinking methods for building scenarios from which one should learn, rather than as a tool designed to make firm predictions.
2.6.1. Scenario development and analysis for policy planning and making
Forecasting, foresighting and backcasting are approaches used for policy planning and making. These scenario development approaches have their benefits and shortfalls. Backcasting involves working backwards from a particular desired future end-point or set of goals (i.e., sustainable society) to the present state, in order to determine the physical feasibility of that future and the policy measures that would be required to reach the state [58-60]. This helps in analyzing alternative futures response to present situation and deals with problems in a different way rather than extrapolating present scenario into the future (forecasting) [61-64]. Backcasting makes it clear that addressing sustainability concerns requires a paradigm shift from business-as-usual attitudes. On the other hand, industries and organizations use forecasting technique as a data analysis methodology to develop future scenarios from existing information. Forecasting enables decision makers to identify reasonable estimates of various current activities. Using forecasting approach, managers and decision makers can tweak and calibrate their operations at the appropriate time in order to maximize benefits. Forecasting assists in preventing losses by taking in all relevant information and making proper judgment decisions . Moreover, foresighting can be distinguished from forecasting. Forecasting is the passive attempt to diagnose or predict future events. Foresighting aims to actively change or create the future by linking it to the present. Thus, the major difference between foresighting and forecasting is that in forecasting the conclusions for today are missing. There are four major applications of foresighting: (1) assessing possible consequences of actions, (2) anticipating problems before they occur, (3) considering the present implications of possible future events; and (4) envisioning desired aspects of future societies. Foresighting which is a tool for 'decision-shaping' rather than 'decision-making' offers many benefits including: engaging policy-makers and experts in actively planning for the future; identifying potential problems early; verifying expectations and examining trends; bringing people together to create a suitable future; strengthening existing networks,; and educating the public on urgent future-related issues. It could have a positive impact on sustainable technology policy by providing a means for analyzing its broader social and economic implications.
By considering different scenarios (starting from business-as-usual to different plausible scenarios in the future (either through foresighting or backcasting), we can generate different results for our system performance measures and identify a few critical alternative systems or scenarios to be strongly considered for developing sustainable decision, policy, technology, systems, intervention, etc. Again, this is with the assumption that we can gather good quality data. We can also perform sensitivity and uncertainty analyses to improve the robustness of integrated sustainability analysis results.
2.6.2. Uncertainty and variability analysis for robust sustainability assessment
Addressing uncertainty is a major hurdle, not only for biofuels LCA, but for other integrated system modeling efforts as well. Many sources of uncertainty and variability, both inherent and epistemic, are encountered in climate-change, human-health, environmental, and economic impact assessments. Some of the uncertainties and variabilities cannot be reduced with current knowledge (i.e., through improvements in data collection or model formulation) because of their spatial and temporal scale and complexity. Effective policies are possible, but such policies must explicitly take into account uncertainty. Among those commenting on how to formally address uncertainty in impact assessments, it has been established that there are “levels” of sophistication in addressing uncertainty. In its recommendations for addressing uncertainty in risk assessment, the International Program on Chemical Safety proposed four levels, ranging from the use of default assumptions to sophisticated probabilistic assessment :
Level 0: Default assumptions; single value of result;
Level 1: Qualitative but systematic identification and characterization of uncertainties;
Level 2: Quantitative evaluation of uncertainty making use of bounding values, interval analysis, and sensitivity analysis; and
Level 3: Probabilistic assessments with single or multiple outcome distributions reflecting uncertainty and variability.
Furthermore, Baumgartner  argued that assessing environmental and social impacts is associated with uncertainties caused by applied assessment tools, definition of assessment objectives, system boundaries of assessment and data quality. There are various ways to deal with data and model uncertainties when conducting system modeling and simulation [6, 66]. Uncertainties and variabilities come from a large number of variables and parameters considered, assumptions made, and the spatial and temporal variability in parameters or sources [67-69]. The latest LCA, MCDA, and system dynamics software packages include statistical tools to support uncertainty and sensitivity analyses. Uncertainty analysis aids to show if the model’s general pattern of behavior is strongly influenced by changes in critical parameters. For system dynamics, the usual method is to perform a sensitivity analysis of the model whereby a collection of simulated experiments is performed . This is done by choosing parameters, metrics and indicators that are judged to be sensitive, changing their values and then re-running the simulation model. If there is a drastic response in the results, this can show a lack of robustness in the system model. For ABM, the goal is to check whether the model addresses the right problem and provides accurate information about the system being modeled . Additionally, Miller  proposes to use computer-based Active Nonlinear Tests (ANTs) that are capable of performing multivariate sensitivity analysis, model breaking and validation, extreme cases, and policy discovery. ANTs search across sets of parameter values and are capable of detecting important non-linear relationships among the parameters—relationships that typically go unnoticed using standard techniques . Besides the probabilistic approach in handling uncertainty, fuzzy mathematics, Monte Carlo simulation, etc. can be used to address imprecision . As we confront uncertainty and variability, we need to separate the “doable” and “knowable” from assumptions that are conditional components of the integrated and life cycle sustainability assessments. An informative system perspective assessment should sort out the data gaps that can be addressed with modest effort from those that would require a major undertaking. All integrated assessment efforts require tools, such as sensitivity analysis, variance propagation methods, and decision/event trees for tracking the impact of data quality and model uncertainty through all components of an assessment. A strong challenge for integrated assessments in addressing uncertainty is to provide and track metrics of data quality with respect to how data were acquired (measurements, assumptions, expert judgment, etc.), to what extent the data have been validated or corroborated, and how well the data capture technological, spatial, and temporal variations. This can be best facilitated by capitalizing cyberinfrastructure such as web-based data mining techniques.
3. Conclusions and discussion
Confronting the seven grand challenges, as argued by McKone et al , means recognizing some issues that have not been well articulated among practitioners of integrated sustainability assessment. In particular, a good balance must be attained between the needs of technology momentum and adaptive decision making. Most importantly, we must recognize that integrated assessment is an adaptive and ongoing process and not just a product. Technology momentum refers to the difficulties encountered in backing away from fixed costs (financial, institutional, and environmental) that have been sunk into one alternative pathway. Adaptive decision-making refers to learning by doing, recognizing that commodity costs and impacts can diminish as a system scales up. For biofuels we need technology momentum, but we must simultaneously maintain options for adaptive decision-making. These can be handled by the system-based approaches proposed in this paper which are being currently applied to wood-derived biofuels.
Although life cycle thinking methods can provide insights on options with the lowest impacts, results are often burdened by uncertainty such that they become more informative as technologies are deployed, making it difficult to apply life cycle thinking methods during the early phases of a major technology shift. One example is the important decision that must be confronted in a transition to (ligno) cellulosic biofuels; what end-product should be targeted among choices such as alcohols, alkanes, or a specific chemical compound such as dimethyl furan? This type of decision hinges on issues of timing, technical feasibility, and competitive advantage.
More collaboration and dialogue between basic scientists and sustainability practitioners is important for incorporating system thinking concepts into early phases of technology evaluation. Overall, approaches are needed to create more cross-talking among all members of the biofuel enterprise, which could be implemented at web-based level. Ideally, efforts toward developing the science and technology of biofuels will be continuously informed by those who are expert in integrated sustainability assessment. In this way, the biofuels community has the best opportunity to attain the overarching sustainability goals they seek. In integrated assessment of biofuels, one must recognize that no large-scale industrial product can be developed in isolation. Natural resource systems such as food, energy, water, and land are all intimately interconnected and thus integrated dynamic system modeling and analysis is absolutely needed.
To confront the uncertainty associated with sustainability analysis of biofuels combined with the irreducibility of many uncertainties, planners and policy makers must consider their role in managing uncertainty as well as managing impacts. Managing uncertainty requires addressing different aspects of the overall decision making process in the context of uncertainty. For example, decisions must be made to allocate resources among (i) investments to collect, store, and manage information; (ii) investments to improve the knowledge base (i.e., to generate new knowledge); (iii) formalization of the processes used to collect, use, and process information; (iv) formalization of processes to evaluate and communicate uncertainty; and (v) adjustment of the risk assessment process to mitigate the practical impact of the uncertainty on the analysis process. These tasks can be facilitated with the support of ICT and cyberinfrastructure.
Barriers to integrated sustainability assessments will be similar to environmental LCA (such as many stakeholders want a final answer), to be “cleared for takeoff, with no call-backs. These stakeholders view these assessments as a final exam; pass it and you are done being concerned with impacts and can proceed to technology deployment. This conceptualization serves to highlight the flaws in our thinking in sustainable technology development and commercialization. As McKone et al  pointed out this shortsighted perspective will fail to take advantage the true power of integrated and life cycle sustainability assessments. At its best, integrated sustainability assessment contributes to an ongoing process that organizes both information and the process of prioritizing information needs. These are opportunities for sustainability practitioners to focus attention and effort on making integrated, system perspective assessments more useful to decision makers. Integrated and life cycle sustainability analysis methods can co-evolve with a technology and provide the basis for adaptive planning. Decision makers who work in real time and often cannot wait for precise results must recognize that integrated sustainability assessment can provide valuable insights but it is not necessarily a “truth generating machine”. Effective integrated and life cycle sustainability assessments can guide and inform decisions, but they cannot replace the wisdom, balance, and responsibility exhibited by effective decision-makers.
This work was carried out as part of the seed grant supported by the United States Department of Agriculture (USDA) Sustainable Bioenergy Program.
McKone T, Nazaroff W, Berck P, Auffhammer M, Lipman T, Torn M, Masanet E, Lobscheid A, Santero N, Mishra U. Grand challenges for life-cycle assessment of biofuels. Environmental Science and Technology; 2011.
Rowe RJ, Terry RC, Rickart EA. Environmental change and declining resource availability for small-mammal communities in the Great Basin. Ecology 2011; 92(6), 1366-1375.
van Dam J, Junginger M, Faaij A, Jurgens I, Best G, Fritsche U. Overview of recent developments in sustainable biomass certification. Biomass and Bioenergy 2008; 32(8), 749-780
Halog A, Chan A. Developing a Dynamic Systems Model for Sustainable Development of the Canadian Oil Sands Industry, International Journal of Environmental Technology and Management 2008; 8 (1): 3-22.
Halog A, Manik Y. Advancing integrated systems modeling framework for life cycle sustainability assessment. Sustainability 2011; 3 (2):469-499
Halog A. Models for evaluating energy, environmental and sustainability performance of biofuels value chain. International Journal of Global Energy Issue 2009; 32: 87-101.
Buchholz T, Luzadis V, Volk T. Sustainability criteria for bioenergy systems: Results form an expert survey. Journal of Cleaner Production 2009; 17: S86-S97.
Buchholz T, Rametsteiner E, Volk T, Luzadis V. Multi criteria analysis for bioenergy systems assessments. Energy Policy 2009; 37:484-495.
National Academy of Sciences. Expanding Biofuel Production: Sustainability and the Transition to Advanced Biofuels: Summary of a Workshop. National Academy Press; 2010
Regalbuto J. Cellulosic Biofuels – Got Gasoline? Science 2009; 325: 822-824.
USDA/USDOE. Sustainability of Biofuels: Future Research Opportunities. Report from the October 2008 Workshop, April 2009; 2009.
Davis SC, Anderson-Teixeira KJ, DeLucia EH. Life-cycle analysis and the ecology of biofuels. Trends in plant science 2009; 14(3): 140-146.
Farrell AE, Plevin RJ, Turner BT, Jones AD, O’Hare M, Kammen DM. Ethanol can contribute to energy and environmental goals. Science 2006; 311:506–508.
Plevin RJ, O’Hare M, Jones AD, Torn MS, Gibbs HK. Greenhouse gas emissions from biofuels’ indirect land use change are uncertain but may be much greater than previously estimated. Environment, Science and Technology 2010; 44: 8015–8021.
Perlack R, Wright L, Turhollow A, Graham R, Stokes B, Erbach D. Biomass for a feedstock for bioenergy and bioproducts industry: the technical feasibility of a billion ton annual supply, Oak Ridge National Laboratory, TN (2005 May) 2005;78 p. ORNL/TM-2005/66, DOE/GO-102995, 2135.
Mao H, Genco JM, Yoon SH, van Heiningen A, Pendse H. Technical economic evaluation of a hardwood biorefinery using the "Near-Neutral" hemicellulose pre-extraction process. Journal of Biobased Materials and Bioenergy 2008; 2(2), 177-185. doi: 10.1166/jbmb.2008.309
Uihlein A, Schebek L. Environmental Impacts of a Lignocelluloses Feedstock Biorefinery System: An Assessment. Biomass and Bioenergy 2009; 33: 793-802.
Dickerson K., Rubin J. Maine Bioproducts Business Pathways. Margaret Chase Smith Policy Centre, http://www.forestbioproducts.umaine.edu/library/Maine-Bioproducts-Business-Pathways/203/. Forest Bioproducts Research Initiative, School of Economics, University of Maine, Orono ME; 2008.
Halog A, Mao H. Assessment of Hemicellulose Extraction Technology for Bioethanol Production in the Emerging Bioeconomy. International Journal of Renewable Energy Technology 2011; 2(3): 223 - 239.
Halog A. Sustainable development of bioenergy sector: An integrated methodological framework. International Journal of Multicriteria Decision Making 2011. In press.
Pór A, Stahl J, Temesi J. Decision support system for production control: Multiple criteria decision making in practice. Engineering Costs and Production Economics 1990; 20: 213-218.
Spengler T, Geldermann J, Hähre S, Sieverdingbeck A, Rentz O. Development of a multiple criteria based decision support system for environmental assessment of recycling measures in the iron and steel making industry. Journal of Cleaner Production 1998; 6: 37-52.
Munda G. A NAIADE based approach for sustainability benchmarking. International Journal of Environmental and Technology Management 2006; 6:65-78.
Munda G. Social multi-criteria evaluation: methodological foundations and operational consequences. European Journal of Operations Research 2003; 3: 662-677.
Roy B. The Outranking Approach and the Foundations of ELECTRE Methods; Bana e Costa, C.A., Ed.; Springer-Verlag: Berlin, Germany; 1991: pp155-183.
Brans J, Vincke P. PROMETHEE method for multiple criteria decision-making. Management Sciences 1985; 31:647-656.
Wang JJ, Jing Y-Y, Zhang CF, Zhao JH. Review on multi-criteria decision analysis aid in sustainable energy decision-making. Renewable and Sustainable Energy Review 2009; 13: 2263-2278.
Pohekar S, Ramachandran M. Application of multi-criteria decision making to sustainable energy planning—a review. Renewable and Sustainable Energy Reviews 2004; 8: 365-381.
Halog A, Wei B, Sagisaka M, Inaba A. A Multi-attribute assessment of environmentally-sound electric vehicle battery technologies. Journal of Industrial Engineering 2004; 1: 40-59.
Halog A. Selection of Sustainable Product Improvement Alternatives. Ph.D. Dissertation. http://digbib.ubka.uni-karlsruhe.de/volltexte/242002 (accessed 16 February 2011). University of Karlsruhe, Karlsruhe, Germany, 2002.
Pineda-Henson R, Culaba A, Mendoza G. Evaluating environmental performance of pulp and paper manufacturing using the analytic hierarchy process and life-cycle assessment. Journal of Industrial Ecology 2002; 6: 15-28.
Saaty TL. The Analytic Hierarchy Process; McGraw Hill Company, New York, NY, USA; 1980.
Saaty TL. How to Structure and Make Choices in Complex Problems. Human Systems Management. 1982; 3-4: 255-260.
Saaty TL. Theory and Applications of the Analytic Network Process. RWS Publications, Pittsburgh, PA, USA; 2005.
Holland JH, Miller JH. Artificial adaptive agents in economic theory. American. Economic Review 1991; 81: 365-371.
Akkermans, H. Emergent supply networks 2001: System dynamics simulation of adaptive supply agents. In Proceedings of the 34th Hawaii International Conference on System Sciences Hawaii, HI, USA, 3–6 January 2001; p. 11.
Axelrod, R. The Complexity of Cooperation: Agent-Based Models of Competition and Collaboration; Princeton University Press: Princeton, NJ, USA; 1997.
Parker D, Manson S, Janssen M, Hoffmann M, Deadman P. Multi-agent systems for the simulation of land-use and land-cover change: A review. Annals of the Association of American Geographers 2003; 93: 314-337.
Fox MS, Barbuceanu M, Teigen R. Agent-oriented supply-chain management. International Journal of Flexible Manufacturing Systems 2000; 12:165-188.
Julka N, Karimi I, Srinivasan R. Agent-based supply chain management: A refinery application. Computers and Chemical. Engineering 2002; 26:1771-1781.
Sterman JD. System dynamics modeling: Tools for learning in a complex world. California. Management Review 2001;43: 8-25.
Borshchev A, Filippov A. From system dynamics and discrete event to practical agent based modeling: Reasons, techniques, tools. In Proceedings of the 22nd International Conference of the System Dynamics Society, 2004. Oxford, UK, 25–29 July.
Radzicki M, Taylor R. Origin of System Dynamics: Jay, W. Forrester and the History of System Dynamics. http://www.systemdynamics.org/DL-IntroSysDyn/start.htm (accessed 22 February 2011). U.S. Department of Energy‘s Introduction to System Dynamics; 2011.
Forrester JW. Industrial Dynamics. John Wiley & Sons Inc, New York, NY, USA; 1961.
Forrester JW. Counterintuitive behavior of social systems. Technology Review 1971;73: 52-68.
Saeed K. Slicing a complex problem for systems dynamics modeling. System Dynamics Review 1992; 8: 251-262.
Halog A, Chan A. Toward sustainable production in the Canadian oil sands industry. In Proceedings of the 13th CIRP International Conference on Life Cycle Engineering, European Union, 31 May–2 June 2006; pp. 131-136.
Chan A, Hoffman R, McInnis B. The role of systems modeling for sustainable development policy analysis: The case of bio-ethanol. Ecology and Society 2004; 9, Article 6.
Riley C, Wooley R, Sandor D. Implementing systems engineering in the US. Department of Energy Office of the Biomass Program. http://www.nrel.gov/docs/fy07osti/41406.pdf (accessed 16 February 2011). In Proceedings of International Conference on System of Systems Engineering: SOSE in Service of Energy and Security, San Antonio, TX, USA, 16–18 April 2007; 2007
Bush B, Duffy M, Sandor D, Peterson S. Using system dynamics to model the transition to biofuels in the United States. In Proceedings of the Third International Conference on Systems of Systems Engineering Monterey, California, CA, USA, 2–4 June 2008; NREL/CP-150-43153. http://www.nrel.gov/docs/fy08osti/43153.pdf (accessed 16 February 2011).
Sheehan JJ. Biofuels and the conundrum of sustainability. Current Opinion in Biotechnology 2009; 20: 318-324.
Scheffran J, BenDor T. Bioenergy and land use: A spatial-agent dynamic model of energy crop production in Illinois. International Journal of Environmental Pollution 2009; 39: 4-27.
Franco C, Ochoa MC, Florez AM. A system dynamics approach to biofuels in Colombia. In Proceedings of the 27th International Conference of the System Dynamics Society 2009, Albuquerque, NM, USA, 26–30 July 2009. http://www.systemdynamics.org/conferences/ 2009/proceed/papers/P1189.pdf (accessed 16 February 2011).
Keam S. McCormick N. Implementing sustainable bioenergy production: A compilation tools and approaches. IUCN, Gland, Switzerland; 2008.
Geyer R, Lindner JP, Stoms DM, Davis FW, Wittstock B. Coupling GIS and LCA for biodiversity assessments of land use. International Journal of Life Cycle Assessment 2010; 15(7): 692-703. doi: 10.1007/s11367-010-0199-9
Neupane B. Incorporating biodiversity impact into environmental life cycle assessment of woodchips for bioethanol production, FTY2011-001; http://www.library.umaine.edu/theses/theses.asp?Cmd=abstract&ID=FTY2011-001 (accessed 16 February 2011) University of Maine; 2011
Kloverpris J, Wenzel H, Banse M, Milai Canals L, Reenberg A. Global land use implications of biofuels: state-of-the-art. Conference and workshop on modeling global land use implications in the environmental assessment of biofuels. International Journal of Life Cycle Assessment 2008; 13 (3): 178-183
Holmberg J, Robert JH. Backcasting from non-overlapping sustainability principles—A framework for strategic planning. International Journal of Sustainable Development and World Ecology 2000; 7:1-18.
Holmberg J, Lundqvist U, Robert K, Wackernagel M. The ecological footprint from a systems perspective of sustainability. International Journal of Sustainable Development and World Ecology 1999; 6:17-33.
Kuisma J. Backcasting for Sustainable Strategies in the Energy Sector. IIIEE Report. Lund, Sweden, September 2000; Volume 18.
Robinson J. Future subjunctive: Backcasting as social learning. Futures 2003; 35: 839-856.
Geurs K, Wee VB. Backcasting as a tool to develop a sustainable transport scenario assuming emission reductions of 80–90%. Innovations 2000; 13:47-62.
Dreborg KH. Essence of backcasting. Futures 1996; 28:813-828.
Borbely M, Muirhead JR, Graniero PA. Backcasting and forecasting biological invasions of inland lakes. Ecological Applications 2004; 14:773-783.
Baumgartner, R. Dealing with uncertainty—integrated sustainability assessment based on Fuzzy Logic Sustainable Development and Planning II; WIT Press: Billerica, MA, USA; 2006 Volumes 1, 2.
Law A, Kelton W. Simulation Modeling and Analysis, 3rd ed.; McGraw-Hill: New York, NY, USA; 2002.
Kempner R, Beck J, Petrie J. Design and analysis of bioenergy networks: a complex adaptive system approach. Journal of Industrial Ecology 2009; 13: 284-305.
Halog A, Sagisaka M, Inaba A. Modeling uncertainties in assessing waste gasification technology. MACRO Review Special Issue 2003; 16:251-255.
Huijbregts M. Dealing with parameter uncertainty and uncertainty due to choices in life cycle assessment. International Journal of Life Cycle Assessment 1998; 3:343-351.
Ford A. Modeling the Environment: An Introduction to System Dynamics Modeling of Environmental Systems; Island Press: Washington, DC, USA 1999; p3
North MJ, Collier NT, Vos JR. Experiences creating three implementations of the repast agent modeling toolkit. ACM Transaction on Modeling and Computer Simulation 2006; 16:1-25.
Miller J. Active nonlinear tests (ANTs) of complex simulation models. Management Science 1998; 44: 620-630.
Scholl H. Agent-based and system dynamics modeling: A call for cross study and joint research. http://projects.ischool. washington.edu/jscholl/Papers/DTABS01.PDF (accessed 16 February 2011). In Proceedings of 34th Annual Hawaii International Conference on System Sciences, Maui, HA, USA, 3–6 January 2011; 2011.