Augmented Reality in AEC Industry

Abstract

One of a kind products, processes, and partner groups typically characterise the architecture, engineering, and construction (AEC) industry. This has led to a challenging industry environment with islands of automation, difficult communication between stakeholders, and increasing specialisation. Building information modelling (BIM) is a modern approach to building design, documentation, delivery, and lifecycle management that addresses many AEC challenges. The outcome of this process is a comprehensive building information model that encompasses all relevant data and information related to the construction process as well as the built asset. This model is a primary resource for diverse end-user applications, including augmented reality, that could be essential in bridging the gap between the virtual and physical worlds and has become a component of modern digital workflows within the AEC industry. This chapter provides an overview of AEC specifics and how those reflect in implementing augmented reality in the context of BIM processes. It also delves into the challenges that must be addressed to facilitate the widespread adoption of augmented reality technology in the AEC sector.

1. Introduction

The architecture, engineering, and construction (AEC) industry is known for its complexity and multi-faceted nature, involving designing, constructing, and managing unique and intricate structures. However, this complexity also brings numerous challenges, including fragmented automation, communication barriers between stakeholders, increased specialisation, and a lack of integration between the various phases of the construction process. To address these challenges and increase industry efficiency and productivity, building data modelling (BIM) [1] has become a transformative approach.

BIM involves creating and managing a digital representation of a building, called the building data model, which contains comprehensive data and information about the construction process (Figure 1) [2]. This digital model is a central repository (Common Data Environment – CDE [3]) of information that all stakeholders can access and use, enabling better collaboration, improved decision-making and streamlined project delivery. However, traditional methods of interacting with the building information model, such as 2D drawings or computer screens, limit the ability of stakeholders to fully grasp and understand the complex spatial relationships and intricacies of the design [4, 5].

Figure 1.

BIM enables communication, collaboration, and visualisation throughout the building life cycle.

Augmented reality technology (AR) has garnered significant attention and demonstrated transformative potential across various industries, including the AEC sector [6, 7]. AR involves superimposing virtual information onto the natural environment, enriching the user’s perception of the physical world by seamlessly integrating digital elements in real-time. In the AEC industry, AR empowers stakeholders to intuitively and immersively visualise and interact with building data models, effectively bridging the divide between the digital and real worlds (Figure 2).

Figure 2.

Bridging the gap between virtual reality (BIM model) and the natural environment.

The integration of augmented reality into the AEC sector presents a multitude of advantages and opportunities [8]. The theoretical explanation of augmented reality’s role can be illustrated through the concept of the meaning triangle (Figure 3) [9]. The concept refers to an abstract notion or idea within the mind, which correlates to a tangible object or referent in the real world. Conversely, the symbol functions as a visual or auditory representation that signifies or stands for the concept associated with the referent. The example provided demonstrates the establishment of a direct relationship between the referent-reference and referent-symbol (Figure 3). The first relationship is referred to as referencing, while the second is modelling. The relationship between the symbol and the object is complex as both exist external to the human mind. However, it can be asserted that constructing a building involves translating symbolic design representations (SYMBOL) into physical structures (OBJECT). Human interpretation of the symbols remains crucial until this translation can be carried out entirely by robots. Augmented reality facilitates this interpretation by overlaying the symbols onto real-world imagery. This technology surpasses traditional 2D plans, projections, and virtual reality by eliminating the separation between the symbolic and the real, with the human mind acting as the interface between the two.

Figure 3.

The meaning triangle.

It allows stakeholders to visualise and explore proposed designs in their intended physical context, enabling better spatial understanding and design validation. AR can help identify potential conflicts during the design phase, enabling early identification and resolution of issues. In addition, augmented reality can improve on-site construction activities by providing real-time guidance and visual aids, increasing accuracy and efficiency. It also has the potential to revolutionise building management and maintenance by overlaying information about physical components, enabling better asset management and maintenance planning. The prospect of augmented reality in the AEC industry is promising, but several challenges must be overcome for widespread adoption. Technical limitations such as accurate tracking and registration of virtual objects in the real world, interoperability and standardisation of data, cost-effectiveness, and user acceptance are significant hurdles. In addition, privacy and security concerns and a robust infrastructure to support the AR ecosystem are critical.

The chapter explores various user scenarios and applications of augmented reality in building data modelling and highlights the benefits, challenges, and potential solutions for successful implementation. By understanding the opportunities and limitations of augmented reality in the AEC industry, stakeholders can make informed decisions about its adoption, ultimately leading to improved collaboration, increased productivity, and the creation of sustainable and efficient building environments.

2. AEC specifics

The architecture, engineering, and construction industry differs in its products, processes, and teams. Unlike the manufacturing industry, which produces standardised goods, the AEC industry primarily involves constructing unique structures, such as buildings, bridges, and infrastructure projects. These products require customised design and construction approaches to meet specific customer requirements, local codes, and site conditions. Consequently, the AEC industry faces inherent challenges in complexity, coordination, and collaboration:

1. Unique project: Each project has unique requirements, site characteristics, and constraints, resulting in diverse architectural styles, building systems, and materials. This variety poses challenges for materials procurement, construction techniques, and project management, as the industry lacks economies of scale in mass production.

2. Unique processes: The AEC industry encompasses complex processes, from project development to construction and handover. Each construction project follows a unique workflow based on its specific characteristics and requirements. It involves multiple stakeholders, such as architects, engineers, contractors, suppliers, and regulatory agencies, which contribute their expertise throughout the project life cycle. Effective communication, collaboration, and coordination among multidisciplinary teams are essential for successful project delivery.

3. Unique teams: The AEC industry comprises diverse groups of professionals with diverse expertise and responsibilities. Architects prioritise aesthetics, functionality, and space planning, while engineers specialise in structural engineering and technical aspects. Contractors and subcontractors manage the construction process and ensure compliance with regulations. These multidisciplinary teams collaborate to achieve a cohesive project outcome. However, integrating different perspectives, resolving conflicts, and maintaining effective communication can be challenging due to the diverse nature of the groups involved.

The uniqueness of AEC projects, processes, and teams creates a challenging environment with islands of automation, fragmented information, and limited interoperability between stakeholders. Traditional paper-based documentation and manual coordination methods have proven insufficient to manage the complexity of the industry effectively. As a result, the AEC industry has recognised the need for innovative technologies and approaches to address these challenges and improve productivity, efficiency, and collaboration. BIM has emerged as a powerful tool to manage the complexity of unique AEC projects. It enables the creation of a digital representation of the building or infrastructure project, integrating various data and information into a central model. This approach facilitates collaboration, reduces errors, improves coordination, and allows stakeholders to visualise and analyse the project comprehensively and interactively. BIM promotes more efficient information sharing and supports seamless communication and integration between multidisciplinary teams.

The characteristics of the AEC industry, including the production of unique products, the implementation of customised processes, and the involvement of diverse teams, create inherent challenges. The industry has recognised these challenges and embraced innovative technologies, such as BIM, to manage complexity, improve coordination and increase project outcomes. Using advanced tools and methodologies, the AEC industry strives to streamline its processes, foster collaboration, and deliver high-quality, customised projects that meet the ever-evolving needs of clients and society.

3. AR implementation

Implementing AR systems in the AEC sector can be facilitated by adopting an OpenBIM approach. OpenBIM is a collaborative framework for creating and managing BIM data models across software platforms [10]. Integrating AR technology with OpenBIM improves collaboration, data interoperability, and project efficiency. OpenBIM emphasises open standards for data exchange, enabling seamless interoperability between software applications [11]. By adhering to OpenBIM principles, AR platforms can access and use BIM data from multiple sources without compatibility issues. This enhances visualisation and collaboration during design reviews, construction coordination, and facilities management. AR systems based on OpenBIM can be seamlessly integrated into existing BIM workflows. Stakeholders can link AR experiences to specific elements within the BIM model, providing context-specific information.

For example, on-site workers can view instructions or safety guidelines overlaid on physical elements in real-time, increasing productivity and reducing errors. OpenBIM encourages collaboration between disciplines and stakeholders throughout the project lifecycle. Integrating AR into an OpenBIM environment enables shared, immersive experiences. Users can visualise, annotate, and interact with the BIM model in real-time, regardless of location, leading to better coordination and decision-making. OpenBIM and AR systems provide scalability and flexibility. They support integrating multiple software applications and adapting to various hardware platforms and user preferences. This ensures adaptability to evolving technologies and project requirements. Combining AR with OpenBIM allows the capture and documentation of augmented experiences within the BIM model. Users can record AR annotations, instructions, or visualisations linked to specific elements. This facilitates information sharing, handover, and future maintenance and facility management activities.

OpenBIM, based on the Industry Foundation Classes (IFC) standard, can present challenges due to the need for consistent implementation across various BIM software providers. IFC, developed by buildingSMART, is an open file format that facilitates information exchange throughout the building life cycle. It enables seamless communication and data exchange between different software applications, regardless of the platform used. However, IFC has its limitations, including the complexity and size of IFC files, which can impact performance for large-scale projects. Inconsistencies and ambiguities in the standard can also lead to data inconsistencies and inaccuracies when exchanging information between software applications.

Many different AR systems follow the above approach: from independent open research systems AR [12] to AR systems that are part of complex shared data environments. Of course, there are clear advantages to using these integrated solutions, but one must also be aware of potential shortcomings, such as locking down data and users (Figure 4). The common data environment Dalux [13] was used for this research and testing, as this platform was chosen for the construction project. As with the AR system, there are many options for selecting devices for this purpose. The choice of a device can be based on many additional requirements or factors, such as whether the device is to be used on a construction site, whether it is to be used indoors or outdoors, whether it is a handheld device or a portable device, and whether it is price limited. This research used a handheld device (Samsung Galaxy Table S7 with 5G connectivity). The choice was not optimal, as seen from the description in the next section, but was justified because smart devices (phones, tablets) are accessible, always available, and offer good value for money.

Figure 4.

OpenBIM AR system architecture – (left) using general purpose AR viewers, (right) integrated solution, CDE with AR capabilities.

4. Use-case scenarios

As identified by different authors [14, 15], there are three main use-case scenarios for the use of AR within the BIM workflows, including: (1) design – enabling the review of proposed solutions (Figure 5), (2) construction – enabling efficient and effective construction progress monitoring [16], and (3) operation – assisting in building maintenance tasks (Figure 6) [17]. However, it should be noted that other use-case scenarios warrant consideration [18], for example, optimising layouts, conducting excavations, establishing precise positioning, performing inspections, coordinating tasks, supervising activities, and providing comments. For this research, the focus has been directed towards the construction phase, specifically monitoring construction progress. This use-case investigation aims to explore the potential implementation of AR technology within a selected mobile application for infrastructure projects characterised by extensive distances.

Figure 5.

Design phase – (left) visualising a future railway track and (right) a tunnel portal.

Figure 6.

Operation phase – (left) building maintenance accessing CDE and (right) AR visualisation using a smart device.

One of the most significant Slovenian infrastructure projects was used for this research. The complete project (managed by 2TDK d.o.o [19], Kolektor Koling d.o.o. [20] as one of the construction companies involved) includes the construction of more than 27 km of a railway line with eight tunnels (over 20 km in length), two viaducts (424 m and 630 m in length). The same project and construction site were also used by De Hugo Silva et al. [15] to assess the potential of the AR system in the design phase (Figure 7).

Figure 7.

One of the largest construction sites of the project.

One of the critical steps in setting up AR visualisation on-site includes positioning and scaling the model according to the natural environment (Figure 8). Specific requirements must be met to determine the exact geo-position regarding the BIM model [21]. Unfortunately, this requirement is not always met, representing a significant problem on long construction sites (roads, railways, tunnels).

Figure 8.

The critical step in setting up AR visualisation – positioning and scaling the BIM model.

In order to evaluate the use case, a tablet computer with Dalux mobile application was used at two separate locations, which were a few kilometres apart. The two locations were georeferenced in the tablet’s 2D model, and the relevant information from the 3D model was successfully connected, enabling the visualisation of interactive BIM models directly at the location (Figure 9) [22, 23] through the implementation of AR technology. The accompanying images showcase the capability to assess railway installations and track the progress of retaining wall construction according to the planned schedule. Furthermore, AR visualisation proved valuable in comprehending the construction site’s overall scale and intricate nature.

Figure 9.

Construction phase – (left) construction site view of retaining wall and railway line, (right) AR view of the planned construction.

Key insights from the analysis include: (1) accurate georeferencing of all BIM models is crucial for their effective utilisation within AR systems, (2) bright environments present challenges when using tablets/phones for AR applications, (3) field orientation and precise positioning and scaling of BIM models can be challenging, (4) AR can provide a valuable tool for gaining an insight of the construction site, and (5) integrated Dalux solution enables the use of AR in practice.

5. Conclusions

The primary focus of this chapter centres on use-case scenarios highlighted by researchers and practitioners in the AEC industry. With the widespread adoption of BIM methodology as the standard [24] for managing construction projects, coupled with the general digitisation of processes and workflows in the AEC industry, there is an opportunity to leverage advanced information and communication technologies, including augmented reality, to enhance AEC workflows characterised by unique products, processes, and teams. It is important to note that the intention is not to assert the superiority or exclusivity of AR over other technologies but rather to highlight its complementary role in managing the lifecycle of a building. An area where AR demonstrates significant potential is in education, as it can generate interest in engineering studies among younger generations. AR facilitates effective communication and decision-making among project stakeholders by enabling instant visualisation. As noted by Wang et al. [25], AR technology inherently facilitates the interaction between real-world and virtual information sources. Within BIM technology, AR allows designers to situate virtual blueprints in a natural environment, provides owners with immersive and interactive experiences, and enables vendors to communicate with different stakeholders effectively.

Table 1 presents the SWOT analysis for integrating augmented reality into BIM workflows, taking into account the AEC specifics discussed earlier, as well as the use cases and key insights from the practical implementation of the technology across various construction sites.

Strengths	Weaknesses
Enhanced visualisation Gain a comprehensive visual representation Adjust the object’s scale within the application On-site support and guidance Improved collaboration and communication	Challenges in accurately placing objects within the natural environment Limitations of mobile devices impacting the quality of results Issues related to transferring large amounts of data Lack of integration with BIM modellers
Opportunities	Threats
Facilitated knowledge acquisition and transfer Enhanced validation of designs Advancements in BIM modelling Different specialised applications Real-time remote interaction Utilisation in maintenance and facility management	Considerations regarding cost and accessibility Unavailability of a 3D BIM model Absence of necessary information Presence of incorrect information Factors influencing user acceptance and adoption Concerns related to privacy and security

Table 1.

SWOT analysis of augmented reality in BIM.

Based on the SWOT analysis, it can be inferred that augmented reality in the AEC sector offers notable strengths in enhanced visualisation, improved collaboration, and on-site support. However, several challenges, such as technical limitations, data interoperability, cost implications, and user acceptance, must be addressed effectively. By leveraging the opportunities presented by augmented reality, such as improved design validation, enhanced client engagement, and streamlined maintenance processes, successful integration within the AEC sector can lead to increased productivity, better project outcomes, and improved operational efficiency.

The AEC industry is currently grappling with a significant scarcity of qualified engineers, which poses obstacles to project delivery and industry growth. The demand for engineering expertise often surpasses the available pool of skilled professionals, resulting in increased workloads, extended project timelines, and compromised quality. Augmented reality technology has the potential to alleviate this challenge by enhancing the capabilities of existing engineers and empowering less experienced individuals to acquire new skills and knowledge.

Future research endeavours should primarily focus on three key areas. Firstly, there is a need for a better understanding of information transfer processes to determine which tasks could derive the most benefit from AR technology. Additionally, improvements in software solutions are essential to facilitate seamless integration and maximise the potential of augmented reality in the AEC industry. Lastly, there is a requirement to gain a deeper understanding of the information requirements in BIM models. Exploring alternative information flows would be an intriguing avenue for further investigation.

Acknowledgments

The presented research supported the Slovenian Research Agency research program E-construction (E-Gradbeništvo): P2-0210. Their support is gratefully acknowledged.

The author also wishes to thank Metod Gaber, Kolektor d.d. for his support and the 2TDK d.o.o. company for access to the construction sites and for using BIM models in this research.

Conflict of interest

The authors declare no conflict of interest.