Case studies: the metaverse in the mining industry 

Concept:

Canadian start-up Arvizio in partnership with mining software company Sight Power has launched an AR-powered integrated suite for mining operations. It encompasses mining data, 3D models, and LiDAR scans that are to be shared between Arvizio’s Immerse 3D AR solution and Sight Power’s Digital Mine spatial enterprise system. The duo aims to optimise the mining process by reducing costs, increasing productivity, improving efficiencies, and enhancing safety.

Nature of disruption:

Sight Power’s Digital Mine is a system that collects and analyses information about operations and work processes in the mining sector. It combines the data with modelling, monitoring, and distributed sensor systems to provide geologists, mine surveyors, and mining engineers with a solution to automate routine operations, increasing labour productivity and minimising errors. The Arvizio Immerse 3D solution is an AR platform that allows users to optimize and share 3D models and point clouds on multiple mobile devices and headsets. It incorporates documents, photos, and other project data into the AR experience without the need for customised application software. It leverages web meeting platforms like Microsoft Teams and Zoom to execute planning and review sessions of CAD, BIM, and other 3D model formats and visualise AR digital twins using mobile devices and mixed reality headsets. Through the integrated suite, Arvizio Immerse 3D allows users to visualise Digital Mine’s 3D models and LiDAR scans in AR. Its hybrid rendering and advanced model optimisation features help visualise LiDAR scans and geological models from mining operations that might span across several kilometres and contain multiple layers. Furthermore, it expands the Digital Mine system's capabilities by including multi-user, multi-location AR visualisation, and synchronised session collaboration utilising web-based meeting platforms. Additional benefits of the Immerse 3D platform extension include staff training and equipment repair support, an extension of digital twin capabilities for processing plants, continuous evaluation of mine evolution models, and virtual presence at mining sites in real-time. 

Outlook:

In recent years, AR has emerged as an essential component for the incorporation and visualisation of mine planning data across operations, design, planning, resource management, and investor relations activities. Arvizio and Sight power aim to provide stakeholders across the globe with a tool to optimise the mining process, thereby minimising costs, increasing productivity, improving efficiency, and enhancing safety.

Concept:

Tokyo-based steel manufacturing company JFE Steel has incorporated advanced mixed reality (MR) technology into its training simulator installed at its West Japan Works plant. The technology is used to train workers at their plant for developing their steel-mill skills.

Nature of disruption:

JFE Steel uses MR technology to generate a training environment that combines the trainee’s real-world body movements with highly realistic computer-generated virtual factory floors. The training simulator allows employers to provide hands-on training for young workers to help them experience the equipment operations under normal and abnormal conditions. The trainees can move equipment in the 3D space, which enables them to operate actual switches to perform certain operations. It replicates the actual working environment and adds various abnormal scenarios to allow employees to learn how to handle unexpected events quickly and effectively. The MR system reduces the operational and safety risks of traditional training by enabling trainees to practice riskier tasks including volume adjustment of molten steel that is poured into a continuous casting machine under high temperature.

Outlook:

New employees need to be provided on-the-job training to develop their skill sets, whereas employers find it difficult to train their employees for processes involving high risk.  JFE introduced MR technology in virtual training environments to eliminate real-world risks for tasks that require hands-on experience. JFE Steel plans to deploy the simulator at all its steelworks and manufacturing sites. Additionally, JFE steel under its digital transformation (DX) strategy has started adopting digital technologies to increase operational productivity, and the MR training simulator is one of its initiative.

Concept:

Indian start-up Fusion VR has developed a customised end-to-end virtual reality (VR) solution for the mining sector. It furnishes visualisation of the mining environment in a 3D VR space and utilises VR training simulators to provide scenario-based, experiential learning to workers, engineers, and technicians.

Nature of disruption:

The VR solution leverages radar, LiDAR, optical stereophotogrammetry, or electromagnetic survey to create 3D visualisation of geospatial digital elevation models that are overlaid in multiple layers inside the 3D VR space. Stereo photogrammetry estimates the 3D coordinates of the mining area using measurements made from two or more photographic images taken at different angles. The solution enables operators, workers, and managers to explore the mining site virtually, helping them make informed decisions related to production operations, mining exploration, and excavation. Besides this, the solution offers virtual training that allows mining engineers and workers to practice their skills before entering the site physically. It enhances their productivity and improves their ability to handle emergencies, thereby reducing the probability of human errors, shutdowns, equipment damage, and downtime. It also helps capture the key-performance indicators (KPI) of employees while fulfilling training and certification objectives.

Outlook:

Mining operations involve several challenges such as production issues, improper maintenance, regulatory violations, and worker safety. Inability to meet the challenges might result in decreased productivity, increased costs, and reduced sustainability. Fusion VR intends to provide a VR-based solution that would enable users to assess the mining environment, monitor operations and activities, and train the workforce without compromising on safety. Furthermore, it would allow mining companies to enhance regulatory compliance, streamline mining workflow, improve safety, and increase industry reputation.

Concept:

Brazil’s mining company Vale has collaborated with Canada’s non-profit training solutions provider NORCAT to develop a ‘blended learning program’ for the training and education of miners. The virtual and augmented reality-based platform will provide an immersive experience and help miners to upskill.

Nature of disruption:

NORCAT offers in-person and online proprietary skilled labour training and development programs to enhance the safety and productivity of workers in mining industry, occupational health and safety services. It offers industry-specific common core programs including Hardrock miner, forestry, and basic mills as well as simulation training to assist miners in operating mining equipment such as forklifts, utility vehicles in a simulated, safe and secure environment. The AR and VR-powered tool leverages new methods of delivering equipment maintenance and operating training by providing virtual exercises. The technology-based approach can help Vale to improve safety, efficiency and productivity in mine training operations.

Outlook:

The global mining industry is going through a shift in terms of a technology-driven approach to upskill workers. A trend of embracing experiential learning technologies like alternative reality is gaining traction. Using NORCAT’s AR and VR-based learning and development program, companies in the mining, forestry and construction industries can optimise operational efficiency and maximise workforce safety.