Research into virtual environments that allow for narrative simulations that address the complexity of working underground has been constrained by its ability to create adequately realistic and immersive scenarios.
iCASTS听is a world-first fully immersive and audio-visually realistic environment that allows for the recreation of complex underground mining scenarios. It provides a platform for research into prototyping the types of narrative and visualisation that can aesthetically address the multi-faceted nature of underground technology and mining events. Combining a unique visual interaction design and industrial grade custom wireless keyboard interface, it allows up to 30 users to navigate through seven kilometres of an underground 360 degree tunnel labyrinth and interact with a large number of scenarios.
The significance of the system is attested by: a) exhibition at听APPEA听Conference, Australia鈥檚 leading Oil and Gas industry exposition; b) winner of the world leading Gold听IDEA听award for interactive design, 2009 (USA), the judges noting 鈥淎 thoughtful approach to immersive learning鈥 The potential applications are a class apart"; and c) cited 15 times in major news reports including听BBC.
In 2008, iCASTS鈥 suite of VR simulations and platforms were commercialised for the Australian Coal Services Pty Ltd for $7.2M as a permanent training simulator housed in custom-designed facilities across five sites, using the听AVIE, AVIE_SC and iDOME visualisation platforms.
iCASTS 鈥撎鼵CTEG听was adapted in 2013 and developed for the Shenyang Research Institute of China Coal Technology & Engineering Group (CCTEG) for a $1M commercialisation. Designed in collaboration with local architects, builders, designers, mine engineers and project managers, it saw extensive on-site consultation, installation and post-installation testing and facilitation in Fushun ensured implementation of a custom fit-out. The adaptation of the system delivered highly realistic 3D models of a customised underground mine environment in which a wide range of hazard and technology scenarios could be simulated.
Project Details
Key characteristic differentiators for this iCinema technology include:
- A range of 360 degree immersive projection platforms
- Capability to be interactively used by groups rather than just one person at a time (a limitation of head-mounted display VR solutions)
- Unprecedented level of realism and immersion
- Trainees can recognise and train in their own mine environments
- Continual build-up of a database of actual mine layouts
- Image as opposed to text-based training delivers potential to be easily adapted for overseas operations such as in China or Latin America
The interaction device was developed with assistance by Tiller Design, a professional product development team. It consists of a central control console and a 3D inertia hand-held wand that allows the user to navigate and travel through virtual environments as well as control physical environmental attributes such as lighting, sound and playback of a simulation. Both console and wand are intuitive, immediately accessible but importantly do not distract from the virtual environment experience. The wand allows the user to interact directly with the environment by selecting items, moving objects, and simulating basic tasks that would be done in the real-world environment. The console gently removes itself from the environment by lowering the lighting and brightness of controls depending on the status of the training program. Together, the console-wand combination provides an ergonomically pleasant interactive experience.
Initial introduction to the immersive environment through the virtual reality training scenarios is an uncanny realistic experience. Driving along in an underground mine vehicle, for instance, you can see in all directions as in real vision simply depending on where you look. You feel you can reach out and touch the roof bolts. You can manoeuvre past static vehicles or walk up to operating continuous miners. And in the process, you can interactively learn where you should or should not go 鈥 and to recognise signs of danger in particular situations.
Similarly, in an open-cut simulated environment at the wheel of a giant haul truck, you can learn to manoeuvre beside an electric shovel for loading and be alert to how easy it is to miss spotting people or personnel vehicles from a driving position several metres high.
These virtual experiences enable users to begin to visualise and recognise complex mining situations, to build up knowledge of procedures and skills and to undergo training in a safe and forgiving environment.
iCASTS听is currently utilised in four locations nationally and one location in China.
Dr Phil Stothard, Chairman of the International Mining VR Group and Senior Research Fellow at the听麻豆社madou听School of Mining Engineering, is responsible for creating the interactive group-based virtual reality training scenarios for Coal Services that will run on the iCAST systems. 鈥溌槎股鏼adou听and听CSPL听are leading the world in this field,鈥 he said. 鈥淭here is no question that these technologies have the potential to save lives and their full potential will be fully realised through further domestic and international collaboration.鈥
Use of these systems provides mines with key cost savings in addition to their ability to provide enhanced safety training:
- It allows training to take place at any time of day.
- It reduces down-time on taking equipment out of production for training purposes.
- This reduces training impact on production levels.
- Enables faster start-up with better prepared staff
- Being highly familiar with equipment and its operation through the training simulation means that operators are far less likely to damage multi-million dollar equipment once they start in the actual operating environment 鈥 a huge saving on maintenance and repair.
- Improved knowledge and skills reduce injuries and increase productivity.
- Improved risk assessment tools
- Improved competency increases staff morale
- Workforce has high level of competence before entering real environment
- Maintains a record of personal assessment and achievements
- Identifies deficiencies in personnel training without risk
- Trains away unsafe practices
- The progressive improvement of the technology and delivery of novel interactive content continues through interfaculty collaborative research.
- Overview
- Exhibition
- Credits
Project Directors:听Dennis Del Favero, Jeffrey Shaw
Programmers: Matthew McGinity, Ardrian Hardjono, Jared Berghold, Alex Kuptsov, Marc Chee, Robin Chow, Xin Guan
Project Funding:听麻豆社madou听University Capital Infrastructure Grants Scheme,听麻豆社madou听School of Mining Engineering
2008-2013
- Shenyang Research Institute, Fushun, 2012
- APPEA听Conference, Convention & Exhibition Centre, Brisbane, 2010
- Mines Rescue Pty Ltd Australian Facilities in Woonona, Argenton, Lithgow & Singleton, 2008
- Simulation 鈥 Maximising Organisational Benefits at the SimTech Conference, Convention & Exhibition Centre, Melbourne, 2008
Project Directors:听Dennis Del Favero, Jeffrey Shaw
Lead Software Engineer:听Matthew McGinity
Software and Hardware Engineering:听Ardrian Hardjono, Jared Berghold, Alex Kuptsov, Marc Chee, Robin Chow, Xin Guan
Project Co-ordination and Management:听Damian Leonard, Ardrian Hardjono, Volker Kuchelmeister, Densan Obst, Kate Dennis, Sue Midgley, Joann Bowers
This project was financially supported under the听麻豆社madou听University Capital Infrastructure Grants Scheme:听AVIE听and the听麻豆社madou听School of Mining Engineering