A multi-sensor fusion framework for improving situational awareness in demanding maritime training

Real offshore operational scenarios can involve a considerable amount of risk. Sophisticated training programmes involving specially designed simulator environments constitute a promising approach for improving an individual's perception and assessment of dangerous situations in real applications. One of the world's most advanced providers of simulators for such demanding offshore operations is the Offshore Simulator Centre AS (OSC). However, even though the OSC provides powerful simulation tools, techniques for visualising operational procedures that can be used to further improve Situational awareness (SA), are still lacking. Providing the OSC with an integrated multi-sensor fusion framework is the goal of this work. The proposed framework is designed to improve planning, execution and assessment of demanding maritime operations by adopting newly-designed risk-evaluation tools. Different information from the simulator scene and from the real world can be collected, such as audio, video, bio-metric data from eye-trackers, other sensor data and annotations. This integration is the base for research on novel SA assessment methodologies. This will serve the industry for the purpose of improving operational effectiveness and safety through the use of simulators. In this work, a training methodology based on the concept of briefing/debriefing is adopted based on previous literature. By using this methodology borrowed from similarly demanding applications, the efficiency of the proposed framework is validated in a conceptual case study. In particular, the training procedure, which was previously performed by Statoil and partners, for the world's first sub-sea gas compression plant, in Aasgard, Norway, is considered and reviewed highlighting the potentials of the proposed framework.