Integration and use of an AR display in a maritime helicopter simulator

Christian Walko; Niklas Peinecke

doi:10.1117/12.2520142

1 May 2019 Integration and use of an AR display in a maritime helicopter simulator

Christian Walko, Niklas Peinecke

Proceedings Volume 11019, Situation Awareness in Degraded Environments 2019; 1101905 (2019) https://doi.org/10.1117/12.2520142
Event: SPIE Defense + Commercial Sensing, 2019, Baltimore, MD, United States

Abstract

Operating a helicopter in off-shore wind parks in DVE from clouds or fog can endanger crew and material due to the presence of unseen obstacles. Utilizing on-board sensors like Lidar or radar one can sense and record obstacles that could be potentially dangerous. One major challenge is then to display the resulting raw sensor data in a way that the crew, especially the pilot can make use of without distracting them from their actual task. Augmented and mixed reality applications are thought to play an important role here. By displaying the data in a see-through helmet mounted display (HMD) the pilot can be made aware of obstacles that are currently obscured by degraded visual conditions or even parts of the own helicopter. This can be accomplished in one HMD. No attention sharing between the outside view and a headdown instrument is necessary. DLR is continuously aiming at testing and evaluating both flight-proof and consumer grade HMDs. One particular widely known system is the Microsoft HoloLens. DLR will integrate this low-cost HMD into their test helicopter ACT/FHS. For this, as a first step a Microsoft HoloLens was integrated into DLR's simulator AVES. In this paper the integration process is detailed. The simulation capabilities are described, especially for conformal, open-loop Lidar sensor data. Furthermore, first concepts of the display format are shown, and strengths and drawbacks of the HoloLens in a cockpit environment are discussed.

Citation Download Citation

Christian Walko and Niklas Peinecke "Integration and use of an AR display in a maritime helicopter simulator", Proc. SPIE 11019, Situation Awareness in Degraded Environments 2019, 1101905 (1 May 2019); https://doi.org/10.1117/12.2520142

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available