Cross-sectional display system using AR (augmented reality), VR (virtual reality), and MR (mixed reality) for 3D x-ray CT inspection

Hiroki Kase; Junichi Nishizawa; Kento Tabata; Katsuyuki Takagi; Toru Aoki

doi:10.1117/12.2663569

12 June 2023 Cross-sectional display system using AR (augmented reality), VR (virtual reality), and MR (mixed reality) for 3D x-ray CT inspection

Hiroki Kase, Junichi Nishizawa, Kento Tabata, Katsuyuki Takagi, Toru Aoki

Author Affiliations +

Proceedings Volume 12538, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications V; 125381T (2023) https://doi.org/10.1117/12.2663569
Event: SPIE Defense + Commercial Sensing, 2023, Orlando, Florida, United States

Conference Poster

Abstract

Demand for 3D X-ray CT inspection (in the medical, nondestructive testing, and security fields) is increasing year by year, and AR (Augmented Reality), VR (Virtual Reality), and MR (Mixed Reality) are being used for displaying internal structure of object. Although, these applications can display surface-rendered or volume-rendered objects, but have not been developed to accurately represent and spatially help the observer understand the point he or she wants to see. In this research, the representation method and system were proposed that 2D image output from DICOM is superimposed on the cross-section of a surface-rendered model, and by using a motion sensor, an object imaged with a 3D X-ray CT can be freely manipulated in the virtual space using the human hand, just as if the object were actually moved in real space, so the cross-section of the point to be checked can be viewed in any direction. By using the stencil buffer function, a shader function on Unity, unnecessary areas other than the cross-section can be hidden, so the object itself is not hidden in the 2D image. This system can be performed with either spatial reality display, VR device, or AR glasses. The results show that the proposed method is effective as a useful 3D representation in 3D X-ray CT, which is voxel data containing internal information, and as a method that allows viewing tomographic images in CT images and easily representing specific locations.

Citation Download Citation

Hiroki Kase, Junichi Nishizawa, Kento Tabata, Katsuyuki Takagi, and Toru Aoki "Cross-sectional display system using AR (augmented reality), VR (virtual reality), and MR (mixed reality) for 3D x-ray CT inspection", Proc. SPIE 12538, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications V, 125381T (12 June 2023); https://doi.org/10.1117/12.2663569

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available