Fusion of millimeter wave radar and RGB-depth sensors for assisted navigation of the visually impaired

Ningbo Long; Kaiwei Wang; Ruiqi Cheng; Kailun Yang; Jian Bai

doi:10.1117/12.2324626

5 October 2018 Fusion of millimeter wave radar and RGB-depth sensors for assisted navigation of the visually impaired

Ningbo Long, Kaiwei Wang, Ruiqi Cheng, Kailun Yang, Jian Bai

Proceedings Volume 10800, Millimetre Wave and Terahertz Sensors and Technology XI; 1080006 (2018) https://doi.org/10.1117/12.2324626
Event: SPIE Security + Defence, 2018, Berlin, Germany

Abstract

According to the data from the World Health Organization, 285 million people are estimated to be visually impaired worldwide, and 39 million are blind. It is very difficult for visually impaired people to perceive and avoid obstacles at a distance during their travelling. To address this problem, we propose a sensor fusion system, which combines the RGBDepth sensor and millimeter wave radar sensor, to detect the surrounding obstacles. The range and velocity of multiple obstacles are acquired by the millimeter wave radar based on the principle of frequency modulated continuous wave. The positions of the obstacles are verified by the RGB-Depth sensor based on the contour extraction and MeanShift algorithm. The data fusion algorithm based on particle filters obtains accurate state estimation by fusing RGB-Depth data with millimeter wave radar data. The experiment results show that multiple obstacles with different ranges and angles are successfully detected by the proposed system. The measurement uncertainties are reduced by the data fusion system, meanwhile the effective detectable range is expanded compared to the detection with only RGB-Depth sensor. Moreover, the measurement results are stable when the illumination varies. As a wearable prototype, the sensor fusion system has the characteristics of versatility, portability and cost-effectiveness, which is very suitable for blind navigation application.

Conference Presentation

Citation Download Citation

Ningbo Long, Kaiwei Wang, Ruiqi Cheng, Kailun Yang, and Jian Bai "Fusion of millimeter wave radar and RGB-depth sensors for assisted navigation of the visually impaired", Proc. SPIE 10800, Millimetre Wave and Terahertz Sensors and Technology XI, 1080006 (5 October 2018); https://doi.org/10.1117/12.2324626

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available