Visual SLAM algorithm based on semantic information and IMU fusion in dynamic scenes

Feiyang Xiao; Lin Xu; Yifu Shi; Kaiqi Zhao; Wenjie Ni

doi:10.1117/12.3024194

14 February 2024 Visual SLAM algorithm based on semantic information and IMU fusion in dynamic scenes

Feiyang Xiao, Lin Xu, Yifu Shi, Kaiqi Zhao, Wenjie Ni

Proceedings Volume 13018, International Conference on Smart Transportation and City Engineering (STCE 2023); 130184V (2024) https://doi.org/10.1117/12.3024194
Event: International Conference on Smart Transportation and City Engineering (STCE 2023), 2023, Chongqing, China

Abstract

Visual SLAM algorithms usually assume that objects in the environment are static or low-motion, and perform poorly in dynamic scenes due to the influence of dynamic objects. To address this issue, this paper proposes a SLAM algorithm based on semantic information and IMU fusion. This algorithm is an improvement based on the ORB-SLAM2 framework. Firstly, we use the real-time instance segmentation model YOLACT to identify potential dynamic objects in the image frame, and then further detects and identifies dynamic objects to eliminate dynamic feature points. Secondly, an extended Kalman filter motion model is established. The camera pose is calculated using IMU data that is not affected by the environment, and then fused with the pose calculated based on visual information to further reduce the adverse effects of the dynamic environment. Experiments show that when this algorithm is running in a dynamic scene, compared to pure visual SLAM algorithms, our algorithm has greatly improved accuracy and robustness.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Feiyang Xiao, Lin Xu, Yifu Shi, Kaiqi Zhao, and Wenjie Ni "Visual SLAM algorithm based on semantic information and IMU fusion in dynamic scenes", Proc. SPIE 13018, International Conference on Smart Transportation and City Engineering (STCE 2023), 130184V (14 February 2024); https://doi.org/10.1117/12.3024194

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available