Target-driven indoor visual navigation using inverse reinforcement learning

Xitong Wang; Qiang Fang; Xin Xu

doi:10.1117/12.2581306

10 November 2020 Target-driven indoor visual navigation using inverse reinforcement learning

Xitong Wang, Qiang Fang, Xin Xu

Proceedings Volume 11584, 2020 International Conference on Image, Video Processing and Artificial Intelligence; 115841R (2020) https://doi.org/10.1117/12.2581306
Event: Third International Conference on Image, Video Processing and Artificial Intelligence, 2020, Shanghai, China

Abstract

Deep reinforcement learning has greatly simplified visual navigation by utilizing the end-to-end network training strategy. Unlike previous navigation methods which build upon high-precision maps, deep reinforcement learning-based method enables real-time navigation by only taking one image as input at a time. As such, deep reinforcement learning based navigation methods are applicable to a variety number of applications in robotics/vision communities, thanks to its light-weight computational cost. Despite the advantages, however, these methods still suffer from inefficient data exploration and poor convergence on network training. In this paper, we propose to use inverse reinforcement learning to solve the problem，which can provide more accurate and efficient guidance for decision-making. The proposed method is able to learn a more effective reward function from less training data. Experiments demonstrated that the proposed method achieves a higher success rate of navigation and produces paths that are more similar to the optimal ones compared to the reinforcement learning baselines.

Citation Download Citation

Xitong Wang, Qiang Fang, and Xin Xu "Target-driven indoor visual navigation using inverse reinforcement learning", Proc. SPIE 11584, 2020 International Conference on Image, Video Processing and Artificial Intelligence, 115841R (10 November 2020); https://doi.org/10.1117/12.2581306

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available