Real-time video stitching based on ORB features and SVM

Ruifeng Yuan; Ming Liu; Mei Hui; Yuejin Zhao; Liquan Dong; Lingqin Kong; Zhi Cai

doi:10.1117/12.2320032

17 September 2018 Real-time video stitching based on ORB features and SVM

Ruifeng Yuan, Ming Liu, Mei Hui, Yuejin Zhao, Liquan Dong, Lingqin Kong, Zhi Cai

Proceedings Volume 10752, Applications of Digital Image Processing XLI; 107521A (2018) https://doi.org/10.1117/12.2320032
Event: SPIE Optical Engineering + Applications, 2018, San Diego, California, United States

Abstract

Real-time video stitching, which is used to obtain a large field video by some small field cameras, has great significance in real life. The existing video mosaic method based on SIFT features and RANSAC algorithm takes too much time in the processing of the first frame image, and the transformation matrix will have large errors when the number of the feature points matched correctly is small. In this paper, a real-time video stitching method based on ORB features and support vector machine (SVM) using binocular cameras is proposed. Firstly, the distortion of the cameras is corrected. Secondly, the ORB features in the overlapped regions of the first two frame images are extracted. Each pair of the feature points matched is filtered through the pre-trained SVM model. The matching calculation is terminated after 4 pairs of feature points are obtained and the transformation matrix can be calculated. Finally, the video stitching result can be obtained by image registration. The experiments show that the real-time seamless wide-field video can be obtained, and the first frame processing time of this method is much shorter than the other methods available, the frame frequency is 30fps.

Conference Presentation

Citation Download Citation

Ruifeng Yuan, Ming Liu, Mei Hui, Yuejin Zhao, Liquan Dong, Lingqin Kong, and Zhi Cai "Real-time video stitching based on ORB features and SVM", Proc. SPIE 10752, Applications of Digital Image Processing XLI, 107521A (17 September 2018); https://doi.org/10.1117/12.2320032

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available