Translator Disclaimer
Presentation + Paper
9 October 2018 Scene text detection and recognition system for visually impaired people in real world
Author Affiliations +
Visually Impaired (VI) people around the world have difficulties in socializing and traveling due to the limitation of traditional assistive tools. In recent years, practical assistance systems for scene text detection and recognition allow VI people to obtain text information from surrounding scenes. However, real-world scene text features complex background, low resolution, variable fonts as well as irregular arrangement which make it difficult to achieve robust scene text detection and recognition. In this paper, a scene text recognition system to help VI people is proposed. Firstly, we propose a high-performance neural network to detect and track objects, which is applied to specific scenes to obtain Regions of Interest (ROI). In order to achieve real-time detection, a light-weight deep neural network has been built using depth-wise separable convolutions that enables the system to be integrated into mobile devices with limited computational resources. Secondly, we train the neural network using the textural features to improve the precision of text detection. Our algorithm suppresses the effects of spatial transformation (including translation, scaling, rotation as well as other geometric transformations) based on the spatial transformer networks. Open-source optical character recognition (OCR) is used to train scene texts individually to improve the accuracy of text recognition. The interactive system eventually transfers the number and distance information of inbound buses to visually impaired people. Finally, a comprehensive set of experiments on several benchmark datasets demonstrates that our algorithm has achieved an extraordinary trade-off between precision and resource usage.
Conference Presentation
© (2018) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Lei Fei, Kaiwei Wang, Shufei Lin, Kailun Yang, Ruiqi Cheng, and Hao Chen "Scene text detection and recognition system for visually impaired people in real world", Proc. SPIE 10794, Target and Background Signatures IV, 107940S (9 October 2018);


Adversarial camouflage for naval vessels
Proceedings of SPIE (September 19 2019)
Sign detection for autonomous navigation
Proceedings of SPIE (September 30 2003)
Lane detection using road planar information
Proceedings of SPIE (May 05 2011)
Low-cost asset tracking using location-aware camera phones
Proceedings of SPIE (September 07 2010)

Back to Top