Translator Disclaimer
17 February 2011 Multimodal sensing-based camera applications
Author Affiliations +
Proceedings Volume 7881, Multimedia on Mobile Devices 2011; and Multimedia Content Access: Algorithms and Systems V; 788103 (2011)
Event: IS&T/SPIE Electronic Imaging, 2011, San Francisco Airport, California, United States
The increased sensing and computing capabilities of mobile devices can provide for enhanced mobile user experience. Integrating the data from different sensors offers a way to improve application performance in camera-based applications. A key advantage of using cameras as an input modality is that it enables recognizing the context. Therefore, computer vision has been traditionally utilized in user interfaces to observe and automatically detect the user actions. The imaging applications can also make use of various sensors for improving the interactivity and the robustness of the system. In this context, two applications fusing the sensor data with the results obtained from video analysis have been implemented on a Nokia Nseries mobile device. The first solution is a real-time user interface that can be used for browsing large images. The solution enables the display to be controlled by the motion of the user's hand using the built-in sensors as complementary information. The second application is a real-time panorama builder that uses the device's accelerometers to improve the overall quality, providing also instructions during the capture. The experiments show that fusing the sensor data improves camera-based applications especially when the conditions are not optimal for approaches using camera data alone.
© (2011) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Miguel Bordallo López, Jari Hannuksela, J. Olli Silvén, and Markku Vehviläinen "Multimodal sensing-based camera applications", Proc. SPIE 7881, Multimedia on Mobile Devices 2011; and Multimedia Content Access: Algorithms and Systems V, 788103 (17 February 2011);

Back to Top