Natural user interface as a supplement of the holographic Raman tweezers

Zoltan Tomori; Jan Kanka; Peter Kesa; Petr Jakl; Mojmir Sery; Silvie Bernatova; Marian Antalik; Pavel Zemánek

doi:10.1117/12.2061024

16 September 2014 Natural user interface as a supplement of the holographic Raman tweezers

Zoltan Tomori, Jan Kanka, Peter Kesa, Petr Jakl, Mojmir Sery, Silvie Bernatova, Marian Antalik, Pavel Zemánek

Proceedings Volume 9164, Optical Trapping and Optical Micromanipulation XI; 91642P (2014) https://doi.org/10.1117/12.2061024
Event: SPIE NanoScience + Engineering, 2014, San Diego, California, United States

Abstract

Holographic Raman tweezers (HRT) manipulates with microobjects by controlling the positions of multiple optical traps via the mouse or joystick. Several attempts have appeared recently to exploit touch tablets, 2D cameras or Kinect game console instead. We proposed a multimodal “Natural User Interface” (NUI) approach integrating hands tracking, gestures recognition, eye tracking and speech recognition. For this purpose we exploited “Leap Motion” and “MyGaze” low-cost sensors and a simple speech recognition program “Tazti”. We developed own NUI software which processes signals from the sensors and sends the control commands to HRT which subsequently controls the positions of trapping beams, micropositioning stage and the acquisition system of Raman spectra. System allows various modes of operation proper for specific tasks. Virtual tools (called “pin” and “tweezers”) serving for the manipulation with particles are displayed on the transparent “overlay” window above the live camera image. Eye tracker identifies the position of the observed particle and uses it for the autofocus. Laser trap manipulation navigated by the dominant hand can be combined with the gestures recognition of the secondary hand. Speech commands recognition is useful if both hands are busy. Proposed methods make manual control of HRT more efficient and they are also a good platform for its future semi-automated and fully automated work.

Citation Download Citation

Zoltan Tomori, Jan Kanka, Peter Kesa, Petr Jakl, Mojmir Sery, Silvie Bernatova, Marian Antalik, and Pavel Zemánek "Natural user interface as a supplement of the holographic Raman tweezers", Proc. SPIE 9164, Optical Trapping and Optical Micromanipulation XI, 91642P (16 September 2014); https://doi.org/10.1117/12.2061024

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available