In this article, a hybrid type of virtual keyboard with multimodal feedback using a physical tabletop (or any hard plane around the user) is proposed. A user, wearing a VR Head-Mounted-Display (HMD), sees a keyboard in the given virtual world. Tracking his/her finger’s motion on the tabletop, the proposed system determines the key pressed by him/her and gives multimodal feedback to him/her. A pair of changing colors and playing sounds are given to the user as visual and audio feedback, in conjunction with physical tactile feedback from the tabletop. The system is expected to improve performance of keyboard input in the virtual environment.
|