WIKNECTVR: A Gesture-Based Approach for Interacting in Virtual Reality Based on WIKNECT and Gestural Writing

摘要

In recent years, the usability of interfaces in the field of Virtual Realities (VR) has massively improved, so that theories and applications of multimodal data processing can now be tested more extensively. In this paper we present an extension of VANNOTATOR, which is a VR-based open hypermedia system that is used for annotating, visualizing and interacting with multimodal data. We extend VANNOTATOR by a module for gestural writing that uses data gloves as an interface for VR. Our extension addresses the application scenario of WikiNect, a museum information system, and its gesture palette for realizing gestural writing. To this end, we implement and evaluate seven gestures. The paper describes the training and recognition of these gestures and their use within the framework of a user-centered evaluation system for virtual museums as exemplified by WIKINECT.