MULTI-MODAL GESTURE BASED INTERACTIVE SYSTEM AND METHOD USING ONE SINGLE SENSING SYSTEM

摘要

Multi-mode gesture-based interaction system and method using a single detection system Disclosed herein are methods and systems for providing natural multi-mode gesture-based interaction that is effective and complementary to a computational system that displays visual feedback information on a graphical user interface on the interaction surface (120). The interaction surface 120 is within the frustum of an imaging device that includes a single sensing system 170 . both a touch gesture interaction with the interaction surface 120 and a three-dimensional touchless gesture interaction in an area or volume 230a, 230b above the interaction surface 120 performed by the user's hand 240a, 240b. A single detection system 170 that detects all of them is used. Both types of interactions are contextually coupled with interactive commands that control the computational system when a gesture is detected. Preferably, the system includes a projection system 160 that displays a graphical user interface and visual feedback on the interactive surface 120 , the projection system comprising the interactive surface 120 relative to the sensing system 170 . may be placed on the same side of or on the opposite side of