Development of air touch interface for floating 3D image in the air

摘要

We developed a prototype virtual air touch interface system for interaction in the virtual 3D space. The spatial imaging display system provides the observer virtual 3D objects. These 3D images are floating in the air and one can directly touch objects or virtual images. To take mutual action we need to prepare the interface system which can recognize that the user moves his hand near the virtual objects. Because a conventional touch-panel system detects the user's operation on the display screen but the touching point differs from the actual displaying space, it is important to realize that the user can operate at the same space. A typical method is to use the computer vision. In this paper, the authors propose the interface system using a theremin which is a musical instrument having the unusual aspect of being controlled by the performer's hand motions near the antennas.