VIRTUAL INSTRUMENT PLAYING DEVICE AND METHOD BASED ON FINGER MOTIONS, ENABLING A USER TO PLAY A VIRTUAL INSTRUMENT WITHOUT USING A COMPUTER-HUMAN INTERFACE OR ATTACHING A SENSOR TO THE BODY OF THE USER

摘要

PURPOSE: A virtual instrument playing device and method based on finger motions are provided to enable a single or multiple users to play an instrument in any space with no physical instrument without constraints of space.;CONSTITUTION: A motion acquisition part(200) acquires information about finger motions of a user by processing image data acquired by an image acquisition part(100). A sound information simulation part(300) simulates and stores sound information of an instrument in accordance with a finger posture. A sound information configuration part(400) generates sound information of the instrument for the finger motions by using the acquired information about the finger motions and a neural network where learning is performed by the sound information simulation part.;COPYRIGHT KIPO 2013;[Reference numerals] (100) Image acquisition part; (200) Motion acquisition part; (300) Sound information simulation part; (400) Sound information configuration part; (500) Sound information output part; (600) Multiple motion management part