METHOD AND SYSTEM FOR SOUND SOURCE LOCALIZATION USING IMAGE INFORMATION AND STORAGE MEDIUM STORING PROGRAM TO REALIZE THE METHOD

摘要

PROBLEM TO BE SOLVED: To provide a method and a system for sound source localization where an image with monaural sound is automatically converted into an image with stereophonic sound and no sense of incongruity is caused in positional relation between the image and the sound source in a panorama image or the like. ;SOLUTION: In this sound source localization method, a division section 20 divides a received image with sound information into the sound information and the image. An image analysis section 40 uses information in an image intelligence database 30 to analyze an object in the image, a motion (position) of the object, and camera motion or the like from the image divided from the original image and to acquire image information. A sound source separation section 60 separates a sound source considered to be emitted from the object from the divided sound information on the basis of the acquired image information and information of a sound intelligence database section 50. A sound source localization section 70 relocates the separated sound source into a sound space proper to the video image by taking the acquired image information and a video display method such as display of a panorama image or the like in a reproduction section 90 into account. A synthesis section 80 synthesizes the relocated sound source and the image and the reproduction section 90 displays and reproduces the synthesized image with sound information by processing video display method.;COPYRIGHT: (C)2000,JPO