METHOD FOR RESTORING NONRIGID 3D SHAPE AND MOVEMENT OF OBJECT AND SYSTEM FOR RESTORING NONRIGID 3D MODEL OF SCENE

摘要

PROBLEM TO BE SOLVED: To provide a linear method for restoring the shape, movement, and deformation of a nonrigid 3D (three-dimensional) object from a picture.;SOLUTION: This method, at first, specifies a set of characteristics related to an object in a reference image of an inputted picture and restores the nonrigid 3D shape and a 3D model of the movement of the object directly from the inputted picture of the object. Then, the correspondence between the set of the characteristics in the reference image and characteristics corresponding to other respective images of the inputted picture is determined. The correspondence is factorized into a movement matrix and a shape matrix by a series of singular value decomposition. The 3D model can be extracted from the factorized movement matrix and shape matrix. The 3D model includes a linear reference for a deformable shape of the object in the inputted picture, a 3D rotation matrix for each image, a deformation modulus, and a parallel movement vector. At this point, a new picture can be formed from the inputted picture by operating the 3D model.;COPYRIGHT: (C)2003,JPO