Automatic Reconstruction of 3D Human Face from CT and Color Photographs

摘要

This paper proposes an automatic method for reconstructing a realistic 3D facial image from CT (computer tomography) and three color photographs: front, left and right views, which can be linked easily with the underlying bone and soft tissue models. This work is the first part of our final goal, “the prediction of patient's facial appearance after cancer surgery” such as removal of a part of bone or soft tissues. The 3D facial surface derived from CT by the marching cubes algo- rithm is obviously colorless. Our task is to add the color texture of the same patient actually taken with a digital camera to the colorless 3D surface. To do this it needs an accurate registra- tion between the 3D facial image and the color photograph. Our approach is to set up a virtual camera around the 3D facial sur- face to register the virtual camera images with the corresponding color photographs by automatically adjusting seven parameters of the virtual camera. The camera parameters consists of three rotations, three translations and one scale factor. The registra- tion algorithm has been developed based upon Besl and McKay's iterative closest point (ICP) algorithm.