3D reconstruction under light ray distortion from parametric focal cameras

摘要

In this paper, we propose a new method for reconstructing 3D objects under light ray distortion caused by unknown refractive media. The proposed method can reconstruct 3D scene, even if light rays projected into the cameras are refracted by unknown refractive media, such as glasses and raindrops. For this objective, we represent light ray projection of multiple cameras by using a pair of planes shared by the multiple cameras in the scene. By using this model, intrinsic and extrinsic camera parameters as well as the refractive properties of the refractive media can be represented efficiently. By using the newly defined camera model, we propose a method for recovering 3D points and camera parameters with refractive properties simultaneously. The experimental results show the efficiency of the proposed camera model and reconstruction method. (C) 2018 Elsevier B.V. All rights reserved.