Shading Structure-Guided Depth Image Restoration

摘要

Color-guided depth image restoration is an issue of great interest. However, the edge in color image is not always consistent with the depth image. There is a certain relationship between the shading component of RGB image and the depth, so a depth image restoration method is proposed with shading structure guidance. First, the RGB image is decomposed into the shading component and the reflectance component based on Retinex Theory; next, calculate the structure tensors of the shading component and the depth image respectively, and the corresponding eigenvalues and eigenvectors; then, design the diffusion tensor with the eigenvalues and eigenvectors of the depth structure tensor to make the diffusion be along the level lines isophotes, finally the shading structure is introduced to inhibit the diffusion in the direction perpendicular to the edge, and the depth image is restored by diffusion. Experiments show, visually and quantitatively, the better restoration results are achieved by the introduction of the shading structure.