3D vision for virtual reality and augmented reality

摘要

3D vision is a kind of technology that allow computers to perceive,reconstruct and interact with the 3D world based on vision sensors.It is not only a hot academic topic in computer science,but also crucial to many applications,such as virtual reality(VR)and augmented reality(AR).For achieving high-quality effects of VR and AR,we need to recover the 6DoF camera pose,3D structure of the scene,and even the human interaction,so that people not only can see the lifelike virtual objects/scenes,but also the seamless fusion of virtual and real contents and even interact with them.We can leverage 3D vision technology to achieve this objective.For example,the simultaneous localization and mapping(SLAM)technique allows users to walk freely in a digital world wearing a VR/AR helmet by recovering the 6DoF movement of the helmet,and is also able to see the seamless mixture of real and virtual contents,and even the effect of their interaction with each other by reconstructing the geometry,textures and materials of the real environment.In this special issue,we have selected 6 papers(3 review papers,2 research articles and 1 case report)covering 3 most relevant 3D vision techniques for the VR/AR applications,including SLAM,3D reconstruction,object segmentation and tracking.