2001: an MR-space Odyssey - applying mixed reality technology to VFX in filmmaking

摘要

Visual effects (VFX), which composite computer-generated imagery (CGI) onto live-action scenes in a feature film, usually require a sequence of images that is manually generated in the post-production process. In an alternative approach, mixed reality (MR) merges the real and virtual worlds to achieve real-time interaction between users and MR space. In this sense, MR creates real-time VFX seen from an observer's viewpoint. These two fields, which used to be considered independent, will rapidly affect one another. The VFX techniques, especially photometric registration, are useful in MR systems. On the other hand, MR technology can be utilized in film production. This paper introduces the first MR system that is specially implemented for a rehearsal stage in filmmaking.