Logging Interactions in Explorable Immersive VR/AR Applications

摘要

3D content of immersive virtual and augmented reality applications typically consists of objects that can interact with users and other objects. Interactions may be followed by changes of objects' properties, including their geometry, structure and appearance as well as high-level, domain-specific semantics. Logging interactions and temporal 3D content properties in a uniform, explorable way can be useful in various domains that involve multiple collaborating users and interacting objects, and can benefit from analysis of the users' and objects' behavior, e.g., in design, training, education, e-commerce, marketing and merchandising. However, the available approaches do not enable creation of explorable immersive VR/AR applications with regards to interactions and temporal 3D content properties. The main contribution of this paper is an approach to generating explorable interaction logs in immersive applications. The logs are ontologies compliant with the semantic web. Hence, the approach may be used with general or domain knowledge in a way intelligible to average users or domain specialists without expertise in IT. The approach is discussed in the context of a heterogeneous immersive environment, which combines diverse VR presentation and interaction devices to enable collaboration of multiple users within urban design.