Augmented HE-Book: A Multimedia Based Extension to Support Immersive Reading Experience

摘要

Traditionally we know that the use of various modalities such as audio-visual materials can influence the effective learning behaviour [6]. Can haptic rendering if combined with the audio-visual learning content have the similar effect? In order to examine that we present an intuitive approach of annotation based hapto-audio-visual interaction with the traditional digital learning materials such as eBooks. It leverages the haptic jacket interface to receive haptic emotive signals wirelessly in the form of patterned vibrations of the actuators and expresses the learning material by incorporating image based augmented display in order to pave ways for intimate reading experience in the popular eBook platform.