Multi-Modal-Method: A Design Methodology for Building Multi-Modal Systems

摘要

This paper describes Multi-Modal-Method, a design methodology for building multi-modal systems. Multi-modal-method defines the procedure which interface designers may follow in developing multi-modal systems, and provides MM-DCG (Multi-Modal Definite Clause Grammar), a grammatical framework for multi-modal input interpretation. Multi-modal-method has been inductively defined through several experimental multi-modal interface systems. Development of a multi-modal drawing tool along with multi-modal-method is also introduced.