Multi-Modal-Method: A Design Method for Building Multi-Modal Systems

摘要

This paper describes Multi-Modal-Method, a design method for building grammar-based multi modal systems. Multi-Modal-Method defines the procedure which interface designers may follow in developing multi-modal systems, and provides MM-DCG, a grammatical framework for multi-modal input interpretation. Multi-Modal-Method has been inductively defined through several experimental multi-modal interface system developments. A case study of a multi-modal drawing tool development along with Multi-Modal-Method is reported.