A Novel Synchronous Hybrid Steady-State Brain-Computer Interface Based on Visual and Auditory Integration **This work was supported by the National Key Research Development Program of China (2017YFA0701103), the Open Funding Project of National Key Labo

摘要

Brain-computer interface (BCI) is a direct connection channel between brain and external devices. The problem of “BCI illiteracy” in single-modality BCI limits its further development and application. The hybrid braincomputer interface (hybrid BCI), with its strong practicability, high reliability, richness of types of brain signals, and flexibility of application, provides a possible solution for the simultaneous completion of complex control, and has become a hot topic in current BCI researches. This paper mainly studied the synchronous hybrid BCI paradigm based on steady-state visual evoked potential (SSVEP) and steady-state auditory evoked potential (SSAEP). Respectively, the cursor movement in four directions was controlled by the visual stimulation, and the left and right clicks were controlled by the auditory stimulation via the hook program and graphic handle. Experimental results verified the effectiveness of the proposed hybrid BCI in controlling the two-dimensional movement of the mouse cursor. With canonical correlation analysis (CCA) algorithm, the average recognition accuracy of visual and auditory recognition is 98.3% and 73.3%, respectively, which proved the robust performance of the proposed hybrid BCI in real applications.