EEG FUSION TECHNOLOGY OF IMAGE AND EEG SIGNAL FOR REAL-TIME EMOTION RECOGNITION

摘要

A fusion technology of an image and EEG signal for real-time emotion recognition is disclosed. An emotion recognition method performed by an emotion recognition system according to an embodiment includes: extracting each modality feature from a video signal and an EEG signal; determining an attention weight for modality by inputting each of the extracted modality features into a multimodal attention network; and outputting fused emotion information by reflecting the determined attention weight on each of the extracted modality features.