Modality-specific Affective Responses and their Implications for Affective BCI

Reliable applications of multimodal affective brain-computer interfaces (aBCI) require a detailed understanding of the processes involved in emotions. To explore the modality-specific nature of affective responses, we studied neurophysiological responses of 24 subjects during visual, auditory, and audiovisual affect stimulation and obtained their subjective ratings. Coherent with literature, we found modality-specific responses in the EEG: parietal alpha power decreases during visual stimulation and increases during auditory stimulation, whereas more anterior alpha power decreases during auditory stimulation and increases during visual stimulation. We discuss the implications of these results for multimodal aBCI.