熟悉视频上的 EEG-fNIRS 情绪回归：视频-时间先验有多大用？

View PDF HTML (experimental)

Abstract:Do viewer-specific physiological signals improve continuous emotion regression beyond the stimulus-driven response shared across viewers? We examine this question by predicting emotion ratings for new viewers watching videos that also appear in the training set. As a stimulus-only baseline, we define a video-time prior:the smoothed median of training labels for each video at each second. We then combine this prior, using a fixed fusion weight, with a graph-based model of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) signals. On MER-PS 2026, five-fold cross-validation grouped by participant over 24 participants yields a mean absolute error (MAE) of 29.01 for fusion, compared with 29.06 for the prior alone. On an external cohort of four participants excluded from training, the corresponding MAEs are 27.72 and 28.04. In this cohort, most of the MAE reduction relative to a global-constant baseline comes from the prior, that is, from video identity and playback time this http URL lowers MAE for three of the four held-out participants and for nine of the fifteen videos. The added value of physiological signals is therefore small and varies across participants and videos. Because the model uses physiological signals recorded after each prediction time, it supports only offline prediction. Generalization to unseen videos remains untested.

Subjects:	Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
Cite as:	arXiv:2610.03618 [cs.AI]
	(or arXiv:2610.03618v2 [cs.AI] for this version)
	https://doi.org/10.48550/arXiv.2610.03618 arXiv-issued DOI via DataCite

Submission history

From: Minghao Kong [view email]
[v1] Fri, 2 Oct 2026 17:14:45 UTC (1,490 KB)
[v2] Wed, 14 Oct 2026 13:48:46 UTC (486 KB)