Steady-state visual evoked potentials (SSVEPs) based brain-computer interface (BCI) has received considerable attention due to its high information transfer rate (ITR) and available quantity of targets. However, the performance of frequency identification methods heavily hinges on the amount of user calibration data and data length, which hinders the deployment in real-world applications. Recently, generative adversarial networks (GANs)-based data generation methods have been widely adopted to create synthetic electroencephalography (EEG) data, holds promise to address these issues. In this paper, we proposed a GAN-based end-to-end signal transformation network for data length extension, termed as TEGAN. TEGAN transforms short-length SSVEP signals into long-length artificial SSVEP signals. By incorporating a novel U-Net generator architecture and an auxiliary classifier into the network architecture, the TEGAN could produce conditioned features in the synthetic data. Additionally, we introduced a two-stage training strategy and the LeCam-divergence regularization term to regularize the training process of GAN during the network implementation. The proposed TEGAN was evaluated on two public SSVEP datasets (a 4-class dataset and a 12-class dataset). With the assistance of TEGAN, the performance of traditional frequency recognition methods and deep learning-based methods have been significantly improved under limited calibration data. And the classification performance gap of various frequency recognition methods has been narrowed. This study substantiates the feasibility of the proposed method to extend the data length for short-time SSVEP signals for developing a high-performance BCI system. The proposed GAN-based methods have the great potential of shortening the calibration time and cutting down the budget for various real-world BCI-based applications.
翻译:稳态视觉诱发电位(SSVEP)驱动的脑机接口(BCI)因其高信息传输速率和可用目标数量而受到广泛关注。然而,频率识别方法的性能严重依赖使用者校准数据量和数据时长,这制约了其在实际应用中的部署。近年来,基于生成对抗网络(GAN)的数据生成方法被广泛用于生成合成脑电图(EEG)数据,为解决上述问题提供了可能。本文提出一种基于GAN的端到端信号转换网络TEGAN,用于数据时长扩展。TEGAN可将短时长SSVEP信号转换为长时长人工SSVEP信号。通过引入新型U-Net生成器架构和辅助分类器,TEGAN能够在合成数据中生成条件化特征。此外,我们采用两阶段训练策略和LeCam散度正则化项来规范网络实现过程中GAN的训练过程。所提TEGAN在两个公开SSVEP数据集(4类数据集和12类数据集)上进行了评估。借助TEGAN,传统频率识别方法和基于深度学习的方法在有限校准数据下的性能均得到显著提升,且不同频率识别方法的分类性能差距得以缩小。本研究证实了所提方法通过扩展短时SSVEP信号时长来开发高性能BCI系统的可行性。基于GAN的方法具有缩短校准时间、降低各类实际BCI应用成本的巨大潜力。