Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or model augmentation for generating contrastive pairs to find a proper augmentation operation for different datasets, which makes the model hard to generalize. Additionally, since insufficient input data may lead the encoder to learn collapsed embeddings, these CL methods expect a relatively large number of training data (e.g., large batch size or memory bank) to contrast. However, not all contrastive pairs are always informative and discriminative enough for the training processing. Therefore, a more general CL-based recommendation model called Meta-optimized Contrastive Learning for sequential Recommendation (MCLRec) is proposed in this work. By applying both data augmentation and learnable model augmentation operations, this work innovates the standard CL framework by contrasting data and model augmented views for adaptively capturing the informative features hidden in stochastic data augmentation. Moreover, MCLRec utilizes a meta-learning manner to guide the updating of the model augmenters, which helps to improve the quality of contrastive pairs without enlarging the amount of input data. Finally, a contrastive regularization term is considered to encourage the augmentation model to generate more informative augmented views and avoid too similar contrastive pairs within the meta updating. The experimental results on commonly used datasets validate the effectiveness of MCLRec.
翻译:对比学习(Contrastive Learning, CL)作为一种新兴方法,旨在应对推荐数据稀疏且噪声大的挑战。尽管已有方法取得了显著成果,但现有的大多数CL方法仅通过手工设计的数据增强或模型增强方式生成对比对,以寻找适用于不同数据集的增强操作,这导致模型难以泛化。此外,由于输入数据不足可能使编码器学习到坍缩的嵌入表示,这些CL方法通常需要较大规模的数据量(例如大批次样本或存储库)进行对比。然而,并非所有对比对都能为训练过程提供足够的信息性和判别性。为此,本文提出一种更通用的基于对比学习的推荐模型——用于序列推荐的元优化对比学习(Meta-optimized Contrastive Learning for sequential Recommendation, MCLRec)。该工作通过同时应用数据增强和可学习的模型增强操作,创新性地改进了标准CL框架,对比数据增强视角与模型增强视角,从而自适应地捕捉随机数据增强中隐藏的信息性特征。此外,MCLRec利用元学习方式指导模型增强器的更新,在不增加输入数据量的前提下提升对比对的质量。最后,引入对比正则化项,鼓励增强模型生成更具信息量的增强视角,并避免元更新过程中产生过于相似的对比对。在常用数据集上的实验结果验证了MCLRec的有效性。