Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or model augmentation for generating contrastive pairs to find a proper augmentation operation for different datasets, which makes the model hard to generalize. Additionally, since insufficient input data may lead the encoder to learn collapsed embeddings, these CL methods expect a relatively large number of training data (e.g., large batch size or memory bank) to contrast. However, not all contrastive pairs are always informative and discriminative enough for the training processing. Therefore, a more general CL-based recommendation model called Meta-optimized Contrastive Learning for sequential Recommendation (MCLRec) is proposed in this work. By applying both data augmentation and learnable model augmentation operations, this work innovates the standard CL framework by contrasting data and model augmented views for adaptively capturing the informative features hidden in stochastic data augmentation. Moreover, MCLRec utilizes a meta-learning manner to guide the updating of the model augmenters, which helps to improve the quality of contrastive pairs without enlarging the amount of input data. Finally, a contrastive regularization term is considered to encourage the augmentation model to generate more informative augmented views and avoid too similar contrastive pairs within the meta updating. The experimental results on commonly used datasets validate the effectiveness of MCLRec.
翻译:对比学习(Contrastive Learning, CL)作为一种新兴方法,旨在应对推荐系统中数据稀疏与噪声的挑战。尽管现有CL方法已取得显著成果,但多数方法仅通过手工设计的数据增强或模型增强来生成对比对,以寻找适用于不同数据集的增强操作,这导致模型难以泛化。此外,由于输入数据不足可能使编码器学习到坍塌的嵌入表示,这些CL方法依赖相对大量的训练数据(如大批次大小或记忆库)进行对比。然而,并非所有对比对在训练过程中都具有足够的信息性和判别性。为此,本文提出了一种更具通用性的基于对比学习的推荐模型——元优化对比学习序列推荐(MCLRec)。通过同时应用数据增强与可学习的模型增强操作,本文创新性地将标准CL框架扩展为对比数据增强视图与模型增强视图,以自适应捕获随机数据增强中隐藏的信息特征。进一步地,MCLRec采用元学习策略指导模型增强器的更新,从而在不扩大输入数据量的前提下提升对比对质量。最后,引入对比正则化项,鼓励增强模型生成更具信息性的增强视图,并在元更新过程中避免生成过于相似的对比对。在常用数据集上的实验结果验证了MCLRec的有效性。