Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or model augmentation for generating contrastive pairs to find a proper augmentation operation for different datasets, which makes the model hard to generalize. Additionally, since insufficient input data may lead the encoder to learn collapsed embeddings, these CL methods expect a relatively large number of training data (e.g., large batch size or memory bank) to contrast. However, not all contrastive pairs are always informative and discriminative enough for the training processing. Therefore, a more general CL-based recommendation model called Meta-optimized Contrastive Learning for sequential Recommendation (MCLRec) is proposed in this work. By applying both data augmentation and learnable model augmentation operations, this work innovates the standard CL framework by contrasting data and model augmented views for adaptively capturing the informative features hidden in stochastic data augmentation. Moreover, MCLRec utilizes a meta-learning manner to guide the updating of the model augmenters, which helps to improve the quality of contrastive pairs without enlarging the amount of input data. Finally, a contrastive regularization term is considered to encourage the augmentation model to generate more informative augmented views and avoid too similar contrastive pairs within the meta updating. The experimental results on commonly used datasets validate the effectiveness of MCLRec.
翻译:对比学习(CL)作为一种新兴方法,旨在解决推荐数据稀疏且噪声大的挑战。尽管已取得显著成果,但现有大多数对比学习方法仅通过手工设计的数据增强或模型增强来生成对比对,以针对不同数据集寻找合适的增强操作,导致模型难以泛化。此外,由于输入数据不足可能使编码器学习到坍塌表示,这些对比学习方法通常需要相对大量的训练数据(如大批次或记忆库)进行对比。然而,并非所有对比对都能为训练过程提供充分的信息和判别力。为此,本文提出了一种更通用的基于对比学习的推荐模型——元优化对比学习在序列推荐中的应用(MCLRec)。通过同时应用数据增强和可学习的模型增强操作,本文创新性地将标准对比学习框架扩展为对数据增强视图与模型增强视图进行对比,从而自适应地捕捉随机数据增强中隐藏的信息特征。此外,MCLRec采用元学习方式来指导模型增强器的更新,有助于在不扩大输入数据量的前提下提升对比对的质量。最后,引入对比正则化项,激励增强模型生成更具信息量的增强视图,并避免元更新过程中产生过于相似的对比对。在常用数据集上的实验结果验证了MCLRec的有效性。