This paper studies the multi-modal recommendation problem, where the item multi-modality information (e.g., images and textual descriptions) is exploited to improve the recommendation accuracy. Besides the user-item interaction graph, existing state-of-the-art methods usually use auxiliary graphs (e.g., user-user or item-item relation graph) to augment the learned representations of users and/or items. These representations are often propagated and aggregated on auxiliary graphs using graph convolutional networks, which can be prohibitively expensive in computation and memory, especially for large graphs. Moreover, existing multi-modal recommendation methods usually leverage randomly sampled negative examples in Bayesian Personalized Ranking (BPR) loss to guide the learning of user/item representations, which increases the computational cost on large graphs and may also bring noisy supervision signals into the training process. To tackle the above issues, we propose a novel self-supervised multi-modal recommendation model, dubbed BM3, which requires neither augmentations from auxiliary graphs nor negative samples. Specifically, BM3 first bootstraps latent contrastive views from the representations of users and items with a simple dropout augmentation. It then jointly optimizes three multi-modal objectives to learn the representations of users and items by reconstructing the user-item interaction graph and aligning modality features under both inter- and intra-modality perspectives. BM3 alleviates both the need for contrasting with negative examples and the complex graph augmentation from an additional target network for contrastive view generation. We show BM3 outperforms prior recommendation models on three datasets with number of nodes ranging from 20K to 200K, while achieving a 2-9X reduction in training time. Our code is available at https://github.com/enoche/BM3.
翻译:本文研究多模态推荐问题,即利用物品的多模态信息(如图像和文本描述)提升推荐精度。除用户-物品交互图外,现有最优方法通常采用辅助图(如用户-用户或物品-物品关系图)来增强用户和/或物品的表示学习。这些表示常通过图卷积网络在辅助图上进行传播和聚合,这在计算和内存上开销极大,尤其针对大规模图。此外,现有方法通常在贝叶斯个性化排序损失中利用随机采样的负例指导用户/物品表示学习,这不仅增加大规模图的计算成本,还可能引入噪声监督信号。针对上述问题,我们提出新型自监督多模态推荐模型BM3,该模型无需辅助图增强或负样本。具体而言,BM3首先通过简单的丢弃增强从用户与物品表示中引导出隐式对比视图,随后联合优化三个多模态目标:通过重建用户-物品交互图,并在模态间与模态内对齐特征,学习用户与物品表示。BM3消除了对比负例的需求,也无需为生成对比视图而构建额外目标网络的复杂图增强。实验表明,在节点规模2万至20万的三类数据集上,BM3性能超越现有推荐模型,同时训练时间减少2-9倍。代码已开源:https://github.com/enoche/BM3。