Large Language Models (LLMs) have demonstrated remarkable performance across diverse domains, thereby prompting researchers to explore their potential for use in recommendation systems. Initial attempts have leveraged the exceptional capabilities of LLMs, such as rich knowledge and strong generalization through In-context Learning, which involves phrasing the recommendation task as prompts. Nevertheless, the performance of LLMs in recommendation tasks remains suboptimal due to a substantial disparity between the training tasks for LLMs and recommendation tasks, as well as inadequate recommendation data during pre-training. To bridge the gap, we consider building a Large Recommendation Language Model by tunning LLMs with recommendation data. To this end, we propose an efficient and effective Tuning framework for Aligning LLMs with Recommendation, namely TALLRec. We have demonstrated that the proposed TALLRec framework can significantly enhance the recommendation capabilities of LLMs in the movie and book domains, even with a limited dataset of fewer than 100 samples. Additionally, the proposed framework is highly efficient and can be executed on a single RTX 3090 with LLaMA-7B. Furthermore, the fine-tuned LLM exhibits robust cross-domain generalization. Our code and data are available at https://github.com/SAI990323/TALLRec.
翻译:大语言模型(LLMs)已在多个领域展现出卓越性能,促使研究者探索其在推荐系统中的潜力。早期尝试利用LLMs的出色能力(例如通过上下文学习(In-context Learning)将推荐任务表述为提示词,实现丰富知识与强泛化能力)。然而,由于LLM训练任务与推荐任务之间存在显著差异,且预训练阶段缺乏足够的推荐数据,LLM在推荐任务中的表现仍不理想。为弥合这一差距,我们考虑通过使用推荐数据微调LLM,构建大型推荐语言模型。为此,我们提出一种高效且有效的对齐LLM与推荐系统的微调框架TALLRec。实验证明,即使在少于100个样本的有限数据集上,所提出的TALLRec框架也能显著提升LLM在电影和图书领域的推荐能力。此外,该框架效率极高,可在搭载LLaMA-7B的单块RTX 3090上执行。进一步地,微调后的LLM展现出强大的跨领域泛化能力。我们的代码和数据可在https://github.com/SAI990323/TALLRec获取。