Running live music recommendation studies without direct industry partnerships can be a prohibitively daunting task, especially for small teams. In order to help future researchers interested in such evaluations, we present a number of struggles we faced in the process of generating our own such evaluation system alongside potential solutions. These problems span the topics of users, data, computation, and application architecture.

翻译：进行实时的音乐推荐研究，若无直接的行业合作伙伴关系，可能是一项极具挑战性的任务，尤其是对于小型团队而言。为了帮助未来有意进行此类评估的研究者，我们介绍了在构建自身评估系统过程中遇到的若干困难及潜在解决方案。这些问题涵盖用户、数据、计算及应用架构等多个方面。