EvalRS aims to bring together practitioners from industry and academia to foster a debate on rounded evaluation of recommender systems, with a focus on real-world impact across a multitude of deployment scenarios. Recommender systems are often evaluated only through accuracy metrics, which fall short of fully characterizing their generalization capabilities and miss important aspects, such as fairness, bias, usefulness, informativeness. This workshop builds on the success of last year's workshop at CIKM, but with a broader scope and an interactive format.
翻译:EvalRS旨在汇聚工业界和学术界从业者,推动关于推荐系统全面评估的讨论,重点关注跨多种部署场景的实际影响。推荐系统通常仅通过准确率指标进行评估,这不足以充分表征其泛化能力,且忽略了公平性、偏差、实用性、信息性等重要方面。本工作坊在去年CIKM工作坊成功的基础上,以更广泛的视野和互动形式展开。