EvalRS aims to bring together practitioners from industry and academia to foster a debate on rounded evaluation of recommender systems, with a focus on real-world impact across a multitude of deployment scenarios. Recommender systems are often evaluated only through accuracy metrics, which fall short of fully characterizing their generalization capabilities and miss important aspects, such as fairness, bias, usefulness, informativeness. This workshop builds on the success of last year's workshop at CIKM, but with a broader scope and an interactive format.
翻译:EvalRS 旨在汇聚工业界与学术界从业者,推动关于推荐系统全方位评估的讨论,重点关注多场景实际部署中的真实影响。推荐系统通常仅通过准确率指标进行评估,这不足以充分表征其泛化能力,且忽视了公平性、偏差、实用性、信息量等重要方面。本研讨会基于去年CIKM会议研讨会的成功经验,以更广泛的视角和互动形式展开。