Multi-stage ranking pipelines have become widely used strategies in modern recommender systems, where the final stage aims to return a ranked list of items that balances a number of requirements such as user preference, diversity, novelty etc. Linear scalarization is arguably the most widely used technique to merge multiple requirements into one optimization objective, by summing up the requirements with certain preference weights. Existing final-stage ranking methods often adopt a static model where the preference weights are determined during offline training and kept unchanged during online serving. Whenever a modification of the preference weights is needed, the model has to be re-trained, which is time and resources inefficient. Meanwhile, the most appropriate weights may vary greatly for different groups of targeting users or at different time periods (e.g., during holiday promotions). In this paper, we propose a framework called controllable multi-objective re-ranking (CMR) which incorporates a hypernetwork to generate parameters for a re-ranking model according to different preference weights. In this way, CMR is enabled to adapt the preference weights according to the environment changes in an online manner, without retraining the models. Moreover, we classify practical business-oriented tasks into four main categories and seamlessly incorporate them in a new proposed re-ranking model based on an Actor-Evaluator framework, which serves as a reliable real-world testbed for CMR. Offline experiments based on the dataset collected from Taobao App showed that CMR improved several popular re-ranking models by using them as underlying models. Online A/B tests also demonstrated the effectiveness and trustworthiness of CMR.
翻译:多阶段排序流水线已成为现代推荐系统中广泛采用的策略,其最终阶段旨在返回一个平衡用户偏好、多样性、新颖性等多重需求的排序项目列表。线性标量化是最常用的多需求融合技术,通过将各项需求与特定偏好权重求和后转化为单一优化目标。现有终阶段排序方法通常采用静态模型,即偏好权重在离线训练时确定,在线服务期间保持固定。每当需要调整偏好权重时,模型必须重新训练,导致时间和资源低效。同时,最合适的权重可能因目标用户群体差异或不同时间段(如节假日促销活动)而产生显著变化。本文提出名为可控多目标重排序(CMR)的框架,通过引入超网络根据不同的偏好权重生成重排序模型参数。通过这种方式,CMR能够在线适应环境变化自动调整偏好权重,无需重新训练模型。此外,我们将实际业务导向任务划分为四大类别,并将其无缝整合到基于Actor-Evaluator框架的新颖重排序模型中,该模型作为CMR的可靠真实世界测试平台。基于淘宝App采集数据集的离线实验表明,CMR通过将现有主流重排序模型作为基础模型显著提升了其性能。在线A/B测试也验证了CMR的有效性与可信度。