Click-Through Rate (CTR) prediction has been an indispensable component for many industrial applications, such as recommendation systems and online advertising. CTR prediction systems are usually based on multi-field categorical features, i.e., every feature is categorical and belongs to one and only one field. Modeling feature conjunctions is crucial for CTR prediction accuracy. However, it requires a massive number of parameters to explicitly model all feature conjunctions, which is not scalable for real-world production systems. In this paper, we describe a novel Field-Leveraged Embedding Network (FLEN) which has been deployed in the commercial recommender system in Meitu and serves the main traffic. FLEN devises a field-wise bi-interaction pooling technique. By suitably exploiting field information, the field-wise bi-interaction pooling captures both inter-field and intra-field feature conjunctions with a small number of model parameters and an acceptable time complexity for industrial applications. We show that a variety of state-of-the-art CTR models can be expressed under this technique. Furthermore, we develop Dicefactor: a dropout technique to prevent independent latent features from co-adapting. Extensive experiments, including offline evaluations and online A/B testing on real production systems, demonstrate the effectiveness and efficiency of FLEN against the state-of-the-arts. Notably, FLEN has obtained 5.19% improvement on CTR with 1/6 of memory usage and computation time, compared to last version (i.e. NFM).
翻译:点击浏览率(CTR)预测是许多工业应用,例如建议系统和在线广告的一个不可或缺的组成部分。CTR预测系统通常基于多领域的绝对特征,即每个功能都是绝对的,属于一个和唯一的领域。模型特征连接对于计算TR预测的准确性至关重要。然而,它需要大量参数来明确模拟所有特征连接,这对于现实世界的生产系统来说是无法伸缩的。在本文中,我们描述了一个新型的外地杠杆化嵌入网络(FLEN),它已经部署在Meitu的商业推荐系统内,为主要交通服务。FLEN设计了一个实地的双对流联合技术。通过适当开发外地信息,外地的双对流组合将捕获出不同场间和外地内部的特征,与少量的模型参数和可接受的工业应用时间复杂性。我们展示了在这项技术下可以表达的多种最新的、最先进的CTR模型(FL) 。此外,我们开发了Dicefactor:一种流学技术,用来防止独立的FVP-L(V) 和F-L(F-L) 常规(N-L) 常规) 的升级,从共同测试中进行实时的测试。我们开发了VIL(F-L) 和(F-L) 和(F-L) 模拟) 模拟的升级的实时) 测试。我们研发(F-S-S-L) 演示-L) 演示-L) 和(F-S-S-S-S-S-S-L) 测试-S-S-S-S-S-S-S-S-L-L-L-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S-S