When machine learning is outsourced to a rational agent, conflicts of interest might arise and severely impact predictive performance. In this work, we propose a theoretical framework for incentive-aware delegation of machine learning tasks. We model delegation as a principal-agent game, in which accurate learning can be incentivized by the principal using performance-based contracts. Adapting the economic theory of contract design to this setting, we define budget-optimal contracts and prove they take a simple threshold form under reasonable assumptions. In the binary-action case, the optimality of such contracts is shown to be equivalent to the classic Neyman-Pearson lemma, establishing a formal connection between contract design and statistical hypothesis testing. Empirically, we demonstrate that budget-optimal contracts can be constructed using small-scale data, leveraging recent advances in the study of learning curves and scaling laws. Performance and economic outcomes are evaluated using synthetic and real-world classification tasks.
翻译:当机器学习任务外包给理性智能体时,利益冲突可能出现并严重影响预测性能。本文提出了一种面向激励感知的机器学习任务委派理论框架。我们将委派建模为委托-代理博弈,其中委托人可通过基于绩效的契约激励精确学习。通过将契约设计的经济学理论适配至该场景,我们定义了预算最优契约,并在合理假设下证明其具有简单的阈值形式。在二元行动情形下,此类契约的最优性被证明等价于经典的奈曼-皮尔逊引理,从而在契约设计与统计假设检验之间建立了形式化关联。实验表明,利用学习曲线与缩放定律研究的最新进展,可通过小规模数据构建预算最优契约。性能与经济结果通过合成数据及真实世界分类任务进行评估。