Essential for an unfettered data market is the ability to discreetly select and evaluate training data before finalizing a transaction between the data owner and model owner. To safeguard the privacy of both data and model, this process involves scrutinizing the target model through Multi-Party Computation (MPC). While prior research has posited that the MPC-based evaluation of Transformer models is excessively resource-intensive, this paper introduces an innovative approach that renders data selection practical. The contributions of this study encompass three pivotal elements: (1) a groundbreaking pipeline for confidential data selection using MPC, (2) replicating intricate high-dimensional operations with simplified low-dimensional MLPs trained on a limited subset of pertinent data, and (3) implementing MPC in a concurrent, multi-phase manner. The proposed method is assessed across an array of Transformer models and NLP/CV benchmarks. In comparison to the direct MPC-based evaluation of the target model, our approach substantially reduces the time required, from thousands of hours to mere tens of hours, with only a nominal 0.20% dip in accuracy when training with the selected data.

翻译：一个不受约束的数据市场的核心在于，在数据所有者和模型所有者最终确定交易之前，能够谨慎地挑选并评估训练数据。为保护数据和模型的隐私，此过程涉及通过多方计算（MPC）对目标模型进行审查。尽管先前研究认为基于MPC的Transformer模型评估资源消耗过高，但本文提出了一种创新方法，使数据选择具备实际可行性。本研究的贡献包含三个关键要素：（1）一种基于MPC的机密数据选择创新流程；（2）通过训练于有限相关数据子集上的简化低维MLP，复现复杂高维运算；（3）以并行、多阶段方式实现MPC。所提方法在多种Transformer模型及NLP/CV基准测试上进行了评估。相较于直接基于MPC的目标模型评估，我们的方法将所需时间从数千小时大幅缩短至数十小时，同时使用所选数据训练时精度仅下降0.20%。