The aim of boosting is to convert a sequence of weak learners into a strong learner. At their heart, these methods are fully sequential. In this paper, we investigate the possibility of parallelizing boosting. Our main contribution is a strong negative result, implying that significant parallelization of boosting requires an exponential blow-up in the total computing resources needed for training.
翻译:提升(Boosting)的目标是将一系列弱学习器转化为强学习器。其核心本质是完全顺序化的。本文研究了将提升方法并行化的可能性。我们的主要贡献在于一个强否定性结论,该结论表明,要实现提升方法的大幅并行化,训练所需的总计算资源将呈指数级增长。