Can gradient descent be accelerated by just choosing better stepsizes? Surprisingly, the answer is yes. This short expository article provides an accessible introduction to this phenomenon of stepsize hedging.
翻译:梯度下降能否仅通过选择更优的步长来加速?令人惊讶的是,答案是肯定的。这篇短小的说明性文章为步长对冲这一现象提供了易于理解的介绍。