Modern machine learning models have started to consume incredible amounts of energy, thus incurring large carbon footprints (Strubell et al., 2019). To address this issue, we have created an energy estimation pipeline1, which allows practitioners to estimate the energy needs of their models in advance, without actually running or training them. We accomplished this, by collecting high-quality energy data and building a first baseline model, capable of predicting the energy consumption of DL models by accumulating their estimated layer-wise energies.
翻译:现代机器学习模型开始消耗惊人的能量,从而产生巨大的碳足迹(Strubell等人,2019)。为解决这一问题,我们构建了一个能耗估计流程¹,使从业者能够在无需实际运行或训练模型的情况下,预先估计其模型的能源需求。我们通过收集高质量能耗数据并构建首个基线模型实现了这一目标,该模型能够通过累加各层估计能耗来预测深度学习模型的能量消耗。