The consumption of a video requires a considerable amount of energy during the various stages of its life-cycle. With a billion hours of video consumed daily, this contributes significantly to the greenhouse gas emission. Therefore, reducing the end-to-end carbon footprint of the video chain, while preserving the quality of experience at the user side, is of high importance. To contribute in an impactful manner, we propose 3R-INN, a single light invertible network that does three tasks at once: given a high-resolution grainy image, it Rescales it to a lower resolution, Removes film grain and Reduces its power consumption when displayed. Providing such a minimum viable quality content contributes to reducing the energy consumption during encoding, transmission, decoding and display. 3R-INN also offers the possibility to restore either the high-resolution grainy original image or a grain-free version, thanks to its invertibility and the disentanglement of the high frequency, and without transmitting auxiliary data. Experiments show that, while enabling significant energy savings for encoding (78%), decoding (77%) and rendering (5% to 20%), 3R-INN outperforms state-of-the-art film grain synthesis and energy-aware methods and achieves state-of-the-art performance on the rescaling task on different test-sets.
翻译:视频消费在其生命周期的各个阶段都需要消耗大量能源。随着每天数十亿小时的视频被观看,这显著增加了温室气体排放。因此,在保持用户体验质量的同时,减少视频链路的端到端碳足迹至关重要。为了产生切实影响,我们提出了3R-INN——一个轻量级可逆网络,可一次性完成三项任务:给定高分辨率颗粒状图像,将其缩放至较低分辨率、移除胶片颗粒并降低显示时的功耗。提供这种最低可行质量的内容有助于减少编码、传输、解码和显示过程中的能耗。得益于网络的可逆性及高频信息的解耦,3R-INN无需传输辅助数据即可恢复高分辨率颗粒状原始图像或去除颗粒的版本。实验表明,在实现编码(78%)、解码(77%)和渲染(5%至20%)显著节能的同时,3R-INN在胶片颗粒合成与节能方法上优于现有技术,并在不同测试集上的缩放任务中达到最优性能。