Real-time path tracing increasingly operates under extremely low sampling budgets, often below one sample per pixel, as rendering complexity, resolution, and frame-rate requirements continue to rise. While super-resolution is widely used in production, it uniformly sacrifices spatial detail and cannot exploit variations in noise, reconstruction difficulty, and perceptual importance across the image. Adaptive sampling offers a compelling alternative, but existing end-to-end approaches rely on approximations that break down in sparse regimes. We introduce an end-to-end adaptive sampling and denoising pipeline explicitly designed for the sub-1-spp regime. Our method uses a stochastic formulation of sample placement that enables gradient estimation despite discrete sampling decisions, allowing stable training of a neural sampler at low sampling budgets. To better align optimization with human perception, we propose a tonemapping-aware training pipeline that integrates differentiable filmic operators and a state-of-the-art perceptual loss, preventing oversampling of regions with low visual impact. In addition, we introduce a gather-based pyramidal denoising filter and a learnable generalization of albedo demodulation tailored to sparse sampling. Our results show consistent improvements over uniform sparse sampling, with notably better reconstruction of perceptually critical details such as specular highlights and shadow boundaries, and demonstrate that adaptive sampling remains effective even at minimal budgets.
翻译:随着渲染复杂度、分辨率和帧率要求的持续提升,实时路径追踪日益需要在极低的采样预算下运行,通常低于每像素一个样本。虽然超分辨率技术在生产中被广泛采用,但它会均匀地牺牲空间细节,且无法利用图像中噪声、重建难度和感知重要性的变化。自适应采样提供了一种引人注目的替代方案,但现有的端到端方法依赖于在稀疏采样条件下失效的近似。我们提出了一种专为亚每像素一个样本(sub-1-spp)机制设计的端到端自适应采样与去噪流程。我们的方法采用了一种随机化的样本放置公式,能够在离散采样决策下实现梯度估计,从而允许在低采样预算下稳定地训练神经采样器。为了更好地将优化目标与人类感知对齐,我们提出了一种感知色调映射的训练流程,该流程集成了可微分的电影色调映射算子与最先进的感知损失函数,防止了对视觉影响较低区域的过度采样。此外,我们引入了一种基于聚集的金字塔形去噪滤波器,以及一种专为稀疏采样设计的、可学习的反照率解调泛化方法。我们的结果显示,相较于均匀稀疏采样,本方法取得了持续的改进,在镜面高光和阴影边界等感知关键细节的重建上表现尤为出色,并证明了即使在极低的采样预算下,自适应采样依然有效。