We consider the general problem of recovering a high-dimensional signal from noisy quantized measurements. Quantization, especially coarse quantization such as 1-bit sign measurements, leads to severe information loss and thus a good prior knowledge of the unknown signal is helpful for accurate recovery. Motivated by the power of score-based generative models (SGM, also known as diffusion models) in capturing the rich structure of natural signals beyond simple sparsity, we propose an unsupervised data-driven approach called quantized compressed sensing with SGM (QCS-SGM), where the prior distribution is modeled by a pre-trained SGM. To perform posterior sampling, an annealed pseudo-likelihood score called noise perturbed pseudo-likelihood score is introduced and combined with the prior score of SGM. The proposed QCS-SGM applies to an arbitrary number of quantization bits. Experiments on a variety of baseline datasets demonstrate that the proposed QCS-SGM significantly outperforms existing state-of-the-art algorithms by a large margin for both in-distribution and out-of-distribution samples. Moreover, as a posterior sampling method, QCS-SGM can be easily used to obtain confidence intervals or uncertainty estimates of the reconstructed results. The code is available at https://github.com/mengxiangming/QCS-SGM.
翻译:我们考虑从噪声量化测量中恢复高维信号的一般性问题。量化,特别是粗量化,例如1位符号测量,会导致严重的信息损失,因此良好的未知信号先验知识有助于精确恢复。受分数生成模型(SGM,也称为扩散模型)在捕获超越简单稀疏性的自然信号丰富结构方面的能力启发,我们提出了一种无监督的数据驱动方法,称为基于SGM的量化压缩感知(QCS-SGM),其中先验分布由预训练的SGM建模。为了进行后验采样,我们引入了一种称为噪声扰动伪似然分数的退火伪似然分数,并将其与SGM的先验分数相结合。所提出的QCS-SGM适用于任意数量的量化比特。在多种基准数据集上的实验表明,所提出的QCS-SGM在分布内和分布外样本上均显著优于现有最先进算法,性能大幅提升。此外,作为一种后验采样方法,QCS-SGM可以轻松用于获取重建结果的置信区间或不确定性估计。代码可在 https://github.com/mengxiangming/QCS-SGM 获取。