The action of a noise operator on a code transforms it into a distribution on the respective space. Some common examples from information theory include Bernoulli noise acting on a code in the Hamming space and Gaussian noise acting on a lattice in the Euclidean space. We aim to characterize the cases when the output distribution is close to the uniform distribution on the space, as measured by R\'enyi divergence of order $\alpha \in (1,\infty]$. A version of this question is known as the channel resolvability problem in information theory, and it has implications for security guarantees in wiretap channels, error correction, discrepancy, worst-to-average case complexity reductions, and many other problems. Our work quantifies the requirements for asymptotic uniformity (perfect smoothing) and identifies explicit code families that achieve it under the action of the Bernoulli and ball noise operators on the code. We derive expressions for the minimum rate of codes required to attain asymptotically perfect smoothing. In proving our results, we leverage recent results from harmonic analysis of functions on the Hamming space. Another result pertains to the use of code families in Wyner's transmission scheme on the binary wiretap channel. We identify explicit families that guarantee strong secrecy when applied in this scheme, showing that nested Reed-Muller codes can transmit messages reliably and securely over a binary symmetric wiretap channel with a positive rate. Finally, we establish a connection between smoothing and error correction in the binary symmetric channel.
翻译:噪声算子作用于码会将其转化为相应空间上的分布。信息论中的常见例子包括作用于汉明空间码上的伯努利噪声以及作用于欧几里得空间格上的高斯噪声。本文旨在刻画输出分布(以 $\alpha\in(1,\infty]$ 阶Rényi散度度量)接近空间均匀分布的情形。该问题的一个版本在信息论中被称为信道可解性(channel resolvability),其对窃听信道安全性保障、纠错编码、差异度量、最坏情形到平均情形复杂度归约等诸多问题具有重要意义。本文量化了渐近均匀性(完美平滑化)所需的条件,并识别了在伯努利噪声和球噪声算子作用下能实现完美平滑化的显式码族。我们推导了实现渐近完美平滑化所需码的最小速率表达式。在证明过程中,我们利用了汉明空间函数调和分析的最新成果。另一项成果涉及Wyner传输方案中码族在二元窃听信道中的应用。我们识别了在该方案下能保证强安全性的显式码族,证明嵌套Reed-Muller码能以正速率在二元对称窃听信道上实现可靠且安全的传输。最后,我们建立了二元对称信道中平滑化与纠错编码之间的联系。