This paper presents a novel wireless image transmission paradigm that can exploit feedback from the receiver, called DeepJSCC-ViT-f. We consider a block feedback channel model, where the transmitter receives noiseless/noisy channel output feedback after each block. The proposed scheme employs a single encoder to facilitate transmission over multiple blocks, refining the receiver's estimation at each block. Specifically, the unified encoder of DeepJSCC-ViT-f can leverage the semantic information from the source image, and acquire channel state information and the decoder's current belief about the source image from the feedback signal to generate coded symbols at each block. Numerical experiments show that our DeepJSCC-ViT-f scheme achieves state-of-the-art transmission performance with robustness to noise in the feedback link. Additionally, DeepJSCC-ViT-f can adapt to the channel condition directly through feedback without the need for separate channel estimation. We further extend the scope of the DeepJSCC-ViT-f approach to include the broadcast channel, which enables the transmitter to generate broadcast codes in accordance with signal semantics and channel feedback from individual receivers.
翻译:本文提出了一种利用接收端反馈的新型无线图像传输范式,称为DeepJSCC-ViT-f。我们考虑一个分块反馈信道模型,其中发射端在每个传输块后接收无噪/有噪信道输出反馈。所提方案采用单一编码器在多块传输中完成传输任务,并在每个传输块逐步优化接收端的估计。具体而言,DeepJSCC-ViT-f的统一编码器能够提取源图像的语义信息,同时通过反馈信号获取信道状态信息及解码器对源图像的当前置信度,从而在每个传输块生成编码符号。数值实验表明,我们的DeepJSCC-ViT-f方案在具备反馈链路噪声鲁棒性的同时,实现了最优的传输性能。此外,DeepJSCC-ViT-f可直接通过反馈自适应信道条件,无需独立信道估计。我们进一步将DeepJSCC-ViT-f方法扩展至广播信道场景,使发射端能根据信号语义与各接收端的信道反馈生成广播编码。