This paper presents a novel wireless image transmission paradigm that can exploit feedback from the receiver, called DeepJSCC-ViT-f. We consider a block feedback channel model, where the transmitter receives noiseless/noisy channel output feedback after each block. The proposed scheme employs a single encoder to facilitate transmission over multiple blocks, refining the receiver's estimation at each block. Specifically, the unified encoder of DeepJSCC-ViT-f can leverage the semantic information from the source image, and acquire channel state information and the decoder's current belief about the source image from the feedback signal to generate coded symbols at each block. Numerical experiments show that our DeepJSCC-ViT-f scheme achieves state-of-the-art transmission performance with robustness to noise in the feedback link. Additionally, DeepJSCC-ViT-f can adapt to the channel condition directly through feedback without the need for separate channel estimation. We further extend the scope of the DeepJSCC-ViT-f approach to include the broadcast channel, which enables the transmitter to generate broadcast codes in accordance with signal semantics and channel feedback from individual receivers.
翻译:本文提出了一种新型无线图像传输范式——DeepJSCC-ViT-f,该范式能够利用接收端反馈。我们考虑块反馈信道模型,其中发射端在每个传输块后接收无噪/含噪信道输出反馈。所提方案采用统一编码器实现多块传输,逐步优化接收端在每个块上的估计。具体而言,DeepJSCC-ViT-f的统一编码器既能从源图像中提取语义信息,又能通过反馈信号获取信道状态信息和解码器对源图像的当前置信度,从而在每个块上生成编码符号。数值实验表明,DeepJSCC-ViT-f方案在反馈链路存在噪声的情况下仍能保持鲁棒性,并实现最优传输性能。此外,DeepJSCC-ViT-f无需独立信道估计,可直接通过反馈自适应调整信道条件。我们进一步将DeepJSCC-ViT-f框架扩展至广播信道场景,使发射端能够根据信号语义和各接收端信道反馈生成广播编码。