This paper presents a novel wireless image transmission paradigm that can exploit feedback from the receiver, called DeepJSCC-ViT-f. We consider a block feedback channel model, where the transmitter receives noiseless/noisy channel output feedback after each block. The proposed scheme employs a single encoder to facilitate transmission over multiple blocks, refining the receiver's estimation at each block. Specifically, the unified encoder of DeepJSCC-ViT-f can leverage the semantic information from the source image, and acquire channel state information and the decoder's current belief about the source image from the feedback signal to generate coded symbols at each block. Numerical experiments show that our DeepJSCC-ViT-f scheme achieves state-of-the-art transmission performance with robustness to noise in the feedback link. Additionally, DeepJSCC-ViT-f can adapt to the channel condition directly through feedback without the need for separate channel estimation. We further extend the scope of the DeepJSCC-ViT-f approach to include the broadcast channel, which enables the transmitter to generate broadcast codes in accordance with signal semantics and channel feedback from individual receivers.

翻译：本文提出了一种名为DeepJSCC-ViT-f的新型无线图像传输范式，该范式能够利用接收端的反馈信息。我们考虑一种分块反馈信道模型，其中发射机在每个传输块后能获得无噪/有噪的信道输出反馈。所提方案采用单一编码器实现多块传输，并逐步优化接收端在每个块的估计。具体而言，DeepJSCC-ViT-f的统一编码器能够从源图像中提取语义信息，同时通过反馈信号获取信道状态信息以及解码器当前对源图像的认知状态，从而为每个传输块生成编码符号。数值实验表明，所提DeepJSCC-ViT-f方案在传输性能上达到当前最优水平，并对反馈链路中的噪声具有鲁棒性。此外，DeepJSCC-ViT-f无需单独的信道估计，即可通过反馈直接自适应信道条件。我们进一步将DeepJSCC-ViT-f方法扩展至广播信道场景，使发射机能够根据信号语义和单个接收端的信道反馈生成广播码字。