Advancements in 6G wireless technology have elevated the importance of beamforming, especially for attaining ultra-high data rates via millimeter-wave (mmWave) frequency deployment. Although promising, mmWave bands require substantial beam training to achieve precise beamforming. While initial deep learning models that use RGB camera images demonstrated promise in reducing beam training overhead, their performance suffers due to sensitivity to lighting and environmental variations. Due to this sensitivity, Quality of Service (QoS) fluctuates, eventually affecting the stability and dependability of networks in dynamic environments. This emphasizes a critical need for robust solutions. This paper proposes a robust beamforming technique to ensure consistent QoS under varying environmental conditions. An optimization problem has been formulated to maximize users' data rates. To solve the formulated NP-hard optimization problem, we decompose it into two subproblems: the semantic localization problem and the optimal beam selection problem. To solve the semantic localization problem, we propose a novel method that leverages the K-means clustering and YOLOv8 model. To solve the beam selection problem, we propose a novel lightweight hybrid architecture that combines a lightweight transformer with a CNN architecture through a weighted entropy mechanism. This hybrid architecture utilizes multimodal data sources to dynamically predict the optimal beams. A novel metric, Accuracy-Complexity Efficiency (ACE), has been proposed to quantify this. Six testing scenarios have been developed to evaluate the robustness of the proposed model. Finally, the simulation result demonstrates that the proposed model outperforms several state-of-the-art baselines regarding beam prediction accuracy, received power, and ACE in the developed test scenarios.

翻译：6G无线技术的进步提升了波束成形的重要性，尤其是在通过毫米波频段部署实现超高速率方面。尽管前景广阔，毫米波频段需要大量的波束训练以实现精确的波束成形。虽然早期利用RGB相机图像的深度学习模型在降低波束训练开销方面显示出潜力，但其性能因对光照和环境变化的敏感性而受到影响。由于这种敏感性，服务质量会发生波动，最终影响动态环境中网络的稳定性和可靠性。这凸显了对鲁棒解决方案的迫切需求。本文提出了一种鲁棒波束成形技术，以确保在变化的环境条件下保持稳定的服务质量。我们构建了一个优化问题以最大化用户数据速率。为解决这个NP难优化问题，我们将其分解为两个子问题：语义定位问题和最优波束选择问题。为解决语义定位问题，我们提出了一种新颖的方法，该方法利用K-means聚类和YOLOv8模型。为解决波束选择问题，我们提出了一种新颖的轻量级混合架构，该架构通过加权熵机制将轻量级Transformer与CNN架构相结合。该混合架构利用多模态数据源动态预测最优波束。我们提出了一种新的度量指标——精度-复杂度效率（ACE）来量化这一点。我们开发了六种测试场景来评估所提出模型的鲁棒性。最终，仿真结果表明，在所开发的测试场景中，所提出的模型在波束预测精度、接收功率和ACE方面均优于多个先进的基线模型。