Efficient routing algorithms based on vehicular ad hoc networks (VANETs) play an important role in emerging intelligent transportation systems. This highly dynamic topology faces a number of wireless communication service challenges. In this paper, we propose a protocol based on reinforcement learning and vehicle node clustering, the protocol is called Qucts, solve vehicle-to-fixed-destination or V2V messaging problems. Improve message delivery rates with minimal hops and latency, link stability is also taken into account. The agreement is divided into three levels, first cluster the vehicles, each cluster head broadcasts its own coordinates and speed, to get more cluster members. Also when a cluster member receives another cluster head broadcast message, the cluster head generates a list of surrounding clusters, find the best cluster to the destination as the next cluster during message passing. Second, the protocol constructs a Q-value table based on the state after clustering, used to participate in the selection of messaging clusters. Finally, we introduce parameters that express the stability of the vehicle within the cluster, for communication node selection. This protocol hierarchy makes Qucts an offline and online solution. In order to distinguish unstable nodes within a cluster, Coding of each road, will have vehicles with planned routes, For example, car hailing and public bus. Compare the overlap with other planned paths vehicles in the cluster, low overlap is labeled as unstable nodes. Vehicle path overlap rate without a planned path is set to the mean value. Comparing Qucts with existing routing protocols through simulation, Our proposed Qucts scheme provides large improvements in both data delivery rate and end-to-end delay reduction.

翻译：基于车载自组织网络（VANETs）的高效路由算法在新兴智能交通系统中发挥着重要作用。这种高度动态的拓扑结构面临诸多无线通信服务挑战。本文提出一种基于强化学习和车辆节点聚类的协议——Qucts，用于解决车辆到固定目标或V2V消息传输问题。该协议通过最小跳数和延迟提升消息传输率，同时兼顾链路稳定性。协议分为三个层级：首先对车辆进行聚类，每个簇头广播自身坐标和速度以获取更多簇成员。当某一簇成员接收到其他簇头广播消息时，簇头生成周边簇列表，在消息传递过程中寻找至目标的最佳下一簇。其次，协议基于聚类后的状态构建Q值表，用于参与消息传输簇的选择。最后，我们引入表征车辆在簇内稳定性的参数，用于通信节点选择。这种协议分层使Qucts成为兼具离线与在线能力的解决方案。为区分簇内不稳定节点，对每条道路进行编码，配备规划路径的车辆（例如网约车和公交车）比较与簇内其他规划路径车辆的重叠率，低重叠率被标记为不稳定节点。无规划路径的车辆路径重叠率设为平均值。通过仿真将Qucts与现有路由协议进行对比，我们提出的Qucts方案在数据传输率和端到端延迟降低方面均有显著提升。