Neuroroute-GNNRL: A Hybrid Graph Neural and Reinforcement Learning Framework For Dynamic Node Classification and Speed

Dynamic and complex networks like smart transportation systems, communication infrastructures, and sensor-based Internet of Things (IoT) contexts typically require proper routing and flexible node behaviors to ensure good performance and low latency. We present a new idea of NeuroRoute-GNNRL, the hybrid framework of graph neural networks (GNNs) and reinforcement learning (RL) to effectively implement real-time dynamic node categorization and speed optimization in an evolving network environment seamlessly. GNNs are utilized to learn what are known as the structural dependencies and feature distributions among the nodes in a network so that high-level representations of the graphs can be extracted. Such embeddings are then leveraged by a RL agent, which makes intelligent routing and speed alteration decisions. By interacting with the network, the RL agent learns an optimal policy to maximize throughput and to minimize delays. An experimental comparison with both synthetic and real-world dataset shows the advantage of NeuroRoute-GNNRL over conventional graph-based and machine learning-based methods. The comparison is made in terms of accuracy rate and adaptation capabilities, as well as the performance of the entire network.