AHMA: An Adaptive Hierarchical Meta-Agent For Intelligent Congestion Control In IP Networks Using Machine Learning
By: Amit Kanungo and Prashant Panse
References
- V. Jacobson, “Congestion avoidance and control, ” ACM SIGCOMM Computer Communication Review, vol. 18, no. 4, 1988, pp. 314–329.
- S. Ha, I. Rhee, and L. Xu, “CUBIC: A new TCP-friendly high-speed TCP variant, ” ACM SIGOPS Operating Systems Review, vol. 42, no. 5, 2008, pp. 64–74.
- N. Cardwell, Y. Cheng, C. S. Gunn, S. H. Yeganeh, and V. Jacobson, “BBR: Congestion-based congestion control, ” Communications of the ACM, vol. 60, no. 2, 2017, pp. 58–66.
- M. Allman, V Paxson, V., & E. Blanton, “TCP congestion control, ” RFC5681, IETF, 2009.
- T. Henderson and R. Katz, “Transport protocols for Internet-compatible satellite networks, ” IEEE Journal on Selected Areas in Communications, vol. 17, no. 2, 1999, pp. 326–344.
- G. P. Perrucci, F. H. Fitzek and J. Widmer, “Survey on energy consumption entities on the smartphone platform, ” Proc. IEEE VTC, 2011, pp 1-6.
- C. Casetti, M. Gerla, S. Mascolo, M. Y. Sanadidi, and R. Wang, “TCP Westwood: Bandwidth estimation for enhanced transport over wireless links, ” Proc. MobiCom, 2001, pp. 287–297.
- L. Xu, K. Harfoush, and I. Rhee, “Binary increase congestion control for fast, long-distance networks, ” IEEEINFOCOM, 2004, pp. 2514–2524.
- S. Floyd, M. Handley, J. Padhye, and J. Widmer, “Promoting the use of end-to-end congestion control in the Internet, ” IEEE/ACM Transactions on Networking, vol. 13, no. 3, 2005, pp. 458–472.
- M. Scharf and H. Brakmo, “TCP Hystart++: Optimized slow start for high-bandwidth networks, ” IETF Draft, 2016.
- K. Winstein and H. Balakrishnan, “TCP ex machina: Computer-generated congestion control, ” Proc. ACM SIGCOMM, 2013, pp. 123–134.
- Dong, T. Meng, and J. Zhan, “PCC Vivace: Onlinelearning congestion control, ” Proc. USENIX NSDI, 2018, pp. 343–356.
- H. Jiang, Y. Zhang, J. Singh, and P. Levis, “Aurora: Learning adaptive congestion control with real-world experiments, ” Proc. ACM SIGCOMM, 2021, pp. 255–271.
- D. Silver, G. Lever, N. Heess, T. Degris, D. Wierstra, and M. Riedmiller, “Deterministic policy gradient algorithms, ” Proc. ICML, vol. 32, no. 1, 2014, pp. 387–395.
- J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms, ” arXiv preprint, 20 Jul. 2017; doi: arXiv.1707.06347.
- V. Mnih, K. Kavukcuoglu, D. Silver, et al., “Humanlevel control through deep reinforcement learning, ” Nature, vol. 518, no. 7540, 2015, pp. 529–533.
- T. Degris, P. M. Pilarski, and R. S. Sutton, “Model-free reinforcement learning with continuous action in practice, ” Proc. ACC, 2012, pp. 741–748.
- C. Finn, P. Abbeel, and S. Levine, “Modelagnostic meta-learning for fast adaptation of deep networks, ” Proc. ICML, 2017, pp.1126-1135.
- Y. Duan, J. Schulman, X. Chen, X., et al, “RL2: Fast reinforcement learning via slow reinforcement learning, ” arXiv preprint, 9 Nov. 2016; doi:arXiv.1611.02779.
- T. Salimans, J. Ho, X. Chen, and I. Sutskever, “Evolution strategies as a scalable alternative to reinforcement learning, ” arXiv preprint, 10 Mar. 2017; doi:arXiv.1703.03864.
- Y Gal and Z. Ghahramani, “Dropout as a Bayesian approximation: Representing model uncertainty in deep learning, ” Proc. ICML, 2016, pp. 1050–1059.
- A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet classification with deep convolutional neural networks, ” Proc. NeurIPS, 2012, pp. 1097–1105.
- A. Goyal, N. R. Ke, K. Madan, A. Lamb, B. Scholkopf, and Y. Bengio, “Fast and Slow Learning of Recurrent Independent Mechanisms, ” in Proc. Int. Conf. Learning Representations (ICLR), 2021.
- J. Xing and M. Shahzad, “A reinforcement learning framework for application-specific TCP congestion-control, ” arXiv preprint, 11 May 2025; doi: 10.48550/arXiv.2505.07042.
- X. Jiang, G. Gong, and G. Jin, “Combining heuristic and reinforcement learning to achieve the lowlatency and high-throughput receiver-side congestion control, ” arXiv preprint, 23 Feb 2025; doi:arXiv.2502.16498.
- X. Liao, H. Tian, C. Zeng, X. Wan, and K. Chen, “Astraea: Toward fair and efficient learningbased congestion control, ” Proc. Eurosys, 2024, pp. 99–114.
- X. Huang, H. Zhu, L. Yang, C. Yin, J. Li, and H. Li, “TCP-QNCC: Congestion control algorithm based on deep Q-network, ” Proc. SPIEAICS, vol. 12803, 2023, 1280308.
- K.S. Midhula and P. Arun Raj Kumar, “An adaptive congestion control protocol for wireless networks using deep reinforcement learning, ” IEEE Trans. Netw. Serv. Manag., vol. 21, no. 2, 2023, pp. 2027–2043.
Language: English
Page range: 126 - 133
Submitted on: Jul 28, 2025
Accepted on: Sep 11, 2025
Published on: Jun 22, 2026
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year
Keywords:
Related subjects:
© 2026 Amit Kanungo, Prashant Panse, published by Łukasiewicz Research Network – Industrial Research Institute for Automation and Measurements PIAP
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.