Have a personal or library account? Click to login
A Deep Reinforcement-Learning-Based Relay Selection for Underwater Sensors Network Cover

A Deep Reinforcement-Learning-Based Relay Selection for Underwater Sensors Network

Open Access
|Oct 2023

References

  1. K. Latif, N. Javaid, I. Ullah, Z. Kaleem, Z. Abbas, and L. D. Nguyen, “DIEER: Delay-intolerant energy-efficient routing with sink mobility in underwater wireless sensor networks,” Sens., vol. 20, no. 12, p. 3467, 2020.
  2. G. Khan, R. Dwivedi, and K. K. Gola, “Comparative analysis of routing algorithms for underwater sensor network,” in Pervasive Computing A Networking Perspective and Future Directions. Springer, 2019, pp. 31–46.
  3. A. Abuarqoub, M. Hammoudeh, B. Adebisi, S. Jabbar, A. Bounceur, and H. Al-Bashar, “Dynamic clustering and management of mobile wireless sensor networks,” Comput. Netw., vol. 117, pp. 62–75, 2017.
  4. Y. Su, R. Fan, and Z. Jin, “ORIT: A transport layer protocol design for underwater DTN sensor networks,” IEEE Access, vol. 7, pp. 69 592–69 603, 2019.
  5. I. Ahmad and K. Chang, “Downlink power allocation strategy for next-generation underwater acoustic communications networks,” Electr., vol. 8, no. 11, p. 1297, 2019.
  6. T. Melodia, H. Kulhandjian, L.-C. Kuo, E. Demirors, S. Basagni, M. Conti, S. Giordano, and I. Stojmenovic, Advances in Underwater Acoustic Networking. Wiley Online Library, 2013.
  7. C. R. Berger, S. Zhou, J. C. Preisig, and P. Willett, “Sparse channel estimation for multicarrier underwater acoustic communication: From subspace methods to compressed sensing,” IEEE Trans. Signal Process., vol. 58, no. 3, pp. 1708–1721, 2009.
  8. M. Stojanovic and J. Preisig, “Underwater acoustic communication channels: Propagation models and statistical characterization,” IEEE Commun. Mag., vol. 47, no. 1, pp. 84–89, 2009.
  9. S. Jabbar, M. Ahmad, K. R. Malik, S. Khalid, J. Chaudhry, and O. Aldabbas, “Designing an energy-aware mechanism for lifetime improvement of wireless sensor networks: A comprehensive study,” Mobile Netw. Appl., vol. 23, no. 3, pp. 432–445, 2018.
  10. S. H. PARK and D. GRACE, “Reinforcement learning based mac protocol (uw-aloha-qm) for mobile underwater acoustic sensor networks,” IEEE Access, pp. 5906–5919, 2020.
  11. R. I. B. S. D. Muruganathan, D. C. F. Ma and A. O. Fapojuwo, “A centralized energy-efficient routing protocol for wireless sensor networks,” IEEE Commun. Mag., vol. 43, no. 3, pp. S8–13, 2005.
  12. B. S. F. Boavida and E. Monteiro, “Vbf: Vector-based forwarding protocol for underwater sensor networks,” Networking Technologies, Services and Protocols, pp. 1216–1221, 2006.
  13. N. Y. H. Yu and J. Liu, “An adaptive routing protocol in underwater sparse acoustic sensor networks,” Ad Hoc Netw, pp. 121–143, 2015.
  14. A. S. N. Nicolaou and D. Maggiorini, “Improving the robustness of location-based routing for underwater sensor networks,” IEEE OCEANS, pp. 1–6, 2007.
  15. R. Coutinho and A. Boukerche, “Hydrocast: Pressure routing for underwater sensor networks,” IEEE Trans. Veh. Technol., vol. 65, no. 1, pp. 333–347, 2016.
  16. N. J. et al, “Cooperative opportunistic pressure based routing for underwater wireless sensor networks,” Sensors, vol. 17, no. 3, p. 629, 2017.
  17. K. Saeed, W. Khalil, S. Ahmed, I. Ahmad, and M. N. K. Khattak, “SEECR: secure energy efficient and cooperative routing protocol for underwater wireless sensor networks,” IEEE Access, vol. 8, pp. 107 419–107 433, 2020.
  18. A. A. A. El-Banna, K. Wu, and B. M. ElHalawany, “Opportunistic cooperative transmission for underwater communication based on the water’s key physical variables,” IEEE Sensors J., vol. 20, no. 5, pp. 2792–2802, 2019.
  19. S. Khadim, F. Riaz, S. Jabbar, S. Khalid, and M. Aloqaily, “A non-cooperative rear-end collision avoidance scheme for non-connected and heterogeneous environment,” Comput. Commun., vol. 150, pp. 828–840, 2020.
  20. H. Tran-Dang and D.-S. Kim, “Channel-aware cooperative routing in underwater acoustic sensor networks,” J. commun. Netw-s, vol. 21, no. 1, pp. 33–44, 2019.
  21. X. L. et al, “Marl-based distributed cache placement for wireless networks,” IEEE Access, vol. 7, pp. 62 606–62 615, 2019.
  22. T. Hu, “Qelar: A machine-learning-based adaptive routing protocol for energy-efficient and lifetime-extended underwater sensor networks,” IEEE Trans. Mobile Computing, vol. 6, no. 6, pp. 796–809, 2010.
  23. T. Hu and Y. Fei, “Murao: A multi-level routing protocol for acoustic optical hybrid underwater wireless sensor networks,” in 9th Annu. IEEE Commun. Soc. Conf. Sensor, 2012, pp. 218–116.
  24. I. Ahmad and K. Chang, “Effective SNR mapping and link adaptation strategy for next-generation underwater acoustic communications networks: a cross-layer approach,” IEEE Access, vol. 7, pp. 44 150–44 164, 2019.
  25. A. Bletsas, A. Khisti, D. P. Reed, and A. Lippman, “A simple cooperative diversity method based on network path selection,” IEEE J. Sel. Areas Commun., vol. 24, no. 3, pp. 659–672, 2006.
  26. G. W. H. Wu and X. Lin, “On the effectiveness of opportunistic routing over wireless mesh networks,” in 6th Int. Conf. Wireless Commun. Netw. Mobile Comput, 2010, pp. 1–4.
  27. H. X. K. Tang, C. Li and J. Zou, “Reinforcement learning-based opportunistic routing for live video streaming over multihop wireless networks,” in IEEE 19th Int . Workshop Multimedia Signal Process, 2017, pp. 1–6.
  28. H. J. X. He and H. Xiao, “Routing selection with reinforcement learning for energy harvesting multi-hop crn,” IEEE Access, vol. 7, pp. 54 435–54 448, 2019.
  29. Z. Z. Ying Zhang and X. Wang, “Reinforcement learning-based opportunistic routing protocol for underwater acoustic sensor networks,” IEEE Transaction on Vehicular Technology, vol. 70, no. 3, pp. 2756–2770, 2021.
  30. R. Narmeen and S. Muhaidat, “Shortest propagation delay-based relay selection for underwater acoustic sensor networks,” IEEE Access, pp. 37 923–37 935, 2021.
Language: English
Page range: 5 - 13
Submitted on: Mar 20, 2023
Accepted on: Jul 10, 2023
Published on: Oct 14, 2023
Published by: Future Sciences For Digital Publishing
In partnership with: Paradigm Publishing Services
Publication frequency: 2 issues per year

© 2023 Muhmmad Waleed Aftab, Sajjad Hussain, Aftab Husain, Umar Ali Khan, Hamza Kundi, published by Future Sciences For Digital Publishing
This work is licensed under the Creative Commons Attribution 4.0 License.