Have a personal or library account? Click to login
Adaptive Trajectory Optimization for UAV-IRS Systems in 6G Thz Networks Using Multi Agent-DRL Cover

Adaptive Trajectory Optimization for UAV-IRS Systems in 6G Thz Networks Using Multi Agent-DRL

Open Access
|Apr 2025

References

  1. Abdelsamad, S. E., Abdelteef, M.A., Elsheikh, O.Y., Ali, Y, A., Elsonni, T.H., Abdelhaq, M., Alsaqour, R., Saeed, R. A. (2023) Vision-based support for the detection and recognition of drones with small radar cross sections. Electronics, 12(10), 2235. doi:10.3390/electronics12102235.
  2. Abuzainab, N., Alrabeiah, M., Alkhateeb, A. & Sagduyu, Y. E. (2021) Deep learning for THz drones with flying intelligent surfaces: Beam and handoff prediction. In: Proceedings of 2021 IEEE International Conference on Communications Workshops (ICC Workshops), Montreal, June 2021. IEEE, 1-6. doi: 10.1109/ICCWorkshops50388.2021.9473804.
  3. Alatabani, L.E., Saeed, R.A., Sayed Ali Ahmed, E., Mokhtar, R.A., Khalifa, O.O., Hayder, G. (2023) Vehicular network spectrum allocation using hybrid NOMA and multi-agent reinforcement learning. In: Salih, G.H.A., Saeed, R.A. (eds) Sustainability Challenges and Delivering Practical Engineering Solutions. Advances in Science, Technology & Innovation. Springer, Cham. https://doi.org/10.1007/978-3-031-26580-8_23.
  4. Alghamdi, R., Alhadrami, R., Alhothali, D., Almorad, H., Faisal, A., Helal, S., Shalabi, R., Asfour, R., Hammad, N., Shams, A., Saeed, N., Dahrouj, H., Al-Naffouri, T.Y., Alouini, M.-S. (2020) Intelligent surfaces for 6G wireless networks: A survey of optimization and performance analysis techniques. IEEE Access, 8, 202795-202818. doi: 10.1109/ACCESS.2020.3031959.
  5. Alotibi, W. A., Alahmadi, M.F., Alsheri, A.H., Alnemari, R.V., Haji, L, A., Alsufyani, R.H., Alharthi, W.S., Almehmadi, H.F., Althaqafi, Sh.Kh., Alharthi, M.A., Balgoon, J.O., Saeed, R.A. (2024) Leveraging artificial intelligence and internet of things for advanced disaster drone technology. In: Proceedings of the 11th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI), Yogyakarta, September 2024. IEEE, 596-602. https://doi.org/10.1109/EECSI63442.2024.10776325.
  6. Alsaqour, R., Sayed Ali Ahmed, E., Mokhtar, R.A., Saeed, R.A., Alhumyani, H. and Abdelhaq, M. (2022) Efficient energy mechanism in heterogeneous WSNs for underground mining monitoring applications. IEEE Access, 10, 72907-72924, 2022, doi: 10.1109/ACCESS.2022.3188654.
  7. Alsolami, F., Alqurashi, F.A., Hasan, M. K., Saeed, R., Abdel-Khalek, S., Ishak, A. B. (2021) Development of self-synchronized drones‘ network using cluster-based swarm intelligence approach. IEEE Access, 9, 48010-48022. 10.1109/ACCESS.2021.3064905.
  8. Aziz, R., & Girici, T. (2022) Deployment of a UAV-Mounted Intelligent Reflecting Surface in the THz Band. In: Proceedings of International Balkan Conference on Communications and Networking (BalkanCom), Sarajevo, August 2022. IEEE, 168-172. doi: 10.1109/BalkanCom55633.2022.9900625.
  9. Elfatih, N. M., Sayed Ali Ahmed, E., Abdelhaq, M., Alsaqour, R., Saeed, R.A. (2023) A double threshold energy detection-based neural network for cognitive radio networks. Computer Systems Science and Engineering, 45(1), 329–342. https://doi.org/10.32604/csse.2023.028528.
  10. Elmadina, N. N., Saeid, E., Mokhtar, R.A., Saeed, R.A., Sayed Ali Ahmed, E. and Khalifa, O.O. (2023) Performance of power allocation under priority user in CR-NOMA. In: Proceedings of IEEE 3rd International Maghreb Meeting of the Conference on Sciences and Techniques of Automatic Control and Computer Engineering (MI-STA), Benghazi, May 2023. IEEE, 618-622. doi: 10.1109/MI-STA57575.2023.10169684.
  11. Elmadina, N. N., Saeed, R., Saeid, E., Sayed Ali Ahmed, E., Abdelhaq, M. & Alsaqour, R., A & Alharbe, N. (2023) Downlink power allocation for CR-NOMA-based femtocell D2D using greedy asynchronous distributed interference avoidance algorithm. Computers, 12(8), 158. doi:10.3390/computers12080158.
  12. Gu, J., Wang, H., Ding, G., Xu, Y., Xue, Z. and Zhou, H. (2020) Energy-constrained completion time minimization in UAV-enabled Internet of Things. IEEE Internet of Things Journal, 7(6), 5491–5503. doi: 10.1109/JIOT.2020.2981092.
  13. Hassan, M. B., Sayed Ali Ahmed, E., Saeed, R.A. (2021) Next Generation Wireless Terahertz Communication Networks. USA: CRC Press, pp. 267-297. https://doi.org/10.1201/9781003001140-13.
  14. Hassan, M., Goraya, M., Bilal, Kh., Saeed, R., Abdelhaq, M., Alsaqour, R., Odeh, N. (2023) Enhancing NOMA’s spectrum efficiency in a 5G network through cooperative spectrum sharing. Electronics, 12(4), 815. doi:10.3390/electronics12040815.
  15. Hassan, M., Goraya, M., Bilal, Kh., Saeed, R., Abdelhaq, M., Alsaqour, R. (2022) Design of power location coefficient system for 6G downlink cooperative NOMA network. Energies, 15(19), 6996. doi:10.3390/en15196996.
  16. Hassan, M., Saeed, R., Mokhtar, R. & Bilal, Kh., Sayed Ali Ahmed, E., Odeh, N., Goraya, M., Khalifa, O., Islam, Sh. (2023) BER improvement of cooperative spectrum sharing of NOMA in 5G Network (2023) In: Proceedings of IEEE 3rd International Maghreb Meeting of the Conference on Sciences and Techniques of Automatic Control and Computer Engineering (MI-STA), Benghazi, May 2023. IEEE, 647-652. doi: 10.1109/MI-STA57575.2023.10169494.
  17. Hassan, M., Saeed, R., Mokhtar, R., Bilal, Kh., Sayed Ali Ahmed, E., Odeh, N., Goraya, M., Khalifa, O., Islam, Sh. (2023) NOMA cooperative spectrum sharing average capacity improvement in 5G network. In: Proceedings of IEEE 3rd International Maghreb Meeting of the Conference on Sciences and Techniques of Automatic Control and Computer Engineering (MI-STA), Benghazi, May 2023. IEEE, 653-658. doi: 10.1109/MI-STA57575.2023.10169694.
  18. Hassan, M., Singh, M., Khamid, H., Saeed, R., Abdelgah, M., Alsaqour, R. (2022) Modeling of NOMA-MIMO-based power domain for 5G network under selective rayleigh fading channels. Energies, 15(15), 5668. https://doi.org/10.3390/en15155668.
  19. Hassan, Sh. S., Min Park, Y., Tun, Y.K., W. Saad, W., Han, Zh., and Hong, Ch.S. (2022) 3TO: THz-enabled throughput and trajectory optimization of UAVs in 6G networks by proximal policy optimization deep reinforcement learning. In: Proceedings of ICC 2022 - IEEE International Conference on Communications, Seoul, May 2022. IEEE, 5712-5718. doi: 10.1109/ICC45855.2022.9838676.
  20. Liu, Zh., Li, J., Jian, Sh., Wang, X., Chen, P. (2024). Leader–follower UAVs formation control based on a deep Q-network collaborative framework. Scientific Reports, 14(12), 4674. doi:10.1038/s41598-024-54531-w.
  21. Mustafa, Y., Sayed Ali Ahmed, E., Osman, Th., Khalifa, O., Mohamed, Z., Saeed, R., & Mamoon, S. (2024) Multi-drones energy efficient based path planning optimization using genetic algorithm and gradient decent approach. In: Proceedings of the 9th International Conference on Mechatronics Engineering (ICOM), Kuala Lumpur, August 2024. IEEE, 171-176. doi: 10.1109/ICOM61675.2024.10652441.
  22. Omar, Sh. S., Abd el haleem, A.M., Ibrahim, I., Saleh, A. (2023) Capacity enhancement of flying-IRS assisted 6G THz network using deep reinforcement learning. IEEE Access, 11, 101616-101629. doi: 10.1109/ACCESS.2023.3315660.
  23. Pan, Y., Wang, K., Pan, C., Zhu, H., Wang, J. (2021) UAV-assisted and intelligent reflecting surfaces-supported Terahertz communications. IEEE Wireless Communications Letters, 10(6), 1256-1260. doi: 10.1109/LWC.2021.3063365.
  24. Park, K-W., Kim, H. M., & Shin, O-S. (2022) A survey on intelligent-reflecting-surface-assisted UAV communications. Energies, 15(14), 5143. doi:10.3390/en15145143.
  25. Ranjha, A., Javed, M. A., Srivastava, G., & Asif, M., 2023. Quasi-optimization of resource allocation and positioning for solar-powered UAVs. IEEE Transactions on Network Science and Engineering, 10(6), 4071-4081. doi: 10.1109/TNSE.2023.3282870.
  26. Rehman, B.U., Babar, M.I., Ahmad, A.W., Alhumyani, H., Azim, G.A., Saeed, R.A., Abdel-Khalek, S. (2021) Joint power control and user grouping for uplink power domain non-orthogonal multiple access. International Journal of Distributed Sensor Networks, 17(12). doi:10.1177/15501477211057443.
  27. Rehman, B. U., Babar, M.I., Azim, G.A., Amir, M., Alhumyani, H., Alzaidi, M.S., Alshammari, M., Saeed, R.A. (2023) Uplink power control scheme for spectral efficiency maximization in NOMA systems. Alexandria Engineering Journal, 64, 667-677. doi:10.1016/j.aej.2022.11.030.
  28. Saeed, M. M., Saeed, R., Mokhtar, R., Khalifa, O.O., Ahmed, Z., Barakat, M., Elnaim, A.A. (2023) Task reverse offloading with deep reinforcement learning in multi-access edge computing. In: Proceedings of the 9th International Conference on Computer and Communication Engineering (ICCCE), Kuala Lumpur, August 2023. IEEE, 322-327. doi: 10.1109/ICCCE58854.2023.10246081.
  29. Saeed, R. A., Omri, M., Abdel-Khalek, S., Sayed Ali Ahmed, E., Alotaibi, M.F. (2022) Optimal path planning for drones based on swarm intelligence algorithm. Neural Computing & Applications, 34, 10133–10155. https://doi.org/10.1007/s00521-022-06998-9.
  30. Saeed, R.A., Saeid, E., Sayed Ali Ahmed, E., Nafea, I., Ahmed, M.A. (2024) Double deep RL-based strategy for UAV-assisted energy harvesting optimization in disaster-resilient IoT networks. In: Proceedings of 9th International Conference on Mechatronics Engineering (ICOM), Kuala Lumpur, August 2024. IEEE, 411-416. doi: 10.1109/ICOM61675.2024. 10652500.
  31. Sharma, P. K., & Kim, D. I. (2019) Random 3D mobile UAV networks: Mobility modeling and coverage probability. IEEE Transactions on Wireless Communications, 18(5), 2527-2538. doi: 10.1109/TWC.2019.2904564.
  32. Shen, Sh., Yang, K., Wang, K., Zhang, G., Mei, H. (2021) Number and operation time minimization for multi-UAV-enabled data collection system with time windows. IEEE Internet of Things Journal, 9(12), 10149–10161. doi: 10.1109/JIOT.2021.3121511.
  33. Song, Q., Jin, Sh., & Zheng, F. Ch. (2020) Completion time and energy consumption minimization for UAV-enabled multicasting. IEEE Wireless Communications Letters, 8(3), 821–824. doi: 10.1109/LWC.2019.2894684.
  34. Taneja, A., Rani, Shj., Raza, S., Jain, A., Sefat, Sh. M. (2023) Energy-efficient IRS-assisted 6G network for Industry 5.0. Scientific Reports, 13(1), 12814. doi:10.1038/s41598-023-39974-x.
  35. Wang, J., Zhao, Z., Qu, J. & Chen, X.M. (2024) APPA-3D: An autonomous 3D path planning algorithm for UAVs in unknown complex environments. Scientific Reports, 14(1), 1231. doi:10.1038/s41598-024-51286-2.
  36. Wu, B., Guo, D., Zhang, B., Zhang, X., Wang, H., Wang, H., Jiang, H. (2022) Completion time minimization for UAV-enabled data collection with communication link constraints. IET Communications, 16(10), 1025–1040. doi:10.1049/cmu2.12378.
  37. Wu, Q., Duong, T., Kwan Ng, D.W., Schober, R., Zhang, R. (2024) Intelligent surfaces empowered 6G wireless network. New York: Wiley-IEEE Press. p.368.
  38. Zeng, Y., Xu, J. & Zhang, R. (2019) Energy minimization for wireless communication with rotary-wing UAV. IEEE Transactions on Wireless Communications, 18(4), 2329–2345. doi: 10.1109/TWC.2019.2902559.
DOI: https://doi.org/10.2478/ttj-2025-0011 | Journal eISSN: 1407-6179 | Journal ISSN: 1407-6160
Language: English
Page range: 133 - 148
Published on: Apr 17, 2025
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2025 Nahla Nur Elmadina, Rashid A. Saeed, Elsadig Saeid, Ala Eldin Awouda, Hana M. Mujlid, Hashim Elshafie, published by Transport and Telecommunication Institute
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.