Skip to main content
Have a personal or library account? Click to login
Vision-Based Gesture-Controlled Mobile Robot for Human–Robot Interaction Using ROS 2 Cover

Vision-Based Gesture-Controlled Mobile Robot for Human–Robot Interaction Using ROS 2

Open Access
|Sep 2026
Read online

References

  1. T. B. Sheridan, “Human–robot interaction: status and challenges,” Human Factors, vol. 58, no. 4, pp. 525–532, 2016.
  2. C. Bartneck, T. Belpaeme, F. Eyssel, T. Kanda, M. Keijsers, and S. Šabanović, Human-robot interaction: An introduction. Cambridge University Press, 2024.
  3. T. Turja, T. Rantanen, and A. Oksanen, “Robot use self-efficacy in healthcare work (RUSH): development and validation of a new measure,” AI & Society, vol. 34, no. 1, pp. 137–143, 2019.
  4. H. Liu and L. Wang, “Gesture recognition for human-robot collaboration: A review,” International Journal of Industrial Ergonomics, vol. 68, pp. 355–367, 2018.
  5. S. Sreenath, D. I. Daniels, A. S. D. Ganesh, Y. S. Kuruganti, and R. G. Chittawadigi, “Monocular tracking of human hand on a smart phone camera using mediapipe and its application in robotics,” in 2021 IEEE 9th Region 10 Humanitarian Technology Conference (R10-HTC), 2021, pp. 1–6.
  6. M. Soori, B. Arezoo, and R. Dastres, “Artificial intelligence, machine learning and deep learning in advanced robotics, a review,” Cognitive Robotics, vol. 3, pp. 54–70, 2023.
  7. D. Kim, S.-H. Kim, T. Kim, B. B. Kang, M. Lee, W. Park, S. Ku, D. Kim, J. Kwon, H. Lee, et al., “Review of machine learning methods in soft robotics,” PLOS ONE, vol. 16, no. 2, p. e0246102, 2021.
  8. T. B. Waskito, S. Sumaryo, and C. Setianingsih, “Wheeled robot control with hand gesture based on image processing,” in 2020 IEEE International Conference on Industry 4.0, Artificial Intelligence, and Communications Technology (IAICT), 2020, pp. 48–54.
  9. P. N. Huu, Q. T. Minh, et al., “An ANN-based gesture recognition algorithm for smart-home applications,” KSII Transactions on Internet and Information Systems (TIIS), vol. 14, no. 5, pp. 1967–1983, 2020.
  10. B. J. Boruah, A. K. Talukdar, and K. K. Sarma, “Development of a learning-aid tool using hand gesture based human computer interaction system,” in 2021 Advanced Communication Technologies and Signal Processing (ACTS), 2021, pp. 1–5.
  11. S. Macenski, T. Foote, B. Gerkey, C. Lalancette, and W. Woodall, “Robot operating system 2: Design, architecture, and uses in the wild,” Science Robotics, vol. 7, no. 66, p. eabm6074, 2022.
  12. S. Macenski, T. Moore, D. V. Lu, A. Merzlyakov, and M. Ferguson, “From the desks of ROS maintainers: A survey of modern & capable mobile robotics algorithms in the robot operating system 2,” Robotics and Autonomous Systems, vol. 168, p. 104493, 2023.
  13. A. Bonci, F. Gaudeni, M. C. Giannini, and S. Longhi, “Robot Operating System 2 (ROS2)-based frameworks for increasing robot autonomy: A survey,” Applied Sciences, vol. 13, no. 23, p. 12796, 2023.
  14. Y. Ye, Z. Nie, X. Liu, F. Xie, Z. Li, and P. Li, “ROS2 real-time performance optimization and evaluation,” Chinese Journal of Mechanical Engineering, vol. 36, no. 1, p. 144, 2023.
  15. Slama, Rim, Wael Rabah, and Hazem Wannous. ”Online hand gesture recognition using Continual Graph Transformers.” arXiv preprint arXiv:arXiv:2502.14939 (2025).
  16. Shin, J., Miah, A. S. M., Kabir, M. H., Rahim, M. A., and Al Shiam, A. (2024). ”A methodological and structural review of hand gesture recognition across diverse data modalities.” IEEE Access.
  17. Rezaee, Khosro, et al. ”Hand gestures classification of sEMG signals based on BiLSTM-metaheuristic optimization and hybrid U-Net-MobileNetV2 encoder architecture.” Scientific Reports, vol. 14, no. 1, 2024, p. 31257.
  18. Abdelaziz, Mai H., Wael A. Mohamed, and Ayman S. Selmy. ”Hand gesture recognition based on electromyography signals and deep learning techniques.” Journal of Advances in Information Technology, vol. 15, no. 2, 2024.
  19. Al-Qaness, Mohammed A. A., and Sike Ni. ”TCNN-KAN: Optimized CNN by Kolmogorov-Arnold network and pruning techniques for semg gesture recognition.” IEEE Journal of Biomedical and Health Informatics, 2024.
DOI: https://doi.org/10.14313/jamris-2026-040 | Journal eISSN: 2080-2145 | Journal ISSN: 1897-8649
Language: English
Page range: 86 - 93
Submitted on: Mar 24, 2025
Accepted on: May 9, 2025
Published on: Sep 30, 2026
Published by: Łukasiewicz Research Network – Industrial Research Institute for Automation and Measurements PIAP
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2026 Kaveh Hooshmandi, Mahdi Molavi, published by Łukasiewicz Research Network – Industrial Research Institute for Automation and Measurements PIAP
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.