Technical Skills Assessment in Robotic Surgery: A Review of Recent Methods
References
- Sheetz KH, Claflin J, Dimick JB. Trends in the Adoption of Robotic Surgery for Common Surgical Procedures. JAMA Network Open. 2020;3(1):
e1918911 . doi: 10.1001/jamanetworkopen.2019.18911 - Intuitive Surgical [Internet]. Sunnyvale, CA: Intuitive Surgical; c2025.
Intuitive reaches 10 million procedures performed using da Vinci surgical systems ; 2021 Dec 14 [cited 2025 Jun 27]. Available from:https://isrg.intuitive.com/news-releases/news-release-details/intuitive-reaches-10-million-procedures-performed-using-da-vinci - Intuitive Surgical [Internet]. Sunnyvale, CA: Intuitive Surgical; c2025.
Intuitive da Vinci ; 2025 [cited 2025 Aug 26]. Available from:https://www.intuitive.com/en-us/products-and-services/da-vinci - Corcione F, Esposito C, Cuccurullo D, et al. Advantages and limits of robot-assisted laparoscopic surgery: preliminary experience. Surg Endosc. 2005 Jan;19(1):117-9. doi: 10.1007/s00464-004-9004-9
- Han J, Davids J, Ashrafian H, Darzi A, Elson DS, Sodergren M. A systematic review of robotic surgery: From supervised paradigms to fully autonomous robotic approaches. Int J Med Robot. 2022 Apr;18(2):
e2358 . doi: 10.1002/rcs.2358 - Barbash GI, Glied SA. New technology and health care costs — the case of robot-assisted surgery. New Engl J Med. 2010 Aug;363(8):701-704. doi: 10.1056/NEJMp1006602
- Birkmeyer JD, Finks JF, OReilly A, et al. Surgical skill and complication rates after bariatric surgery. New Engl J Med. 2013 Oct 10;369(15):1434-1442. doi: 10.1056/NEJMsa1300625
- Moorthy K, Munz Y, Sarker SK, Darzi A. Objective assessment of technical skills in surgery. British Med J. 2003 Nov 1;327(7422):1032-7. doi: 10.1136/bmj.327.7422.1032
- Levin G, Siedhoff M, Wright KN, et al. Robotic surgery in obstetrics and gynecology: a bibliometric study. J Robot Surg. 2023 Jul 10;17(5):2387-2397. doi: 10.1007/s11701-023-01672-1
- Lavanchy JL, Zindel J, Kirtac K, et al. Automation of surgical skill assessment using a three- stage machine learning algorithm. Sci Rep. 2021 Apr 20;11(1):5197. doi: 10.1038/s41598-021-88175-x
- Martin JA, Regehr G, Reznick R, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997 Feb;84(2):273-278. doi: 10.1046/j.1365-2168.1997.02502.x
- Goh AC, Goldfarb DW, Sander JC, Miles BJ, Dunkin BJ. Global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills. J Urol. 2012 Jan;187(1):247-52. doi: 10.1016/j.juro.2011.09.032
- Vassiliou MC, Feldman LS, Andrew CG, et al. A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg. 2005 Jul;190(1):107-13. doi: 10.1016/j.amjsurg.2005.04.004
- Reiley CE, Lin HC, Yuh DD, Hager GD. Review of methods for objective surgical skill evaluation. Surg Endosc. 2011 Feb;25(2):356-66. doi: 10.1007/s00464-010-1190-z
- Tarr M, Rivard C, Petzel A, et al. Robotic objective structured assessment of technical skills: A randomized multicenter dry laboratory training pilot study. Female Pelvic Med Reconstr Surg. 2014 Jul-Aug;20(4):228-36. doi: 10.1097/SPV.0000000000000067
- Gomez E, Aggarwal R, McMahan W, Bark K, Kuchenbecker K. Objective assessment of robotic surgical skill using instrument contact vibrations. Surg Endosc. 2016 Apr;30(4):1419-31. doi: 10.1007/s00464-015-4346-z
- Willems J, Shin A, Shin D, Bishop A, Shin A. A comparison of robotically assisted microsurgery versus manual microsurgery in challenging situations. Plast Reconstr Surg. 2016 Apr;137(4):1317-1324. doi: 10.1097/PRS.0000000000002030
- Chen Q-Y, Zhong Q, Liu Z-Y, et al. Surgical outcomes, technical performance, and surgery burden of robotic total gastrectomy for locally advanced gastric cancer a prospective study. Ann Surg. 2022 Nov 1;276(5):e434-e443. doi: 10.1097/SLA.0000000000004764
- Chen C, Malpani A, Waldram M, et al. Effect of pre-operative warm-up on trainee intraoperative performance during robot-assisted hysterectomy: a randomized controlled trial. Int Urogynecol J. 2023 Nov;34(11):2751-2758. doi: 10.1007/s00192-023-05595-1
- Moncayo S, Compagnon R, Caire F, et al. Transition effects from laparocscopic to robotic surgery skills in small cavities. J Robot Surg. 2020 Jun;14(3):525-530. doi: 10.1007/s11701-019-01024-y
- Farah E, Abreu A, Rail B, et al. Adapting to a Robotic Era: The Transferability of Open and Laparoscopic Skills to Robotic Surgery. J Surg Educ. 2023 Dec;80(12):1868-1876. doi: 10.1016/j.jsurg.2023.08.014
- Liu ZY, Zhong Q, Wang ZB, et al. Appraisal of surgical outcomes and oncological efficiency of intraoperative adverse events in robotic radical gastrectomy for gastric cancer. Surg Endosc. 2024 Apr;38(4):2027-2040. doi: 10.1007/s00464-024-10736-8
- Tam V, Zenati M, Novak S, et al. Robotic Pancreatoduodenectomy Biotissue Curriculum has Validity and Improves Technical Performance for Surgical Oncology Fellows. J Surg Educ. 2017 Nov-Dec;74(6):1057-1065. doi: 10.1016/j.jsurg.2017.05.016
- Robison W, Patel S, Mehta A, et al. Can fatigue affect acquisition of new surgical skills? A prospective trial of pre- and post-call general surgery residents using the da Vinci surgical skills simulator. Surg Endosc. 2018 Mar;32(3):1389-1396. doi: 10.1007/s00464-017-5820-6
- Rail B, Abreu A, Farah E, et al. Learning Curve of a Robotic Bio-Tissue Intestinal Anastomosis: Implications for Surgical Training Curricula. J Surg Educ. 2024 Dec;81(12):103296. doi: 10.1016/j.jsurg.2024.09.015
- Shin D, Dalag L, Azhar R, et al. A novel interface for the telementoring of robotic surgery. BJU Int. 2015 Aug;116(2):302-8. doi: 10.1111/bju.12985
- Kelly J, Nash M, Heller N, Lendvay T, Kowalewski T. Temporal variability of surgical technical skill perception in real robotic surgery. Int J Comp Assist Radiol Surg. 2020 Dec;15(12):2101-2107. doi: 10.1007/s11548-020-02253-5
- Laca J, Kocielnik R, Nguyen J, et al. Using Real-time Feedback To Improve Surgical Performance on a Robotic Tissue Dissection Task. Eur Urol Open Sci. 2022 Oct 22:46:15-21. doi: 10.1016/j.euros.2022.09.015
- Roberts S, Cen S, Nguyen J, et al. The Relationship Between Technical Skills, Cognitive Workload, and Errors During Robotic Surgical Exercises. J Endourol. 2022 May;36(5):712-720. doi: 10.1089/end.2021.0790
- Chowriappa A, Raza S, Fazili A, et al. Augmented-reality-based skills training for robot-assisted urethrovesical anastomosis: A multi-institutional randomised controlled trial. BJU Int. 2015 Feb;115(2):336-45. doi: 10.1111/bju.12704
- Raison N, Ahmed K, Abe T, et al. Cognitive training for technical and nontechnical skills in robotic surgery: a randomised controlled trial. BJU Int. 2018 Dec;122(6):1075-1081. doi: 10.1111/bju.14376
- Liu M, Purohit S, Mazanetz J, Allen W, Kreaden U, Curet M. Assessment of Robotic Console Skills (ARCS): construct validity of a novel global rating scale for technical skills in robotically assisted surgery. Surg Endosc. 2018 Jan;32(1):526-535. doi: 10.1007/s00464-017-5694-7
- Bendre H, Rajender A, Barbosa P, Wason S. Robotic dismembered pyeloplasty surgical simulation using a 3D- printed silicone-based model: development, face validation and crowdsourced learning outcomes assessment. J Robot Surg. 2020 Dec;14(6):897-902. doi: 10.1007/s11701-020-01072-9
- Laverty R, Khan M, Patnaik R, et al. Intentional enterotomies: validation of a novel robotic surgery training exercise. J Robot Surg. 2023 Oct;17(5):2109-2115. doi: 10.1007/s11701-023-01625-8
- Gorard J, Boal M, Swamynathan V, Ghamrawi W, Francis N. The application of objective clinical human reliability analysis (OCHRA) in the assessment of basic robotic surgical skills. Surg Endosc. 2024 Jan;38(1):116-128. doi: 10.1007/s00464-023-10510-2
- Zia A, Essa I. Automated surgical skill assessment in RAMIS training. Int J Comput Assist Radiol Surg. 2018 May;13(5):731-739. doi: 10.1007/s11548-018-1735-5
- Newcomb L, Bradley M, Truong T, et al. Correlation of Virtual Reality Simulation and Dry Lab Robotic Technical Skills. J Minim Invasive Gynecol. 2018 May-Jun;25(4):689-696. doi: 10.1016/j.jmig.2017.11.006
- Nathan A, Patel S, Georgi M, et al. Virtual classroom proficiency-based progression for robotic surgery training (VROBOT): a randomised, prospective, cross-over, effectiveness study. J Robot Surg. 2023 Apr;17(2):629-635. doi: 10.1007/s11701-022-01467-w
- Brocke T, Fox C, Clanahan J, et al. Extrapolative Validity Evidence of the Anastomosis Objective Structured Assessment of Technical Skill (A-OSATS) for Robotic Ileocolic Anastomosis. J Surg Edu. 2024 Nov;81(11):1577-1584. doi: 10.1016/j.jsurg.2024.07.021
- Selber J, Alrasheed T. Robotic microsurgical training and evaluation. Semin Plast Surg. 2014 Feb;28(1):5-10. doi: 10.1055/s-0034-1368161
- Boal M, Afzal A, Gorard J, et al. Development and evaluation of a societal core robotic surgery accreditation curriculum for the UK. J Robot Surg. 2024 Aug 6;18(1):305. doi: 10.1007/s11701-024-02062-x
- Sirajudeen N, Boal M, Anastasiou D, et al. Deep learning prediction of error and skill in robotic prostatectomy suturing. Surg Endosc. 2024 Dec;38(12):7663-7671. doi: 10.1007/s00464-024-11341-5
- Amazon Mechanical Turk [Internet]. Seattle, WA: Amazon Mechanical Turk; c2025.
Home page ; 2025 [cited 2025 Aug 27]. Available from:https://www.mturk.com - White L, Kowalewski T, Dockter R, Comstock B, Hannaford B, Lendvay T. Crowd-sourced assessment of technical skill: A valid method for discriminating basic robotic surgery skills. J Endourol. 2015 Nov;29(11):1295-301. doi: 10.1089/end.2015.0191
- Oh P, Chen J, Hatcher D, Djaladat H, Hung A. Crowdsourced versus expert evaluations of the vesico-urethral anastomosis in the robotic radical prostatectomy: is one superior at discriminating differences in automated performance metrics? J Robot Surg. 2018 Dec;12(4):705-711. doi: 10.1007/s11701-018-0814-5
- Mendelsohn A, Kim C, Song J, et al. Transoral Robotic Surgical Proficiency Via Real-Time Tactile Collision Awareness System. Laryngoscope. 2020 Dec:130 Suppl 6:S1-S17. doi: 10.1002/lary.29034
- Malpani A, Vedula S, Chen C, Hager G. A study of crowdsourced segment-level surgical skill assessment using pairwise rankings. Int J Comput Assist Radiol Surg. 2015 Sep;10(9):1435-47. doi: 10.1007/s11548-015-1238-6
- Shay S, Chrin J, Wang M, Mendelsohn A. Initial and Long-term Retention of Robotic Technical Skills in an Otolaryngology Residency Program. Laryngoscope. 2019 Jun;129(6):1380-1385. doi: 10.1002/lary.27425
- Satava R, Stefanidis D, Levy J, et al. Proving the effectiveness of the fundamentals of robotic surgery (FRS) skills curriculum: A single-blinded, multispecialty, multi-institutional randomized control trial. Ann Surg. 2020 Aug;272(2):384-392.
- Mariani A, Pellegrini E, De Momi E. Skill-Oriented and Performance-Driven Adaptive Curricula for Training in Robot-Assisted Surgery Using Simulators: A Feasibility Study. IEEE Trans Biomed Eng. 2021 Feb;68(2):685-694. doi: 10.1109/TBME.2020.3011867
- Kelly J, Kowalewski T, Brand T, et al. Virtual Reality Warm-up Before Robot-assisted Surgery: A Randomized Controlled Trial. J Surg Res. 2021 Aug:264:107-116. doi: 10.1016/j.jss.2021.01.037
- Hardon S, Willuth E, Rahimi A, et al. Crossover-effects in technical skills between laparoscopy and robot-assisted surgery. Surg Endosc. 2023 Aug;37(8):6015-6024. doi: 10.1007/s00464-023-10045-6
- Rahimi A, Hardon S, Willuth E, et al. Force-based assessment of tissue handling skills in simulation training for robot-assisted surgery. Surg Endosc. 2023 Jun;37(6):4414-4420. doi: 10.1007/s00464-023-09905-y
- CiNii Research [Internet]. Tokyo, Japan: National Institute of Informatics; c2025. DiMaio S, Hasser C.
The da Vinci Research Interface ; 2025 May 12 [cited 2025 Aug 27]. Available from:https://cir.nii.ac.jp/crid/1360298341437258240 - Fard MJ, Ameri S, Darin Ellis R, Chinnam RB, Pandya AK, Klein MD. Automated robot-assisted surgical skill evaluation: Predictive analytics approach. Int J Med Robot. 2018 Feb;14(1). doi: 10.1002/rcs.1850
- Vedula S, Malpani A, Ahmidi N, Khudanpur S, Hager G, Chen C. Task-Level vs. Segment-Level Quantitative Metrics for Surgical Skill Assessment. J Surg Educ. 2016 May-Jun;73(3):482-9. doi: 10.1016/j.jsurg.2015.11.009
- Singh H, Modi H, Ranjan S, et al. Robotic Surgery Improves Technical Performance and Enhances Prefrontal Activation During High Temporal Demand. Ann Biomed Eng. 2018 Oct;46(10):1621-1636. doi: 10.1007/s10439-018-2049-z
- Patel R, Suwa Y, Kinross J, et al. Neuroenhancement of surgeons during robotic suturing. Surg Endosc. 2022 Jul;36(7):4803-4814. doi: 10.1007/s00464-021-08823-1
- Malpani A, Vedula S, Lin H, Hager G, Taylor R. Effect of real-time virtual reality-based teaching cues on learning needle passing for robot-assisted minimally invasive surgery: a randomized controlled trial. Int J Comput Assist Radiol Surg. 2020 Jul;15(7):1187-1194. doi: 10.1007/s11548-020-02156-5
- Wang Z, Mariani A, Menciassi A, De Momi E, Fey A. Uncertainty-Aware Self-Supervised Learning for Cross-Domain Technical Skill Assessment in Robot-Assisted Surgery. IEEE Trans Med Robot Bionics. 2023 May;5(2):301-11. doi: 10.1109/TMRB.2023.3272008
- Kheshvadjian M, Nazmifar M, Rawal R, et al. Implementation and Validation of a High-fidelity Simulation Model for Surgical Resident Training: Management of Acute Intraoperative Hemorrhage during Robot-assisted Surgery. Urology. 2024 Sep:191:185-192. doi: 10.1016/j.urology.2024.06.055
- Wong E, Chu T, Ma R, et al. Development of a Classification System for Live Surgical Feedback. JAMA Network Open. 2023 Jun 1;6(6):
e2320702 . doi: 10.1001/jamanetworkopen.2023.20702 - Johns Hopkins University [Internet]. Baltimore, MD: Johns Hopkins University; c2025. Gao Y, Vedula SS, Reiley CE, et al.
Jhu-isi gesture and skill assessment working set (jigsaws): A surgical activity dataset for human motion modeling ; 2014 [cited 2025 Aug 27]. Available from:https://cirl.lcsr.jhu.edu/wp-content/uploads/dlm_uploads/2014/09/JIGSAWS.pdf - Wang Z, Majewicz Fey A. Deep learning with convolutional neural network for objective skill evaluation in robot-assisted surgery. Int J Comput Assist Radiol Surg. 2018 Dec;13(12):1959-1970. doi: 10.1007/s11548-018-1860-1
- Springer Nature [Internet]. Berlin, Germany: Springer Nature; c2025. Ismail Fawaz H, Forestier G, Weber J, Idoumghar L, Muller P-A.
Evaluating Surgical Skills from Kinematic Data Using Convolutional Neural Networks ; 2018 Sep 13 [cited 2025 Aug 27]. doi: 10.1007/978-3-030-00937-3_25 - Benmansour M, Malti A, Jannin P. Deep neural network architecture for automated soft surgical skills evaluation using objective structured assessment of technical skills criteria. Int J Comput Assist Radiol Surg. 2023 May;18(5):929-937. doi: 10.1007/s11548-022-02827-5
- Funke I, Mees S, Weitz J, Speidel S. Video-based surgical skill assessment using 3D convolutional neural networks. Int J Comput Assist Radiol Surg. 2019 Jul;14(7):1217–1225. doi: 10.1007/s11548-019-01995-1
- Lee D, Yu H, Kwon H, Kong HJ, Lee K, Kim H. Evaluation of surgical skills during robotic surgery by deep learning-based multiple surgical instrument tracking in training and actual operations. J Clin Med. 2020 Jun 23;9(6):1964. doi: 10.3390/jcm9061964
- Arxiv [Internet]. New York, NY: Cornell University; c2025. Psychogyios D, Colleoni E, Van Amsterdam B, et al.
SAR-RARP50: Segmentation of surgical instrumentation and action recognition on robot-assisted radical prostatectomy challenge ; 2023 Dec 31 [cited 2025 Aug 27]. Available from:https://arxiv.org/abs/2401.00496 - Shafiei S, Shadpour S, Intes X, Rahul R, Toussi M, Shafqat A. Performance and learning rate prediction models development in FLS and RAS surgical tasks using electroencephalogram and eye gaze data and machine learning. Surg Endosc. 2023 Nov;37(11):8447-8463. doi: 10.1007/s00464-023-10409-y
- Ma R, Kiyasseh D, Laca J, et al. Artificial Intelligence-Based Video Feedback to Improve Novice Performance on Robotic Suturing Skills: A Pilot Study. J Endourol. 2024 Aug;38(8):884-891. doi: 10.1089/end.2023.0328
- Raison N, Gavazzi A, Abe T, Ahmed K, Dasgupta P. Virtually Competent: A Comparative Analysis of Virtual Reality and Dry-Lab Robotic Simulation Training. J Endourol. 2020 Mar;34(3):379-384. doi: 10.1089/end.2019.0541
- Menso J, Rahimi A, Zwart M, et al. Robotic hepaticojejunostomy training in novices using robotic simulation and dry-lab suturing (ROSIM): randomized controlled crossover trial. Surg Endosc. 2024 Sep;38(9):4906-4915. doi: 10.1007/s00464-024-10914-8
DOI: https://doi.org/10.14797/mdcvj.1667 | Journal eISSN: 1947-6108
Language: English
Page range: 49 - 59
Submitted on: Jul 5, 2025
Accepted on: Aug 19, 2025
Published on: Oct 7, 2025
Published by: Houston Methodist DeBakey Heart & Vascular Center
In partnership with: Paradigm Publishing Services
© 2025 Jacob L. Laughlin, Lianne R. Johnson, Bhargav Ghanekar, Marcia K. O’Malley, published by Houston Methodist DeBakey Heart & Vascular Center
This work is licensed under the Creative Commons Attribution-NonCommercial 4.0 License.