Purpose: Reliable automation of surgical suturing requires accurate and flexible simulation tools to effectively learn robot autonomous skills that match clinical practice. Yet, high-fidelity, ready-to-use learning frameworks remain scarce even for popular platforms like the da Vinci Research Kit (dVRK). We release Nail It!, a complete Unity–ROS–dVRK learning framework supporting both teleoperation data collection and Reinforcement Learning (RL) training of surgical primitives like needle grasping and placement. Methods: Nail It! features (i) a physics-based Unity environment with full and accurate dVRK kinematic modelling, (ii) a real-time ROS communication with the dVRK master console for active surgeon control of Patient-Side Manipulators (PSMs), and (iii) an integrated Graphical User Interface (GUI) for environment tuning, reward design, learning algorithms development, and sim-to-real validation. We also provide full support for RL policies training, e.g. through Proximal Policy Optimization (PPO) with curriculum learning and domain randomization for robust policy training of suturing steps, and Multi Agent RL for multi-arm coordination. Results: We experiment with Nail It! to learn autonomous suturing with our dVRK using PPO with curriculum learning to handle multi-step surgical procedures, and domain randomization techniques to mitigate the sim-to-real gap and enable policy deployment. Nail It! delivers policies that can solve the suturing task in simulation with 95% accuracy, with proven robustness over visual and positional variations up to 15 mm (target). Conclusions: Nail It! provides a modular, high-fidelity platform for developing and benchmarking autonomous surgical skills. By integrating accurate kinematics, reinforcement learning, and teleoperation, it supports both autonomous training and human-in-the-loop control in realistic surgical scenarios. Direct ROS connectivity and an integrated GUI further facilitate rapid development and sim-to-real experimentation. Supplementary materials associated with this work are publicly available at https://luigimuratore.github.io/Nail-it/.

Nail It! A learning framework for autonomous surgical suturing and teleoperation on the dVRK / Muratore, L., Pescio, M., Barontini, F., Marzola, F., Leoncini, P., Ammirati, C.A., Arezzo, A., Dagnino, G., Averta, G.. - In: INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY. - ISSN 1861-6429. - (2026). [10.1007/s11548-026-03735-8]

Nail It! A learning framework for autonomous surgical suturing and teleoperation on the dVRK

Pescio, Matteo;Leoncini, Pietro;Averta, Giuseppe
2026

Abstract

Purpose: Reliable automation of surgical suturing requires accurate and flexible simulation tools to effectively learn robot autonomous skills that match clinical practice. Yet, high-fidelity, ready-to-use learning frameworks remain scarce even for popular platforms like the da Vinci Research Kit (dVRK). We release Nail It!, a complete Unity–ROS–dVRK learning framework supporting both teleoperation data collection and Reinforcement Learning (RL) training of surgical primitives like needle grasping and placement. Methods: Nail It! features (i) a physics-based Unity environment with full and accurate dVRK kinematic modelling, (ii) a real-time ROS communication with the dVRK master console for active surgeon control of Patient-Side Manipulators (PSMs), and (iii) an integrated Graphical User Interface (GUI) for environment tuning, reward design, learning algorithms development, and sim-to-real validation. We also provide full support for RL policies training, e.g. through Proximal Policy Optimization (PPO) with curriculum learning and domain randomization for robust policy training of suturing steps, and Multi Agent RL for multi-arm coordination. Results: We experiment with Nail It! to learn autonomous suturing with our dVRK using PPO with curriculum learning to handle multi-step surgical procedures, and domain randomization techniques to mitigate the sim-to-real gap and enable policy deployment. Nail It! delivers policies that can solve the suturing task in simulation with 95% accuracy, with proven robustness over visual and positional variations up to 15 mm (target). Conclusions: Nail It! provides a modular, high-fidelity platform for developing and benchmarking autonomous surgical skills. By integrating accurate kinematics, reinforcement learning, and teleoperation, it supports both autonomous training and human-in-the-loop control in realistic surgical scenarios. Direct ROS connectivity and an integrated GUI further facilitate rapid development and sim-to-real experimentation. Supplementary materials associated with this work are publicly available at https://luigimuratore.github.io/Nail-it/.
File in questo prodotto:
File Dimensione Formato  
Nail_It_A_learning_framework_for_autonomous_surgic.pdf

accesso aperto

Tipologia: 2a Post-print versione editoriale / Version of Record
Licenza: Creative commons
Dimensione 2.48 MB
Formato Adobe PDF
2.48 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/3013036