Training of surgical skills by a Three-Dimensional Augmented Model Response During Instrument Interactions Simulation
Main Article Content
Keywords
Software applications, Surgical Robotics, Augmented Reality, Surgical Training, Training Program Simulation (TPS)
Abstract
Background and Objective: In recent years, interest in surgical robotics simulation has grown significantly, particularly among trainee surgeons. This trend is driven by the demand for cost-effective training solutions, improved surgical outcomes, and reduced training times. Simulations also play a vital role in the design and testing of surgical instruments, enabling analysis of static and dynamic loads and optimization of tool–tissue interactions. However, because of the complex nature of soft tissue deformation during surgical procedures, developing realistic and effective simulations remains a challenge. This study focuses on modeling liver responses during tool–tissue interactions in laparoscopic surgery. Building on prior research in surgical robotics, the goal is to develop a personalized training platform that enhances the skills of surgical personnel without the need for live human or animal subjects.
Materials and Methods: The study begins by analyzing the motion of a tactile surgical instrument interacting with tissue. Direct kinematics is used to enable remote control of surgical robots by the lead surgeon. To improve control accuracy, systematic positional errors are introduced into the control links. A simulation program is developed to define the operational workspace and potential tool actions. Movement within this space is controlled by four motors connected to transmission mechanisms. Analytical models of these mechanisms are used to optimize performance under defined constraints. In addition, a training simulation program (TSP) is created to model liver responses during tool–tissue interactions. This program visualizes the 3D behavior of organs using physical material properties and simulates collisions between solids. The Unity Game Engine is used to generate animations compatible with both standard and VR/AR environments.
Results: Experimental data involving various laparoscopic instrument tips and biological tissues are stored in a MySQL database. These data can be accessed via local workstations, institutional servers, or cloud-based platforms. Users can also store their simulation data on mobile devices or processor cards.
Conclusion: This study presents a comprehensive approach to developing a surgical training system that simulates realistic tool–tissue interactions. The findings contribute to the advancement of minimally invasive surgical education by enabling personalized, data-driven training experiences. The proposed system offers a scalable and ethical alternative to traditional training methods, with potential applications in both academic and clinical settings. The simulation programs effectively transferred acquired skills to real-world scenarios, demonstrating the system’s potential for enhancing surgical training.
Downloads
Abstract 46 | PDF Downloads 30
References
Lian, L. and Chen, Y.H. Haptic surgical simulation: An application to virtual suture, In: Computer-Aided Design & Applications. 2006;3:203–210. Available online: https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=5b8035ee9506aca522da134ec11e119e19202a64.
Berkley, J., Turkiyyah, G., Berg, D., et al. Real-time finite element modeling for surgery simulation: An application to virtual suturing. TVCG. 2004;10(3):314–325. https://doi.org/10.1109/TVCG.2004.1272730.
Sorkine, O. and Alexa, M. As-rigid-as-possible surface modeling, Eurographics symposium on geometry processing, A. Belyaev and M. Garland, Eds. The Eurographics Association. 2007;1–8. Available online: https://igl.ethz.ch/projects/ARAP/arap_web.pdf.
Passport, Interactive Simulation of Liver Resection PASSPORT demonstration at SIGGRAPH. 2012. Available online: http://raweb.inria.fr/rapportsactivite/RA2011/s.h.a.m.a.n/uid50.html.
Acharya, M. Modelling of diaphragm motion for simulation of liver access: Surgery and anaesthesia BSc Project. 2008;1–46. Available online: https://members.loria.fr/PFVillard/files/supervision/report/Metesh.pdf.
Villard, P., Boshier, P., Bello, F., et al. Virtual reality simulation of liver biopsy with a respiratory component. In: Liver Biopsy, H. Takahashi, (Eds.). 2009;315–334. https://doi.org/10.5772/22033.
Lister, K., Gao, Z., Desai, J. Development of in vivo constitutive models for liver: Application to surgical simulation. Ann Biomed Eng. 2011;39(3):1060–1073. https://doi.org/ 10.1007/s10439-010-0227-8.
Maciel, A. and De S. Physics-based real time laparoscopic electrosurgery simulation. Stud. Health Technol. Inform. 2008;132:272–274, Available online: https://pubmed.ncbi.nlm.nih.gov/18391303/.
Delingette, H. Surgery simulation. In: Fourth IEEE EMBS International Summer School on Biomedical Imaging, Berder, France, IEEE EMBS. 2000;1–13, Available online: http://www-sop.inria.fr/asclepios /Publications/Herve.Delingette/Berder-delingette.pdf.
Ayache, D., Earally, F., Elbaz, P. Characteristics and postoperative course of tinnitus. Oto Otol Neurotol. 2003;24(1):48–51. https://doi.org/10.1097/00129492-200301000-00011.
Hamza-Lup, F., Seitan, A., Popovici, D., et al. Medical simulation and training: “haptic” liver, The 7th International Conference on Virtual Learning ICVL 2012. 2012;27–32. Available online: https://arxiv.org/ftp/arxiv/papers/1812/1812.03325.pdf.
Lup, F., Seitan, A., Popovici, D., et al. Medical simulation and training: “Haptic” Liver, In: Proc. of the 7th International Conference on Virtual Learning ICVL 2012, Preprint December 2018. 27–33. Available online: https://www.researchgate.net/publication/329569121_Medical_Simulation_and_Training_Haptic_Liver.
Vidal, F., Bello, K., Brodlie, N., et al. Avis/principles and applications of medical virtual environments. In: Proc. of Eurographics 2004. The Eurographics Association. 2004;1–35. Available online: https://www.researchgate.net/publication/241688442_Principles_and_Applications_of_Medical_Virtual_Environments.
Satava, R. Virtual reality surgical simulator. Surg. Endosc. 1993;7(3):203–205. https://doi.org/10.1007/BF00594110.
Satava, R. Emerging medical applications of virtual reality: A surgeon’s perspective. Artif. Intell. Med. 1994;6(4):281–288. https://doi.org/10.1016/0933-3657(94)90033-7.
Wynn, G., Lykoudis, P., Berlingieri, P. Development and implementation of a virtual reality laparoscopic colorectal training curriculum. Am J Surg. 2018;216(3):610–617. https://doi.org/10.1016/j.amjsurg.2017.11.034.
Giannotti, D., Patrizi, G., Casella, G. et al. Can virtual reality simulators be a certification tool for bariatric surgeons? Surg. Endosc. 2014;28(1):242–248. https://doi.org/10.1007/s00464-013-3179-x.
Munz, Y., Almoudaris, A.M., Moorthy, K., et al. Curriculum-based solo virtual reality training for laparoscopic intracorporeal knot tying: Objective assessment of the transfer of skill from virtual reality to reality. Am J Surg. 2007;193(6):774–783. https://doi.org/10.1016/j.amjsurg.2007.01.022.
Training simulators for laparoscopy. LapSim®—Surgical Science. 2022. Available online: https://surgicalscience.com/simulators/lapsim/.
LAP Mentor | Simbionix. 2022; Available online: https://simbionix.com/simulators/lap-mentor/.
Wynn, G., Lykoudis, P., Berlingieri, P. Development and implementation of a virtual reality laparoscopic colorectal training curriculum. Am J Surg. 2018;216(3):610–617. https://doi.org/10.1016/j.amjsurg.2017.11.034.
Rosanna, M.V., Condino, S., Turini, G., et al. Augmented reality, mixed reality and hybrid approach in healthcare simulation: A systematic review. Appl Sci. 2021;11(5):1–20. https://doi.org/10.3390/app11052338.
Haouchine, N., Dequidt, J., Berger, M.O, et al. Deformation-based augmented reality for hepatic surgery. Stud Health Technol Inform. 2013;184:182–188. Available online: https://europepmc.org/article/med/23400153.
Saito, Y., Sugimoto, M., Imura, S., et al. Intraoperative 3D hologram support with mixed reality techniques in liver surgery. Ann Surg. 2020;271(1):e4–e7. Available online: https://pubmed.ncbi.nlm.nih.gov/31425293/.
Ackerman, J. UNC ultrasound/medical augmented reality research. Last modified June 15, 2000. Available online at: https://www.cs.unc.edu/Research/us/.
Bajura, M., Fuchs, H., Ohbuchi, R. Merging virtual objects with the real world: Seeing ultrasound imagery within the patient. CG. 1992;26(2):203–210. Available online: https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=baa071b6b1c80a980d328b423e34af27951bd180.
Khan, M.F, Dogan, S., Maataoui, A. et al. Accuracy of biopsy needle navigation using the Medarpa system—computed tomography reality superimposed on the site of intervention. Eur Radiol. 20005;15:2366–2374. https://doi.org/10.1007/s00330-005-2708-y.
Thompson, J., Finnie, T., Hall, I., et al. Catching clouds: Simultaneous optimization of the parameters of biological agent plumes using Dirichlet processes to best estimate infection source location. (FEDCSIS 2017) 3–6 September 2017, Prague, Czech Republic. Proceedings of the 2017 Federated Conference on Computer Science and Information Systems. 2017;11(1):481–484. https://doi.org/10.15439/978-83-946253-7-5.
Shajun, N. and Raja, S.P. Multiscale transform and shrinkage thresholding techniques for medical image denoising-performance evaluation. CIT. 2020;(3):130–147. https://doi.org/10.2478/cait-2020-0033.
Yuong, S.W., Mian Yu Soh, Wong, J.M. Internet of medical things: Brief overview and the future, 2021 IEEE 19th Student Conference on Research and Development (SCOReD), Kota Kinabalu, Malaysia, IEEE Xplore. 2021;427–432. https://doi.org/10.1109/SCOReD53546.2021.9652784.
Mozaffari, A., Behzadipour, S., Kohani, M. Identifying the tool-tissue force in robotic laparoscopic surgery using neuro-evolutionary fuzzy systems and a synchronous self-learning hyper level supervisor. Appl.Soft Comput. 2014;14(Part A):12–30. https://doi.org/10.1016/j.asoc.2013.09.023.
Totev, D., Dimitrova, R., Dimitrov, S. Main steps in the process of upgrade of existing systems for automation and control of industrial and manufacturing processes in order to fulfill the requirements of the concept industry 4.0. AIP Conference Proceedings. 2024;3063(1):060007-1–060007-6. https://doi.org/10.1063/5.0195885.
Pavlov, V. Design of manufacturing robots. Technical University Publishing House, Schoolbook, ISBN 954-438-053-1, 1993;1–208 (in Bulgarian). Available online: https://plus.cobiss.net/cobiss/bg/en/bib/1027087076.
Shi, H.F. Fundamentals of suturing simulation in surgical training environment, Shandong University, China 1996. Master Thesis, 2008;1–135. Available online: https://core.ac.uk/download/pdf/56373453.pdf.
Tavakoli, M., Patel. R.V., Moallem, M. Robotic suturing forces in the presence of haptic feedback and sensory substitution. In: Proc. of the 2005 IEEE Conference on Control Applications. Toronto, Canada, August 28–31. 2005: 1–6. https://doi.org/10.1109/CCA.2005.1507091.
Peirs, J., Clijnen, D., Reynaerts, H., et. al. A micro optical force sensor for force feedback during minimally invasive robotic surgery. Sensor Actuat A-Phys. 2004;115(2–3) 447–455. https://doi.org/10.1016/j.sna.2004.04.057.
Gupta, V., Reddy, N.P, Batur, P. Forces in surgical tools: Comparison between laparoscopic and surgical forceps. In: Proc. of 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Amsterdam, Netherlands, 1996; IEEE Xplore. 2002;223–224. https://doi.org/10.1109/IEMBS.1996.656926.
Dobbelsteen, J.J. van den, Schooleman, A., Dankelman, J. Friction dynamics of trocars. Surg Endosc. 2007;21(8):1338–1343. https://doi.org/10.1007/s00464-006-9105-8.
Picod, G., Jambon, A.C, Vinatier, D, Dubois, P. What can the operator actually feel when performing a laparoscopy? Surg Endosc. 2005;19(1):95–100. https://doi.org/ 10.1007/s00464-003-9330-3.
Sjoerdsma, W., Herder, J.L., Horward, M.J. et. al. Force transmission of laparoscopic grasping instruments. Minim. Invas. Ther. Allied Technol. 1997;6(4):274–278. https://doi.org/ 10.3109/13645709709153075.
ZeitControl cardsystems GmbH. Available online: https://www.zeitcontrol.de/BasicCard_3.
Abdul-Jabbar, S.S. and Farhan, A.K. Secure QR-code generation in healthcare. KIJOMS. 2023;9(2):307–315. https://doi.org/ https://doi.org/10.33640/2405-609X.3294.
El-Moneim Kabel, S.A., El-Banby, G.M., Abou Elazm, L.A., et al. Securing internet-of-medical-things networks using cancellable ECG recognition. Sci Rep. 2024;14(1):1–16. https://doi.org/10.1038/s41598-024-54830-2.
Dallas Semiconductor/Maxim. DS9490R/DS9490B: USB to 1-Wire/iButton Adapter. Available online: https://pdf1.alldatasheet.com/datasheet-pdf/view/100776/DALLAS/DS9490R.html.
Unity Technologies, Scripting API, Available online: https://docs.unity3d.com/ScriptReference/Physics.html.
Watanabe, Y., Madani, A., Ito, Y.M. et al. Psychometric properties of the global operative assessment of laparoscopic skills (GOALS) using item response theory. Am J Surg. 2017(2):213:273–276. https://doi.org/10.1016/j.amjsurg.2016.09.050.
Asif, H., Mclnnis, C., Dang, F., et al. Objective structured assessment of technical skill (OSATS) in the surgical skills and technology elective program (SSTEP): Comparison of peer and expert raters. Am J Surg. 2022: 223(2): 276–279. https://doi.org/10.1016/j.amjsurg.2021.03.064.
Roberto, E., Zorzal, J.M.C.G., Sousab, M., et al., Laparoscopy with augmented reality adaptations. J. Biomed. Inform. 2020;107:1–11 103463. https://doi.org/10.1016/j.jbi.2020.103463.
Sheng, B., Masood, S., Jung, Y., Chapter twenty—virtual and augmented reality in medicine. Biomedical Information Technology (Second Edition), 2020. Elsevier Inc, pp. 673–686. https://doi.org/10.1016/B978-0-12-816034-3.00020-1.
Article Sidebar
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Author(s) must obtain all parties consent [co-author(s), others if applicable] and submit the acceptance of Copyright Agreement with their paper. Written permission must be obtained by the author for material that has been published in copyrighted material; this includes tables, figures, and quoted text that exceeds 150 words. A copy of all permissions must accompany the manuscript when published in copyrighted material. The author(s) hereby represents and warrants that the paper is original and that he/she is the author of the paper, except for material that is clearly identified as to its original source, with permission notices from the copyright owners where required. Author(s) must clearly indicate that approval for publication has been received in cases of institutional ownership.
In all submitted material authors retain all copyrights; however, the GlobalCE Journal reserve the right to reprint all or portions of the article and to post all or part of the article online. GlobalCE Journal reserves the right to edit manuscripts as required to publish in the journal. Authors are responsible for obtaining any and all clearances as appropriate. Unless stated otherwise, all articles are open-access and distributed under the terms of the Creative Commons Attribution License (CC BY 4.0) which permits unrestricted use, distribution, and reproduction in any medium, provided the original author(s) and original work (e.g. first published in the Global Clinical Engineering Journal) is properly cited with the original URL and bibliographic citation information. The complete bibliographic information, a link to the original publication on www.Globalce.org well as the copyright and license information must be included. No use, distribution or reproduction is permitted which does not comply with these terms.
