A Study on the VR Goggle-based Vision System for Robotic Surgery

다국어 초록 (Multilingual Abstract)

Robot-assisted surgery (RAS) using the da Vinci surgical system (dVSS) has been widely performed owing to its high-definition stereoscopic visualization and improved maneuverability, which has been developed from minimally invasive surgery. However, there was motivation to resolve the chronic fatigue suffered by surgeons because of stereo viewer, the vision system of the dVSS. Reflecting the clinical opinions, a virtual reality (VR) goggle was proposed to enhance the convenience by replacing the stereo viewer, and its applicability was investigated. Based on the da Vinci research kit, validation of the VR goggle was performed by analyzing the condition of its use and implementing the performance assessment. In addition, user evaluations, such as performance analysis, questionnaire surveys, and ergonomic analysis, were conducted to determine the difference in the performance and satisfaction between the stereo viewer and VR goggle. Following the IRB approval, a retrospective analysis of the results was performed. Based on the comparison between the vision systems, the VR goggle was evaluated positively by the surgeons and novices. Satisfaction with the ergonomic properties of the VR goggle averaged 3.9 on a five-point Likert scale, and there was no significant difference in the performance when using the VR goggle and stereo viewer in both groups. Adopting the VR goggle, the volume of the vision system could be decreased by 87.6%. Considering that the VR goggle was better than the stereo viewer in terms of satisfaction and ergonomic analysis with analogous performance, it has the main contribution that the VR goggle can be a promising candidate.
as a new vision baseline to research the enhancements of the RAS platform in further studies.

참고문헌 (Reference)

1 한제희 ; 우병훈, "체간의 운동연쇄 형태에 따른 운동역학적 분석" 한국운동역학회 20 (20): 277-284, 2010

2 L. Bukavina, "‘Robotic fatigue?’-The impact of case order on positive surgical margins in robotic-assisted laparoscopic prostatectomy" 39 (39): 365.e17-365.e23, 2021

3 J. van Hilst, "Worldwide survey on opinions and use of minimally invasive pancreatic resection" 19 (19): 190-204, 2017

4 Yeeun Jo ; 김윤재 ; Minwoo Cho ; 이치원 ; Myungjoon Kim ; 문혜민 ; 김성완, "Virtual Reality-Based Control of Robotic Endoscope in Laparoscopic Surgery" 제어·로봇·시스템학회 18 (18): 150-162, 2020

5 J. C. Byrn, "Three-dimensional imaging improves surgical performance for both novice and experienced operators using the da Vinci robot system" 193 (193): 519-522, 2007

6 R. Liu, "The surgical outcomes of robotassisted laparoscopic pancreaticoduodenectomy versus laparoscopic pancreaticoduodenectomy for periampullary neoplasms: A comparative study of a single center" 31 (31): 2380-2386, 2017

7 M. Azizian, "The Encyclopedia of Medical Robotics, vol. 1" 3-28, 2019

8 C. Freschi, "Technical review of the da Vinci surgical telemanipulator" 9 (9): 396-406, 2013

9 C. -H. King, "Tactile feedback induces reduced grasping force in robot-assisted surgery" 2 (2): 103-110, 2009

10 A. T. Gabrielson, "Surgical ergonomics for urologists: A practical guide" 18 (18): 160-169, 2021

11 G. I. Lee, "Surgeons’ physical discomfort and symptoms during robotic surgery: A comprehensive ergonomic survey study" 31 (31): 1697-1706, 2017

12 Z. Chen, "Software architecture of the da Vinci research kit" 180-187, 2017

13 M. Runciman, "Soft robotics in minimally invasive surgery" 6 (6): 423-443, 2019

14 K. -F. Kowalewski, "Skills in minimally invasive and open surgery show limited transferability to robotic surgery: Results from a prospective study" 32 (32): 1656-1667, 2018

15 U. Kim, "Sensorized surgical forceps for robotic-assisted minimally invasive surgery" 65 (65): 9604-9613, 2018

16 W. Zhao, "Safety and efficacy for robot-assisted versus open pancreaticoduodenectomy and distal pancreatectomy: A systematic review and meta-analysis" 27 (27): 468-478, 2018

17 L. A. McGuinness, "Robotics in urology" 100 (100): 45-54, 2018

18 M. D’Souza, "Robotic-assisted spine surgery: History, efficacy, cost, and future trends" 2019 (2019): 6-23, 2019

19 J. Marks, "Robotic transanal surgery (RTAS) with utilization of a next-generation single-port system: A cadaveric feasibility study" 21 (21): 541-545, 2017

20 O. I. Ramadan, "Robotic surgery for lung resections—total port approach: Advantages and disadvantages" 3 (3): 1-5, 2017

21 L. Yu, "Robot-assisted vs freehand pedicle screw fixation in spine surgery–A systematic review and a meta-analysis of comparative studies" 14 (14): 1-8, 2018

22 J. Bric, "Proficiency training on a virtual reality robotic surgical skills curriculum" 28 (28): 3343-3348, 2014

23 B. C. Thomas, "Preclinical evaluation of the versius surgical system: A new robot-assisted surgical device for use in minimal access renal and prostate surgery" 7 (7): 444-452, 2021

24 M. Kaptein, "Powerful and consistent analysis of Likert-type rating scales" 2391-2394, 2010

25 S. Miura, "Optimal monitor positioning and camera rotation angle for mirror image: Overcoming reverse alignment during laparoscopic colorectal surgery" 9 (9): 1-6, 2019

26 T. N. Judkins, "Objective evaluation of expert and novice performance during robotic surgical training tasks" 23 (23): 590-597, 2009

27 Dae-Hyun Kim ; Chang-Ju Kim ; Sung-Min Son, "Neck Pain in Adults with Forward Head Posture: Effects of Craniovertebral Angle and Cervical Range of Motion" 질병관리본부 9 (9): 309-313, 2018

28 J. Fares, "Musculoskeletal neck pain in children and adolescents: Risk factors and complications" 8 (8): 2017

29 M. Pędziwiatr, "Minimally invasive versus open pancreatoduodenectomy—systematic review and meta-analysis" 402 (402): 841-851, 2017

30 B. Brandt, "Minimally invasive surgery versus laparotomy for radical hysterectomy in the management of early-stage cervical cancer: Survival outcomes" 156 (156): 591-597, 2020

31 C. T. Walker, "Minimally invasive surgery for thoracolumbar spinal trauma" 6 (6): 1-11, 2018

32 G. G. Hamad, "Minimally invasive surgery" 199 (199): 423-443, 2010

33 E. Diver, "Minimally invasive radical hysterectomy for cervical cancer is associated with reduced morbidity and similar survival outcomes compared with laparotomy" 24 (24): 402-406, 2017

34 A. V. Subbarayalu, "Measurement of craniovertebral angle by the modified head posture spinal curvature instrument:A reliability and validity study" 32 (32): 144-152, 2016

35 K. Harms-Ringdahl, "Maximum neck extension strength and relative neck muscular load in different cervical spine positions" 4 (4): 17-24, 1989

36 Y. Wang, "Laparoscopy versus laparotomy for the management of early stage cervical cancer" 15 (15): 1-11, 2015

37 A. Luca, "Innovative educational pathways in spine surgery: Advanced virtual reality–based training" 140 : 674-680, 2020

38 A. Brown, "Human flicker fusion correlates with physiological measures of magnocellular neural efficiency" 12 (12): 1-7, 2018

39 B. J. Concannon, "Headmounted display virtual reality in post-secondary education and skill training" 4 (4): 1-23, 2019

40 N. Hong, "Head-mounted interface for intuitive vision control and continuous surgical operation in a surgical robot system" 57 (57): 601-614, 2019

41 D. R. Yates, "From Leonardo to da Vinci: The history of robot-assisted surgery in urology" 108 (108): 1708-1713, 2011

42 A. Sipatchin, "Eye-tracking for clinical ophthalmology with virtual reality (VR): A case study of the HTC Vive Pro Eye’s usability" 9 (9): 1-15, 2021

43 P. R. Armijo, "Ergonomics of minimally invasive surgery: An analysis of muscle effort and fatigue in the operating room between laparoscopic and robotic surgery" 33 (33): 2323-2331, 2019

44 C. D. P. van’t Hullenaar, "Ergonomic assessment of the da Vinci console in robot-assisted surgery" 2 (2): 97-104, 2017

45 고동훈 ; 장원식 ; 박재원 ; 함원식 ; 한웅규 ; 나군호 ; 최영득, "Efficacy and Safety of Robotic Procedures Performed Using the da Vinci Robotic Surgical System at a Single Institute in Korea: Experience with 10000 Cases" 연세대학교의과대학 59 (59): 975-981, 2018

46 Mija Ruth Lee ; Gyusung Isaiah Lee, "Does a robotic surgery approach offer optimal ergonomics to gynecologic surgeons?: a comprehensive ergonomics survey study in gynecologic robotic surgery" 대한부인종양학회 28 (28): 1-11, 2017

47 M. Kim, "Development of stereo endoscope system with its innovative master interface for continuous surgical operation" 16 (16): 1-16, 2017

48 S. Eslamian, "Development and evaluation of an autonomous camera control algorithm on the da Vinci surgical system" 16 (16): e2036-, 2020

49 G. Mun, "Development & evaluation of virtual reality (VR) based novel vision system for the da Vinci surgical robot"

50 G. Parham, "Creating a low-cost virtual reality surgical simulation to increase surgical oncology capacity and capability" 13 (13): 1-11, 2019

51 H. Sadeghian, "Constrained kinematic control in minimally invasive robotic surgery subject to remote center of motion constraint" 95 (95): 901-913, 2019

52 A. Borrego, "Comparison of oculus rift and HTC vive: Feasibility for virtual reality-based exploration, navigation, exergaming, and rehabilitation" 7 (7): 151-156, 2018

53 N. Hansen-Algenstaedt, "Comparison between minimally invasive surgery and conventional open surgery for patients with spinal metastasis" 42 (42): 789-797, 2017

54 J. M. Barrett, "Cervical spine joint loading with neck flexion" 63 (63): 101-108, 2020

55 V. Biener, "Breaking the screen: Interaction across touchscreen boundaries in virtual reality for mobile knowledge workers" 26 (26): 3490-3502, 2020

56 K. Brown, "Battle of the bots: A comparison of the standard da Vinci and the da Vinci surgical skills simulator in surgical skills acquisition" 11 (11): 159-162, 2017

57 J. H. Chen, "Application of da Vinci surgical robotic system in hepatobiliary surgery" 4 (4): 22-27, 2018

58 P. Kazanzides, "An open-source research kit for the da Vinci®surgical system" 6434-6439, 2014

59 G. Meccariello, "An experimental study about haptic feedback in robotic surgery: May visual feedback substitute tactile feedback?" 10 (10): 57-61, 2016

60 S. Kawakura, "Agricultural training system with gazing-point detection function using headmounted display: HTC Vive Pro Eye and virtual reality–based unity system" 3 (3): 121-126, 2021

61 C. D’Ettorre, "Accelerating surgical robotics research: Reviewing 10 years of research with the da Vinci research kit" 28 (28): 56-78, 2021

62 H. Sang, "A zero phase adaptive fuzzy Kalman filter for physiological tremor suppression in robotically assisted minimally invasive surgery" 12 (12): 658-669, 2016

63 M. Vertemati, "A virtual reality environment to visualize three-dimensional patient-specific models by a mobile head-mounted display" 26 (26): 359-370, 2019

64 A. Danioni, "A study on the dexterity of surgical robotic tools in a highly immersive virtual environment:Assessing usability and efficacy" 29 (29): 68-75, 2022

65 A. Pandya, "A robotic recording and playback platform for training surgeons and learning autonomous behaviors using the da Vinci surgical system" 8 (8): 1-17, 2019

66 C. E. Díaz, "A research review on clinical needs, technical requirements, and normativity in the design of surgical robots" 13 (13): 1-10, 2017

67 M. Ferro, "A portable da Vinci simulator in virtual reality" 447-448, 2019

68 C. W. Stockwell, "A physical model of human postural dynamics" 374 (374): 722-730, 1981

69 M. Kim, "A development of assistant surgical robot system based on surgical-operation-by-wire and hands-on-throttle-and-stick" 15 (15): 1-19, 2016

70 K. -H. Choi, "A comparison study of posture and fatigue of neck according to monitor types (moving and fixed monitor) by using flexion relaxation phenomenon (FRP) and craniovertebral angle (CVA)" 17 (17): 6345-, 2020

71 D. Julian, "A comparative analysis and guide to virtual reality robotic surgical simulators" 14 (14): 1-14, 2018