Virtual Anatomical and Endoscopic Exploration Method of Internal Human Body for Training Simulator

다국어 초록 (Multilingual Abstract)

Background: Virtual environments have brought the use of realistic training closer to many different fields of education. In medical education, several visualization methods for studying inside the human body have been introduced as a way to verify the structure of internal organs. However, these methods are insufficient for realistic training simulators because they do not provide photorealistic scenes or offer an intuitive perception to the user. In addition, they are used in limited environments within a classroom setting.
Methods: We have developed a virtual dissection exploration system that provides realistic three-dimensional images and a virtual endoscopic experience. This system enables the user to manipulate a virtual camera through a human organ, using gesture-sensing technology.
We can make a virtual dissection image of the human body using a virtual dissection simulator and then navigate inside an organ using a virtual endoscope. To improve the navigation performance during virtual endoscopy, our system warns the user about any potential collisions that may occur against the organ's wall by taking the virtual control sphere at the virtual camera position into consideration.
Results: Experimental results show that our system efficiently provides high-quality anatomical visualization. We can simulate anatomic training using virtual dissection and endoscopic images.
Conclusion: Our training simulator would be helpful in training medical students because it provides an immersive environment.

참고문헌 (Reference)

1 Deutsch JE, "Wii-based compared to standard of care balance and mobility rehabilitation for two individuals post-stroke" Institute of Electrical and Electronics Engineers 117-120, 2009

2 Park JS, "Visible Korean human : improved serially sectioned images of the entire body" 24 (24): 352-360, 2005

3 Park JS, "Visible Korean Human : improved serially sectioned images of the entire body" 24 (24): 352-360, 2005

4 Shin DS, "Two-dimensional sectioned images and three-dimensional surface models for learning the anatomy of the female pelvis" 6 (6): 316-323, 2013

5 Ruppert GC, "Touchless gesture user interface for interactive image visualization in urological surgery" 30 (30): 687-691, 2012

6 Huang YX, "Three-dimensional reconstruction of the superior mediastinum from Chinese Visible Human Female" 32 (32): 693-698, 2010

7 Chung MS, "Three-dimensional image and virtual dissection program of the brain made of Korean cadaver" 41 (41): 299-303, 2000

8 Spitzer V, "The visible human male: a technical report" 3 (3): 118-130, 1996

9 Potter LE, "The leap motion controller: a view on sign language" Association for Computing Machinery 175-178, 2013

10 Ackerman MJ, "The Visible Human project. A resource for education" 74 (74): 667-670, 1999

11 Zhang SX, "The Chinese Visible Human(CVH)datasets incorporate technical and imaging advances on earlier digital humans" 204 (204): 165-173, 2004

12 Park JS, "Technical report on semiautomatic segmentation using the Adobe Photoshop" 18 (18): 333-343, 2005

13 Garcia P, "Surgical Robotics: Systems Applications and Visions" Springer 33-68, 2011

14 Sinclair B., "Sony reveals what makes PlayStation Move tick"

15 Ren Z, "Robust hand gesture recognition based on finger-earth mover's distance with a commodity depth camera" Association for Computing Machinery 1093-1096, 2011

16 Shin DS, "Outlining of the detailed structures in sectioned images from Visible Korean" 34 (34): 235-247, 2012

17 Lundström C, "Multi-touch table system for medical visualization : application to orthopedic surgery planning" 17 (17): 1775-1784, 2011

18 Zhang Z, "Microsoft Kinect sensor and its effect" 19 (19): 4-10, 2012

19 Gargiulo P, "Medical image analysis and 3-D modeling to quantify changes and functional restoration in denervated muscle undergoing electrical stimulation treatment" 2 (2): 1-11, 2012

20 Ereso AQ, "Live transference of surgical subspecialty skills using telerobotic proctoring to remote general surgeons" 211 (211): 400-411, 2010

21 Anderson F, "Lean on Wii : physical rehabilitation with virtual reality Wii peripherals" 154 : 229-234, 2010

22 Park JS, "Generating useful images for medical applications from the Visible Korean Human" 92 (92): 257-266, 2008

23 Lim S, "GPU-based interactive visualization framework for ultrasound datasets" 20 (20): 11-23, 2009

24 Schiemann T, "Exploring the Visible Human using the VOXEL-MAN framework" 24 (24): 127-132, 2000

25 Klapan I, "Do we really need a new navigationnoninvasive “on the Fly” gesture-controlled incisionless surgery?" 20 (20): 15394-15404, 2019

26 Felzenszwalb PF, "Distance transforms of sampled functions" 8 : 415-428, 2012

27 Chung BS, "Colonoscopy tutorial software made with a cadaver's sectioned images" 208 : 19-23, 2016

28 Bostanci E, "Augmented reality applications for cultural heritage using Kinect" 5 (5): 1-18, 2015

29 Nuwer R, "Armband adds a twitch to gesture control" 217 (217): 21-, 2013

30 "Anatomage Inc"

31 박예슬, "Analysis of Semantic Relations Between Multimodal Medical Images Based on Coronary Anatomy for Acute Myocardial Infarction" 한국정보처리학회 12 (12): 129-148, 2016

32 Kwon K, "An efficient navigation method using progressive curverization in virtual endoscopy" 1281 : 121-125, 2005

33 Chiang PY, "A touchless interaction interface for observing medical imaging" 58 : 363-373, 2019

34 Barry PJ, "A recursive evaluation algorithm for a class of Catmull-Rom splines" Association for Computing Machinery 199-204, 1988

35 Maurer CR, "A linear time algorithm for computing exact Euclidean distance transforms of binary images in arbitrary dimensions" 25 (25): 265-270, 2003