감각형 증강현실 환경에서의 손 가림 현상 해결 방안

다국어 초록 (Multilingual Abstract)

In tangible augmented reality (AR) environments for virtual prototyping, the user interacts with virtual products by manipulating tangible objects with his or her hands, but the user often encounter awkward situations in which his or her hands are occluded by augmented virtual objects, which reduces both immersion and ease of interaction. In this paper, we present how to resolve such hand region occlusion in order to enhance natural interaction and immersive visualization. In the AR environment considered, we use two types (product-type and pointer-type) of tangible objects for tangible user interaction with a virtual product of interest. Holding the tangible objects with his or her hands, the user can create input events by touching specified regions of the product-type tangible object with the pointertype tangible object. We developed a method for resolving hand region occlusion frequently arising during such user interaction. It first detect hand region in a real image and refines the rendered image of the virtual object by subtracting the hand region from the rendered image. Then, it superimposes the refined image onto the real image to obtain an image in which the occlusion is resolved. Incorporated into tangible AR interaction for virtual prototyping of handheld products such as cellular phones and MP3 players, the method has been found by a preliminary user study that it is not only useful to improve natural interaction and immersive visualization of virtual products, but also helpful for making the users experience the products’ shapes and functions better.

목차 (Table of Contents)

• ABSTRACT
• 1. 서론
• 2. 증강현실 기반 감각형 상호작용
• 3. 손 가림 현상의 해결 방안
• 4. 사용성 평가
• 5. 결론
• 참고문헌

참고문헌 (Reference)

1 박형준, "증강현실 기반 상호작용과 시뮬레이션을 이용한 휴대용 전자제품의 설계품평" 한국CAD/CAM학회 13 (13): 209-216, 2008

2 박형준, "증강현실 기반 감각형 상호작용의 유효영역 측정" 한국CAD/CAM학회 929-933, 2008

3 Burdea, G. C, "Virtual Reality Technology" John Wiley & Sons 2003

4 Bullinger, H. J., "Virtual Prototyping - State of the Art in Product Design" 103-107, 1999

5 Kato, H., "Virtual Object Manipulation on a Table-top AR Environment" 111-119, 2000

6 Ishii, H, "Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms" 234-241, 1997

7 Park, H., "Tangible Augmented Prototyping of Digital Handheld Products" 60 (60): 114-125, 2009

8 Ruiz-del-Solar, J, "Skin Detection using Neighborhood Information" 2004

9 K. Lee, "Principles of CAD/CAM/CAE Systems" Addison Wesley 1999

10 "OpenCV"

11 Tan, W., "Hand Extraction Using Geometric Moments Based on Active Skin Color Model"

12 박형준, "HMI 기능성 시뮬레이션과 VR 기법과의 연동을 통한 개인용 전자제품의 가상시작 방안" 한국CAD/CAM학회 12 (12): 87-94, 2007

13 "GLUT"

14 Chai, D, "Face Segmentation Using Skin-Color Map in Videophone Applications" 9 (9): 551-564, 1999

15 Billinghurt, M., "Collaboration with tangible augmented reality interfaces" 234-241, 2001

16 Lee, W, "Augmented Foam: A Tangible Augmented Reality for Product Design" 106-109, 2005

17 Dadgostar, F, "An adaptive real-time skin detector based on Hue thresholding" 27 : 1342-1352, 2006

18 "ARToolKit"

19 Azuma, R. T., "A Survey of Augmented Reality" 6 (6): 355-385, 1997