비대칭 가상현실에서의 현존감을 위한 HMD 사용자와 Non-HMD 사용자간 몰입형 상호작용에 관한 연구 = A Study on Immersive Interaction Between HMD User and Non-HMD User for Presence of Asymmetric Virtual Reality

다국어 초록 (Multilingual Abstract)

This study proposes an immersive interaction optimized for the user’s experience environment to provide an improved presence for both HMD and Non-HMD users in the asymmetric virtual reality (VR) environment. The core of the proposed immersive interaction is to distinguish the differences of the asymmetric environment between the HMD and Non-HMD users and present the optimized interaction to the user. And, in order to increase the presence by providing improved immersion in the asymmetric virtual reality environment given to each user, we design the walking interaction to improve the immersion of space for the HMD users, a hand-based interface that improves immersion by fully understanding and managing the situation through direct control. Finally, through the experiment using questionnaire, it is verified that the immersive interaction provides all users with an enhanced presence and specialized experience in each environment experience. Through these processes, we confirmed that the Non-HMD user can be immersed in an asymmetric virtual reality using by proposed interaction as participant rather than assistant with HMD user.

국문 초록 (Abstract)

본 연구는 비대칭 가상현실 환경에 존재하는 HMD 사용자와 Non-HMD 사용자 모두에게 향상된 현존감을 제공하기 위하여 사용자의 체험 환경에 최적화된 몰입형 상호작용을 제안한다. 제안하는 몰입형 상호작용의 핵심은 HMD 사용자와 Non-HMD 사용자 사이의 비대칭 환경의 차이를 구분하여 사용자에게 최적화된 상호작용을 제시하는 것이다. 그리고 사용자 각각에게 주어지는 비대칭 가상현실 환경에서 향상된 몰입을 제공하여 현존감을 높이기 위하여 HMD 사용자에게는 공간의 몰입을 향상시키는 걷기 상호작용을, Non-HMD 사용자에게는 직접적인 조작을 통해 상황을 전체적으로 이해하고 관리함으로써 몰입을 향상시키는 손 기반 인터페이스를 설계한다. 마지막으로 몰입형 상호작용을 통해 모든 사용자가 향상된 현존감을 제공받으면서 동시에 각각의 체험에 환경에 특화된 경험을 하였음을 설문실험을 통해 검증한다. 이러한 과정들을 통하여 제안한 상호작용이 비대칭 가상현실에서 Non-HMD 사용자도 보조자가 아닌 참가자로써 HMD 사용자와 함께 몰입할 수 있음을 확인한다.

참고문헌 (Reference)

1 S. Marwecki, "Virtualspace - overloading physical space with multiple virtual reality users" ACM 241:1-241:10, 2018

2 O. Oda, "Virtual replicas for remote assistance in virtual and augmented reality" ACM 405-415, 2015

3 C. D. Metcalf, "Validation and application of a computational model for wrist and hand movements using surface markers" 55 (55): 1199-1210, 2008

4 C. Carvalheiro, "User redirection and direct haptics in virtual environments" ACM 1146-1155, 2016

5 D. Economou, "User experience evaluation of human representation in collaborative virtual environments" 21 (21): 989-1001, 2017

6 L.-P. Cheng, "Turkdeck: Physical virtual reality based on people" ACM 417-426, 2015

7 M. Slater., "Transcending the self in immersive virtual reality" 47 (47): 24-30, 2014

8 M. Kim, "Tpvr: User interaction of third person virtual reality for new presence and experience" 10 (10): 109-, 2018

9 D. Prattichizzo, "Towards wearability in fingertip haptics: A 3-dof wearable device for cutaneous force feedback" 6 (6): 506-516, 2013

10 D. Clergeaud, "Towards seamless interaction between physical and virtual locations for asymmetric collaboration" ACM 17:1-17:4, 2017

11 H. Joo, "Total capture: A 3d deformation model for tracking faces, hands, and bodies, vol. abs/1801.01615" 2018

12 R. Hortensius, "The relation between bystanders' behavioral reactivity to distress and later helping behavior during a violent conflict in virtual reality" 13 (13): 1-20, 2018

13 SCE-Japan-Studio, "The playroom vr, Game [PS4/PS VR] [Online]"

14 B. G. Witmer, "The factor structure of the presence questionnaire" 14 (14): 298-312, 2005

15 W. A. Ijsselsteijn, "The Game Experience Questionnaire:Development of a self-report measure to assess the psychological impact of digital games" 2013

16 S. Greenwald, "Technology and applications for collaborative learning in virtual reality" International Society of the Learning Sciences 719-726, 2017

17 M. Slater, "Taking steps: The influence of a walking technique on presence in virtual reality" 2 (2): 201-219, 1995

18 Z.-C. Dong, "Smooth assembled mappings for large-scale real walking" 36 (36): 211:1-211:13, 2017

19 M. Slater., "Simulating peripheral vision in immersive virtual environments" 17 (17): 643-653, 1993

20 J. Gugenheimer, "Sharevr: Enabling co-located experiences for virtual reality between hmd and non-hmd users" ACM 4021-4033, 2017

21 P. Sajjadi, "Maze commander: A collaborative asynchronous game using the oculus rift & the sifteo cubes" ACM 227-236, 2014

22 J. Lee, "Mave: Maze-based immersive virtual environment for new presence and experience" 28 (28): e1756-, 2017

23 E. Remelli, "Lowdimensionality calibration through local anisotropic scaling for robust hand model personalization" 2554-2562, 2017

24 K.-D. Le, "Immersive environment for distributed creative collaboration" ACM 16:1-16:4, 2017

25 L.-P. Cheng, "Haptic turk: A motion platform based on people" 3463-3472, 2014

26 K. Vasylevska, "Flexible spaces: Dynamic layout generation for infinite walking in virtual environments" IEEE 39-42, 2013

27 M. Slater., "Enhancing our lives with immersive virtual reality" 3 : 74-, 2016

28 C. Schissler, "Efficient hrtf-based spatial audio for area and volumetric sources" 22 (22): 1356-1366, 2016

29 C. Carlsson, "Dive a multi-user virtual reality system" 394-400, 1993

30 M. Roussou, "Comparison of the effect of interactive versus passive virtual reality learning activities in evoking and sustaining conceptual change" 1-1, 2017

31 W. Zhao, "Combining markerbased mocap and rgb-d camera for acquiring high-fidelity hand motion data" 33-42, 2012

32 J. C. Oliveira, "Collaborative virtual environment for industrial training and e-commerce, IEEE VRTS 288" 2000

33 S. W. Hong, "Architectural design creativity in multi-user virtual environment: A comparative analysis between remote collaboration media" 2017

34 V. Vinayagamoorthy, "An eye gaze model for dyadic interaction in an immersive virtual environment: Practice and experience" 23 (23): 1-11, 2004

35 T. Duval., "An asymmetric 2d pointer/3d ray for 3d interaction within collaborative virtual environments" ACM 33-41, 2009

36 Y. Visell, "A vibrotactile device for display of virtual ground materials in walking" 420-426, 2008

37 S. Han, "A study on immersion of hand interaction for mobile platform virtual reality contents" 9 (9): 22-, 2017

38 J. Lee, "A study on immersion and vr sickness in walking interaction for immersive virtual reality applications" 9 (9): 78-, 2017

39 M. Kim, "A study on immersion and presence of a portable hand haptic system for immersive virtual reality" 17 (17): 1141-, 2017

40 D. Leonardis, "A 3-rsr haptic wearable device for rendering fingertip contact forces" 10 (10): 305-316, 2017