Immersive Teleconference System based on Human-Robot-Avatar Interaction using Head-Tracking Devices

다국어 초록 (Multilingual Abstract)

This paper introduces a cost-efficient immersive teleconference system. Especially to enhance immer-sive interaction capability during one-to-many telecommunication, this paper concentrates on the design of a teleconference system that is composed of a set of robotic devices and web-based control/monitoring interfaces for human-robot-avatar interaction. To this end, we first propose a server-client network model for human-machine interaction systems based on the latest HTML5 technology. As a hardware system for teleconferencing, the simplest robot is designed specially for remote users to be able to experience augmented reality naturally on live scenes. Modularized software systems are then explained in view of accessibility and functionality. This paper also describes how a human head motion is captured, synchronized with a robot in the real world, and rendered through an 3-D avatar in the augmented world for human-robot-avatar interaction. Finally, the proposed system is evaluated through a questionnaire survey that follows a series of user-experience tests.

참고문헌 (Reference)

1 "jWebSocket, the open source solution for realtime web developers"

2 E. Guizzo, "When my avatar went to work" 47 (47): 26-50, 2010

3 "VGo Communications"

4 J. Apostolopoulos, "The road to immersive communication" 100 (100): 974-990, 2012

5 C. Cruz-Neira, "The cave : audio visual experience au tomatic virtual environment" 35 (35): 64-72, 1992

6 L. Riek, "The age of avatar realism" 17 (17): 37-42, 2010

7 J. Edwards, "Telepresence : virtual reality in the real world [special reports]" 28 (28): 9-142, 2011

8 Alejandro F. Villaverde, "Passive Internet-based Crane Teleoperation with Haptic Aids" 제어·로봇·시스템학회 10 (10): 78-87, 2012

9 J. Cooperstock, "Multimodal telepresence systems" 28 (28): 77-86, 2011

10 Z. Zhang, "Microsoft Kinect sensor and its effect" 19 (19): 4-10, 2012

11 S. Adalgeirsson, "Mebot: a robotic platform for socially embodied presence" 15-22, 2010

12 "Mantarobot Telepresence Robot"

13 "JSEP:Javascript Session Establishment Protocol"

14 K. Petkov, "Interactive visibility retargeting in VR using conformal visualization" 18 (18): 1027-1040, 2012

15 남영우, "Haptic Texture Generation Using Stochastic Models and Teleoperation" 제어·로봇·시스템학회 10 (10): 1245-1253, 2012

16 R. McMahan, "Evaluating display fidelity and interaction fidelity in a virtual reality game" 18 (18): 626-633, 2012

17 A. Maimone, "Encumbrance-free telepresence system with real-time 3D capture and display using commodity depth cameras" 137-146, 2011

18 Baocheng Wang, "Development of Human-Machine Interface for Teleoperation of a Mobile Manipulator" 제어·로봇·시스템학회 10 (10): 1225-1231, 2012

19 K. Tsui, "Designing telepresence robot systems for use by people with special needs" 2011

20 B. Sajadi, "Autocalibration of multiprojector CAVE-like immersive environments" 18 (18): 381-393, 2012

21 A. Jones, "Achieving eye contact in a one-to-many 3D video teleconferencing system" 28 (28): 64:1-64:8, 2009