청각장애인의 메타버스 콘텐츠 감상을 위한 보조 기능의 사용성 분석 －대중음악 콘서트를 중심으로－ = An Analysis of Usability on Secondary Functions for the Hearing Impaired to Enjoy Metaverse Contents －Focusing on popular music concerts－

다국어 초록 (Multilingual Abstract)

Hearing-impaired people should be able to enjoy virtual reality content without discrimination. The development of metaverse has led to the success of virtual environment contents, including virtual concerts, but services for the deaf are still insufficient in this environment. In this paper, we present an auxiliary solution for hearing-impaired people to enjoy metaverse concerts and made video test samples for usability evaluation. To demonstrate that the solutions presented in this study help hearing-impaired people enjoy metaverse concerts, we made video test materials that provide secondary functions such as motion captions and haptic vibration. Test materials that provide basic subtitles were compared with test materials that applied motion captions, haptic vibrations, and both. To this end, an effectiveness evaluation and satisfaction evaluation using the Likert scale were conducted, and then a subjective satisfaction-oriented interview was conducted. Providing motion captions and haptic vibration together resulted in a relatively high usability evaluation effectiveness score, and specific requirements, problems, and improvements were identified through user interviews. If actual programs are developed and distributed based on this study, the quality of cultural life can be improved in the virtual environment of the hearing-impaired people.

참고문헌 (Reference)

1 하주현, "화면 상의 글자 움직임에 대한 청각 장애인의 비언어적 정보 인식 – 목소리의 음성 정보와 감정 정보를 기준으로" 한국디지털콘텐츠학회 21 (21): 337-346, 2020

2 강효순, "청각장애인의 게임 및 게임방송 시청을 위한 청각 장애보조 자막 시스템" 한국게임학회 19 (19): 143-150, 2019

3 강주현 ; 박재국 ; 김효영, "장애인들이 체험한 메타버스 플랫폼의 특징과 디지털 정보 접근성" 한국지체·중복·건강장애교육학회 66 (66): 63-95, 2023

4 지영서 ; 이하람 ; 임순범, "음악 감정 분석을 통한 키네틱 타이포그래피 자막 자동 생성 서비스" 한국멀티미디어학회 24 (24): 1184-1191, 2021

5 신광철, "위드/포스트 코로나 시대 문화콘텐츠 교육의 방향" 인문콘텐츠학회 (59) : 131-154, 2020

6 정승아 ; 이다솜 ; 임순범, "요소를 고려한 키네틱 타이포그래피 시스템의 확장" 한국멀티미디어학회 20 (20): 1828-1841, 2017

7 김지숙 ; 김영옥, "시각자료와 설명자막의 활용이 청각장애학생의 과학개념 이해에 미치는 효과" 한국언어청각임상학회 7 (7): 144-159, 2002

8 임상국, "메타버스 환경에 적합한 게임 플랫폼과 디바이스 몰입요소 분석 - 한·중·일 인기게임 비교를 통해서 -" 한국멀티미디어학회 25 (25): 852-865, 2022

9 김유빈 ; 남양희, "메타버스 플랫폼을 활용한 전시 감상수업에서 초등 학습자의 상호작용성 향상을 위한 UX 분석: 제페토를 중심으로" 한국멀티미디어학회 25 (25): 476-492, 2022

10 H.J. Kim, "[PEOPLE 2] Dokgo Jeongeun, General Director of Festival ‘NADA’ : Break the Boundaries, and Let's Enjoy Together!" 25 : 58-61, 2022

11 P.S. Koskinen, "Using Closed-Captioned Television in the Teaching of Reading to Deaf Students" 131 (131): 43-46, 1986

12 J. Mori, "Seeing the Music Can Animated Lyrics Provide Access to the Emotional Content in Music for People Who Are Deaf or Hard of Hearing?" 951-956, 2009

13 S. M. Jang, "Proceeding of the Winter Conference of the Korea Society of Computer and Information" 195-198, 2011

14 Key & BPM Database and Music Finder, "Key & BPM Database and Music Finder"

15 J.H. Yoon, "Future Research Focus : Metaverse, Crossing the Line Between Virtual and Real" 49 (49): 3-8, 2021

16 G.C. Nugent, "Deaf Students’ Learning From Captioned Instruction : the Relationship Between the Visual and Caption Display" 17 (17): 227-234, 1983

17 H. Florian, "Deaf People Feeling Music Rhythm by Using a Sensing and Actuating Device" 267 : 431-442, 2017

18 "Convergence of Metaverse and Korean Wave Cultural Contents"

19 ETRI, "Application of Tactile Pitch System to Performance for the Hearing Impaired"

20 M.Y. Kim, "A Study of Interface and Accessibility Method in Utilization of Metaverse for the People with Disabilities" Graduate School of Daegu University of Rehabilitation Engineering 2022