발음 평가에 있어서 정확성, 유창성, 이해명료성, 이해가능성 기준 간의 영향 관계 연구 = Investigating the Relationship Among Accuracy, Fluency, Intelligibility and Comprehensibility Criterions in Pronunciation Assessment

다국어 초록 (Multilingual Abstract)

The aim of this study is to investigate the relationships among segmental accuracy, suprasegmental accuracy (intonation), fluency of speech rate/pause, intelligibility and comprehensibility criterions in pronunciation assessment. These criterions are widely regarded as goals for second language teaching and testing for pronunciation. However, there is little empirical evidence about what these criterions are measuring in terms of actual pronunciation skills and how they influence each other or even whether they are related.
So in this study, based on previous research, a Path Model was developed and evaluated to illustrate relationships among these criterions. The study found that there are significant strong correlations among accuracy, fluency, intelligibility and comprehensibility. But there was no direct effect found between suprasegmental accuracy and intelligibility or between suprasegmental accuracy and comprehensibility. However there was a direct effect found for both segmental accuracy and fluency of speech rate/pause on both intelligibility and comprehensibility. First, regression analysis revealed intelligibility accounted for R-squared 97% of variability in pronunciation scores for these two criterion. These two criterion, segmental accuracy(.51) and fluency of seech rate/pause(.50), related to intelligibility to a similar degree. Second, regression analysis showed comprehensibility accounted for R-squared 98% of variability in pronunciation scores for these two criterion. Fluency of speech rate/pause(.67) related to comprehensibility relatively higher than segmental accuracy(.18). Intelligibility was also related to comprehensibility but to a small degree(.17) in regards to semantic understanding.

참고문헌 (Reference)

1 우인혜, "한일 언어 비교를 통한 발음 교수법" 이중언어학회 (15) : 319-347, 1998

2 최순재, "한국인 화자 영어 발음의 명료도, 이해도 및 억양도 : 모국어 배경이 다른 청자를 중심으로" 한국교원대학교 대학원 2010

3 신동일, "한국의 영어평가학 1 : 시험개발편" 한국문화사 2003

4 박동호, "한국어능력시험의 CBT/INT 기반 말하기 평가를 위한 문항 유형 개발" 국립국제교육원 2012

5 김상수, "한국어 학습자 발화의 유창성 판단에 관한 연구" 국제한국어교육학회 19 (19): 75-91, 2008

6 이종은, "한국어 발음 교수 방법과 모형" 한글학회 (10) : 327-348, 1997

7 이영식, "한국어 말하기 시험의 유형 및 채점 기준 설정을 위한 기초 연구" 국제한국어교육학회 15 (15): 207-228, 2004

8 정화영, "한국어 말하기 숙달도 평가 방안 : FSI Oral Proficiency Test 분석을 중심으로" 연세대학교 교육대학원 2000

9 이 향, "한국어 말하기 수행 평가의 발음 범주 채점에 대한 타당성 검증" 이화여자대학교 대학원 2013

10 원진숙, "한국어 말하기 능력 평가 기준 설정을 위한 연구" 한국어문교육학회 (6) : 101-134, 1992

11 金裕正, "한국어 능력 평가 연구 : 숙달도 평가(korean proficiency Test)를 중심으로" 高麗大學校 大學院 1999

12 김소영, "초등학교 3학년 학생의 기초학력에 영향을 미치는 변인 고찰" 한국초등교육학회 22 (22): 233-256, 2009

13 김경선, "일반화가능도 이론을 적용한 한국어 말하기 성취도 평가의 신뢰도와 오차요인 분석" 국제한국어교육학회 21 (21): 51-75, 2010

14 이정희, "인식 조사를 통한 한국어 구어 유창성의 개념 및 요인 연구" 국제한국어교육학회 21 (21): 183-204, 2010

15 신상근, "외국어 평가의 이론과 실제" 한국문화사 2010

16 김선정, "영어 모국어 화자를 위한 한국어 발음 교육 방안" 국제한국어교육학회 10 (10): 153-169, 1999

17 이화여자대학교 언어교육원, "말이 트이는 한국어1" 이화여자대학교 출판부 2009

18 Barnwell, D, "‘Naive’native speakers and judgements of oral proficiency in Spanish" 6 (6): 152-, 1989

19 Chambers, F, "What do we mean by fluency?" 25 (25): 535-544, 1997

20 Derwing, T. M, "What do ESL students say about their accents?" 59 (59): 547-567, 2003

21 Isaacs, T, "Towards defining a valid assessment criterion of pronunciation proficiency in non-native English-speaking graduate students" 64 (64): 555-580, 2008

22 Morley, J, "The pronunciation component in teaching English to speakers of other languages" 25 (25): 481-520, 1991

23 Jenkins, J, "The phonology of English as an international language: New models, new norms, new goals" Oxford University Press 2000

24 Foster, P, "The influence of planning and task type on second language performance" 18 : 299-324, 1996

25 Anderson-Hsieh, J, "The Relationship Between Native Speaker Judgments of Nonnative Pronunciation and Deviance in Segmentais, Prosody, and Syllable Structure" 42 (42): 529-555, 1992

26 Gallego, J. C, "The Intelligibility of Three Nonnative English-Speaking Teaching Assistants: An Analysis of Student-Reported Communication Breakdowns" 1 (1): 219-237, 1990

27 Anderson-Hsieh, J, "The Effect of Foreign Accent and Speaking Rate on Native Speaker Comprehension" 38 (38): 561-613, 1988

28 Abercrombie, D, "Teaching pronunciation" 3 (3): 113-, 1949

29 Pennington, M. C, "Teaching Pronunciation from the Top Down" 20 (20): 20-38, 1989

30 Upshur, J. A, "Systematic effects in the rating of second-language speaking ability: Test method and learner discourse" 16 (16): 82-111, 1999

31 Klein, R. B, "Structural Equational modeling" The Guilford Press 1998

32 Derwing, T. M, "Second language fluency: Judgments on different tasks" 54 (54): 655-679, 2004

33 Derwing, T. M, "Second Language Accent and Pronunciation Teaching: A Research‐Based Approach" 39 (39): 379-397, 2005

34 Pennington, M. C, "Pronunciation revisited" 20 (20): 207-225, 1986

35 Levis, J. M, "Pronunciation and the assessment of spoken language, In Spoken English, applied linguistics and TESOL: Challenges for theory and practice" Palgrave Macmillan 245-270, 2008

36 Munro M. J, "Modeling perceptions of the accentedness and comprehensibility of L2 speech the role of speaking rate" 23 (23): 451-468, 2001

37 McNamara, T, "Measuring second language performance" Longman 1996

38 Linacre, J. M, "Many-faceted Rasch measurement" MESA press 1989

39 Færch, C, "Learner language and language learning, Vol. 14" Multilingual Matters 1984

40 Wesche, M, "Language aptitude measures in streaming, matching students with methods, and diagnosis of learning problems, In Individual differences and universals in language learning aptitude" Newbury House Publishers 119-139, 1981

41 Lunz, M. E, "Judge consistency and severity across grading periods" 13 (13): 425-, 1990

42 Lennon, P, "Investigating fluency in EFL: A quantitative approach" 40 (40): 387-417, 1990

43 Smith, L. E, "International intelligibility of English: Directions and resources" 4 (4): 333-342, 1985

44 Munro, M. J, "Foreign accent, comprehensibility, and intelligibility in the speech of second language learners" 45 (45): 73-97, 1995

45 Derwing, T. M, "Evidence in favor of a broad framework for pronunciation instruction" 48 (48): 393-410, 1998

46 Fulcher, G, "Does thick description lead to smart tests? A data-based approach to rating scale construction" 13 (13): 208-, 1996

47 Brumfit, C, "Communicative methodology in language teaching: The roles of fluency and accuracy, Vol. 129" Cambridge University Press 1984

48 Common European Framework, "Common European Framework of Reference for Languages: learning, teaching, assessment" Cambridge University Press 2001

49 Meyers, L. S, "Applied multivariate research: design and interpretation" Sage Publications Inc 2013

50 McGregor. L. A, "An examination of Comprehensibility in a hight Stakes Oral Proficiency Assessment for Prospective International Teaching" The University of Texas at Austin 2007

51 Derwing, T. M, "Accent, Intelligibility, and Comprehensibility" 19 (19): 1-16, 1997

52 Cumming, A, "A teacherverification study of speaking and writing prototype tasks for a new TOEFL" 21 (21): 107-145, 2004

53 Hieke, A. E, "A componential approach to oral fluency evaluation" 69 : 135-142, 1985