Reliability and Validity of Using Reorganization-Translation Task for L2 Writing Assessment

다국어 초록 (Multilingual Abstract)

This study explored the potentials of a newly-developed translation test as a useful tool in measuring L2 learners’ writing competence. The Reorganization-Translation test is a type of L1 to L2 translation test that is designed to gauge test-takers’ discourse competence in addition to other writing assessment criteria. For the purposes of this study, the test was administered on 95 college students in Korea, and the test responses were marked by four raters. The analyses in this study were centered on the test’s reliability and construct validity, the two qualities of test usefulness that are of great importance in justifying the use of test results. The findings of this research upheld the usefulness of the test as a reliable and valid form of L2 writing assessment and a helpful instrument in teaching L2 learners about coherence or rhetorical organization in writing. The significance of this study was highlighted in relation to its first-of-its-kind attempt to develop and administer a translation test reflecting all of the components of language ability including discourse competence. The implications of such endeavor are discussed together with the study’s limitations and suggestions for a probe into a more appropriate setting for the test.

목차 (Table of Contents)

• Ⅰ. Introduction
• Ⅱ. Literature Review
• Ⅲ. Research Method
• Ⅳ. Results and Discussion
• Ⅳ. Conclusion
• Works Cited

참고문헌 (Reference)

1 최인철, "작문 수행평가에 대한 전문가와 전산언어학적 채점결 과의 비교 분석" 4 (4): 165-184, 2001

2 최인철, "실용 영문법 백과사전" 사람in 2010

3 Jones, Stan, "Writing in Real Time: Modeling Production Processes" Ablex 34-57, 1987

4 Cumming, Alister, "Writing Expertise and Second Language Proficiency" 39 : 81-141, 1989

5 Uzawa, Kozue, "Translation, L1 Writing, and L2 Writing of Japanese ESL Learners" 16 (16): 119-134, 1994

6 Sun, Youyi, "Translation in Language Teaching and Assessment" Cambridge Scholars Publishing 235-252, 2013

7 Bassnett, Susan, "Translation Studies" Routledge 2002

8 Choi, Innchull, "Theoretical Foundations & Practical Applications of Language Assessment" Korea University 2014

9 Roca de Larios, Julio, "The Use of Restructuring Strategies in EFL Writing : A Study of Spanish Learners of English as a Foreign Language" 8 : 13-44, 1999

10 Kim, Youngran, "The Use of L1 as a Writing Strategy in L2 Writing Tasks" 14 (14): 33-50, 2014

11 Stapa, Siti Hamin, "The Use of First Language in Developing Ideas in Second Language Writing" 2 (2): 148-151, 2012

12 Holmes, James S., "The Translation Studies Reader" Routledge 172-185, 2000

13 Angelelli, Claudia V., "Testing and Assessment in Translation and Interpreting Studies: A Call for Dialogue Between Research and Practice" John Benjamins Publishing Company 13-47, 2009

14 Wang, Lurong, "Switching to First Language Among Writers with Differing Second-Language Proficiency" 12 : 347-375, 2003

15 Friedlander, Alexander, "Second Language Writing: Research Insights for the Classroom" Cambridge University Press 109-125, 1990

16 Brown, H. Douglas, "Principles of Language Learning and Teaching" Pearson Education 2007

17 김인숙, "Paper-based versus Image-based Scoring of Student Essays" 한국응용언어학회 27 (27): 231-256, 2011

18 Cumming, Alister, "Metalinguistic and Ideational Thinking in Second Language Composing" 7 : 482-511, 1990

19 McNamara, Timothy Francis, "Measuring Second Language Performance" Longman 1996

20 Woodall, Billy R, "Language-Switching : Using the First Language While Writing in a Second" 11 : 7-28, 2002

21 Bachman, Lyle F., "Language Testing in Practice" Oxford University Press 1996

22 Wang, Wenyu, "L1 Use in the L2 Composing Process : An Exploratory Study of 16 Chinese EFL Writers" 11 : 225-246, 2002

23 최연희, "L1 Use in L2 Writing Process of Korean EFL Students" 한국영어교육학회 61 (61): 205-225, 2006

24 박리리, "Inter-rater Reliability of English Essay Test and Korean-English Translation Test Across Multiple Topics and Rating Criteria" 외국학연구소 (43) : 111-136, 2018

25 Bachman, Lyle F., "Fundamental Considerations in Language Testing" Oxford University Press 1990

26 Stern, Hans H., "Fundamental Concepts of Language Teaching" Oxford University Press 1983

27 Kobayashi, Hiroe, "Effects of First Language on Second Language Writing : Translation Versus Direct Composition" 42 : 183-215, 1992

28 Lay, Nancy Duke S, "Composing Processes of Adult ESL Learners : A Case Study" 16 : 406-, 1982

29 House, Juliane, "Beyond Intervention : Universals in Translation" 1 : 6-19, 2008

30 Kyung-AeJin, "Applying Standards-Based English Performance Assessment in Korean High Schools" 현대문법학회 (28) : 231-244, 2002

31 Qi, Donald, "An Inquiry into Language-Switching in Second Language Composing Processes" 54 : 413-435, 1998

32 Manchón, Rosa María, "An Approximation to the Study of Backtracking in L2 Writing" 8 : 13-35, 2000

33 Cook, Guy, "A Thing of the Future : Translation in Language Learning" 17 (17): 396-401, 2007

34 Ghanooni, Ali Reza, "A Review of the History of Translation Studies" 2 (2): 77-85, 2012

35 박리리, "A Comparative Analysis of Inter-rater Reliability in English Essay and Korean-English Translation Tests" 현대영어교육학회 17 (17): 27-48, 2016