Computer-based Language Testing: Potential and Pitfalls

다국어 초록 (Multilingual Abstract)

The computer is positioning itself as the primary base for performing language assessment. Unlike earlier studies that focused on the comparability of paper-and-pencil and computer-based testing, more recent studies on computer-based assessment are actively examining how the testing method may affect performance. This paper briefly highlights some seminal studies on computer-based language assessment, and then looks at some major recent research trends. This paper goes on to introduce computer-based tests that make the most of the advantages of computer technology: a listening test that allows test takers to control the number of times they listen to a recorded passage; a computer-based reading test that enables test takers to make markings on the screen; and a writing test that allow internet search, and a computer-based reading test that lets test takers adjust the setting for typeface, font size, and line spacing. This paper concludes with introducing the latest research trends and with calling for more research on the construct of and access to computer-based tests.

참고문헌 (Reference)

1 신상근, "인터넷 기반 평가에서 듣기 자료 청취 횟수가 듣기 평가 결과와 수험자의 반응에 미치는 영향" 한국멀티미디어언어교육학회 14 (14): 211-224, 2011

2 Powers, D. E., "Will they think less of my handwritten essay if others word process theirs? Effects on essay scores of intermingling handwritten and word-processed essays" 31 (31): 220-233, 1994

3 Roever, C., "Validation of a web-based test of ESL pragmalinguistics" 23 (23): 229-256, 2006

4 Kirsch, I., "Unpublished manuscript" Educational Testing Service 1997

5 Lee, Y. W., "Toward automated multi-trait scoring of essays : Investigating links among holistic, analytic, and text feature scores" 31 (31): 391-417, 2010

6 Taylor, C., "The relationship between computer familiarity and performance on computer-based TOEFL test tasks" ETS 1998

7 Harrington, S., "The influence of word processing on English placement test" 17 : 197-210, 2000

8 Wolf, D. F., "The effects of task, language of assessment, and target language experience on foreign language learners performance on reading comprehension tests" 1991

9 Lim, J., "The effects of options in typeface, size, and line spacing on computer-based reading test performance" Ewha Womans University 2013

10 Lee, S. H., "The effects of marking on computer-based reading test performance" Ewha Womans University 2012

11 Swain, M., "Teaching and testing communicatively" 15 (15): 7-18, 1984

12 Goldberg, A. L., "Performance differences according to test mode and computer familiarity on a practice graduate record exam" 62 (62): 1053-1067, 2011

13 Bachman, L. F., "Modern language testing at the turn of the century : Assuring that what we count counts" 17 (17): 1-42, 2000

14 Bachman, L. F., "Fundamental considerations in language testing" Oxford University Press 1990

15 Coniam, D., "Experimenting with a computer essayscoring program based on ESL student writing scripts" 21 (21): 259-279, 2009

16 Madsen, H., "Evaluating a comptuer-adaptive ESL placement test" 4 (4): 41-50, 1986

17 Shohamy, E., "Does the testing method make a difference? The case of reading comprehension" 1 : 147-170, 1984

18 Arnold, V., "Do students get higher scores on their word-processed papers? A study in scoring handwritten vs. word-processed papers" Unpublished paper, Rio Hondo College, Whittier, CA 1990

19 Ockey, G. J., "Developments and challenges in the use of computer-based testing for assessing second language ability" 93 (93): 836-847, 2009

20 Ginther, A., "Context and content visuals and performance on listening comprehension stimuli" 19 (19): 133-167, 2002

21 Ockey, G. J., "Construct implications of including still image or video in computer-based listening tests" 24 (24): 517-537, 2007

22 Brown, J. D., "Computers in language testing : Present research and some future directions" 1 (1): 44-59, 1997

23 Sweedler-Brown, C. O., "Computers and assessment : The effect of typing versus handwriting on the holistic score of essays" 8 : 5-14, 1991

24 Wolfe, E. W., "Composition medium comparability in a direct writing assessment of non-native English speakers" 8 (8): 53-65, 2004

25 Bridgeman, B., "Comparability of scores on word-processed and handwritten essays on the graduate management admissions test" 1988

26 Sawaki, Y., "Comparability of conventional and computerized tests of reading in a second language" 5 (5): 38-59, 2001

27 Choi, I. C., "Comparability of a paper-based language test and a computer-based language test" 20 (20): 295-320, 2003

28 Chapelle, C. A., "Assessing language through computer technology" Cambridge University Press 2006

29 Wagner, E., "Are they watching? Test-taker viewing behavior during an L2 video listening test" 11 (11): 67-86, 2007

30 Jun, H. S., "A validity argument for the use of scores from a web-search-permitted and web-source-based integrated writing test" Iowa State University 2014

31 In'mani, Y., "A meta-analysis of test format effects on reading and listening test performance : Focus on multiple-choice and open-ended formats" 26 (26): 219-244, 2009

32 Lee, H. K., "A comparative study of ESL writers’ performance in a paper-based and a computer-delivered writing test" 9 (9): 4-26, 2004