Investigating the Effects of Test Takers’ Perceptions on their Writing Performance

다국어 초록 (Multilingual Abstract)

This paper explores the effect that test takers’ perceptions have on their writing performance. This study also investigates the extent to which test takers’ perceptions of the writing test contribute to their performance, controlling for general English proficiency. The test instrument employed in this study is a newly-developed process-oriented ESL writing assessment. 100 international students took an institutional ESL test which allowed test takers to reflect, interact with other task takers, and revise the essays. Participants were asked to fill out a survey right after the test and 10 closed-response items concerning test format, length, perceptions of test validity, and anxiety were used as an indicator of their attitudes toward the test. The test takers were divided into 3 groups based on their ‘fair average’ scores on these 10 items obtained through multifaceted Rasch measurement. Results showed that students who were positively disposed to the test received slightly higher scores than students who were not, although different perceptions did not lead to statistically differential performance. The results of ANCOVA by controlling for TOEFL scores as the covariate showed that students who were more favorably disposed towards the test instrument did not turn out to be significantly more able, compared with those who were less favorably disposed. There was no relationship between test takers’ perceptions and their performance. Although positive attitudes toward the test did not lead to a statistically significant level of performance in this study, it is suggested that language testers nonetheless need to be aware that attitudes toward the test can be a significant factor in test performance.

참고문헌 (Reference)

1 Woodcock,R.W, "What can Rasch-based score convey about a person’s test performance? In The new rules of measurement: What every psychologist and educator should know" Lawrence Erlbaum 1999

2 이영주, "The Computerized Process-oriented Writing Assessment and its Authenticity" 한국외국어교육학회 13 (13): 105-132, 2006

3 Bradshaw,J, "Test-takers’ reactions to a placement test" 7 (7): 13-30, 1990

4 Scott,M.L, "Student affective reactions to oral language tests" 3 : 99-118, 1986

5 Linacre,J, "Many-Faceted Rasch Measurement" MESA Press 1989

6 Bachman, L. F., "Language testing in practice: Designing and developing useful language tests" Oxford University Press 1996

7 Zhu,W, "Effects of training for peer response on students' comments and interaction" 12 : 492-528, 1995

8 Zeidner, M., "College students’ attitudes towards written versus oral tests of English as a Foreign Language" 5 : 101-114, 1988

9 Shohamy,E, "Affective considerations in language testing" 66 (66): 13-17, 1982