The Reliability of Self- and Peer Assessment and Students’ Perceptions toward Peer and Teacher Assessment

다국어 초록 (Multilingual Abstract)

The purpose of this study is to investigate the reliability of self- and peer assessment and students’ perceptions of peer and teacher assessment as students’ perspectives influence their learning. The data for this study were collected from 51 undergraduates taking an English oral presentation class in a university. Results were compared with the scores given by self, peers, and the instructor. The analysis of the data revealed that a greater correlation was found between peer and teacher assessments than between self- and teacher assessments. Thus, the study concluded that peer assessment is relatively more applicable than self-assessment for marking the students’ oral presentations; accordingly, including self-assessment marks into students’ presentation grades should be cautiously examined. In addition, this study examined students’ perceptions of peer and teacher assessment using a survey. The results indicated that students viewed both of them as beneficial and valuable for enhancing their oral presentation skills.

참고문헌 (Reference)

1 김정렬, "비디오 피드백의 유형에 따른 초등학교 영어 말하기 학습효과" 6 (6): 89-108, 2007

2 정성희, "대학 전공연계 비즈니스 영어수업 비디오 피드백에 대한 학습자 인식 연구" 한국영어교과교육학회 14 (14): 209-232, 2015

3 Thomas, G., "Using self-and peer-assessment to enhance students’ future-learning in higher education" 8 (8): 5-, 2011

4 Wen, M. L., "University students’ perceptions of and attitudes toward(online)peer assessment" 51 (51): 27-44, 2006

5 Dochy, F. J. R. C., "The use of self-, peer, and co-assessment in higher education : A review" 24 (24): 331-350, 1999

6 Jupp, V., "The sage dictionary of social research methods" Sage Publications 2006

7 Bourhis, J., "The role of videotaped feedback in the instruction of public speaking : A quantitative synthesis of published empirical research" 15 (15): 256-261, 1998

8 Patri, M., "The influence of peer feedback on self-and peer-assessment of oral skills" 19 (19): 109-131, 2002

9 Orsmond, P., "The importance of marking criteria in the use of peer assessment" 21 (21): 239-250, 1996

10 Pope, N. K. L., "The impact of stress in self-and peer assessment" 30 (30): 51-63, 2005

11 Crooks, T. J., "The impact of classroom evaluation practices on students" 58 (58): 438-481, 1988

12 Bachman, L. F., "The construct validation of self-ratings of communicative language ability" 6 (6): 14-29, 1989

13 Brown, J. D., "The alternatives in language assessment" 32 (32): 653-675, 1998

14 Paquet, M. R., "Students' acceptance of peer assessment" 11 (11): 25-, 1998

15 McMillan, J. H., "Student self-assessment : The key to stronger student motivation and higher achievement" 87 (87): 40-49, 2008

16 Bostock, S., "Student peer assessment. Learning Technology, 5"

17 Williams, E., "Student attitudes towards approaches to learning and assessment" 17 (17): 45-58, 1992

18 Dale, P., "Speech communication made simple 2" Pearson Education, Inc 2013

19 Morahan-Martin, J., "Should peers' evaluations be used in class projects? : Questions regarding reliability, leniency, and acceptance" 78 (78): 1243-1250, 1996

20 Esfandiari, R., "Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays" 18 (18): 111-131, 2013

21 Higgins, E. T., "Self-discrepancy : A theory relating self and affect" 94 (94): 319-, 1987

22 Oscarson, M., "Self-assessment of language proficiency : Rationale and applications" 6 (6): 1-13, 1989

23 Blue, G. M., "Self-assessment of foreign language skills: Does it work?" 18-35, 1994

24 Matsuno, S., "Self-, peer-, and teacher-assessments in Japanese university EFL writing classrooms" 26 (26): 75-100, 2009

25 Lindblom-ylänne, S., "Self-, peer-, and teacher-assessment of student essays" 7 (7): 51-62, 2006

26 Freeman, M., "SPARK, a confidential web–based template for self and peer assessment of student teamwork : Benefits of evaluating across different subjects" 33 (33): 551-569, 2002

27 Langan, A. M., "Relationships between student characteristics and self, peer, and tutor evaluations of oral presentations" 33 (33): 179-190, 2008

28 Andrew Finch, "Reflective Instruments for Self-Assessment in Korean EFL Classrooms" 대한영어교육학회 6 (6): 63-86, 2003

29 Boud, D., "Quantitative studies of student self-assessment in higher education : A critical analysis of findings" 18 (18): 529-549, 1989

30 Hafner, J., "Quantitative analysis of the rubric as an assessment tool : An empirical study of student peer‐group rating" 25 (25): 1509-1528, 2003

31 Nunnally, J. C., "Psychometric theory" McGraw-Hill 1994

32 Ndoye, A., "Peer/self assessment and student learning" 29 (29): 255-269, 2017

33 Stefani, L. A., "Peer, self, and tutor assessment : Relative reliabilities" 19 (19): 69-75, 1994

34 Campbell, K. S., "Peer versus self assessment of oral business presentation performance" 64 (64): 23-40, 2001

35 Pond, K., "Peer review : A precursor to peer assessment" 32 (32): 314-323, 1995

36 Falchikov, N., "Peer feedback marking : Developing peer assessment" 32 (32): 175-187, 1995

37 Langan, A. M., "Peer assessment of oral presentations : Effects of student gender, university affiliation, and participation in the development of assessment criteria" 30 (30): 21-34, 2005

38 Cheng, W., "Peer assessment of language proficiency" 22 (22): 93-121, 2005

39 Brindley, C., "Peer assessment in undergraduate programmes" 3 (3): 79-90, 1998

40 Papinczak, T., "Peer assessment in problem-based learning : A qualitative study" 12 (12): 169-186, 2007

41 McLaughlin, P., "Peer assessment in first year university : How the students feel" 30 (30): 135-149, 2004

42 Freeman, M., "Peer assessment by groups of group work" 20 (20): 289-300, 1995

43 Topping, K., "Peer assessment between students in colleges and universities" 68 (68): 249-276, 1998

44 Topping, K. J., "Peer assessment" 48 (48): 20-27, 2009

45 Magin, D., "Peer and teacher assessments of oral presentation skills : How reliable are they?" 26 (26): 287-298, 2001

46 Segers, M., "Optimising new modes of assessment: In search of qualities and standards" Kluwer Academic Publishers 1-12, 2003

47 Brown, J. D., "New ways of classroom assessment. New ways in TESOL series II. Innovative classroom techniques" TESOL Publications 1998

48 Hunt, J., "Language teaching and learning styles within and across cultures" Institute of Language in Education 207-217, 1989

49 Falchikov, N., "Involving students in assessment" 3 (3): 102-108, 2004

50 Smith, H, "Improving the quality of undergraduate peer assessment: A case for student and staff development" 39 : 71-81, 2002

51 De Grez, L., "How effective are self-and peer assessment of oral presentation skills compared with teachers’ assessments?" 13 (13): 129-142, 2012

52 Cheng, W., "Having second thoughts : Student perceptions before and after a peer assessment exercise" 22 (22): 233-239, 1997

53 Duke, C. R., "Giving students control over writing assessment" 83 (83): 47-53, 1994

54 Sadler, D. R., "Formative assessment and the design of instructional systems" 18 (18): 119-144, 1989

55 Nicol, D. J., "Formative assessment and selfregulated learning : A model and seven principles of good feedback practice" 31 (31): 199-218, 2006

56 Murphy, K., "Feed-forward : Students gaining more from assessment via deeper engagement in video-recorded presentations" 41 (41): 213-227, 2016

57 Cowan, J., "Developing student autonomy in learning" Kogan Page 192-210, 1988

58 Sluijsmans, D., "Creating a learning environment by using self-, peer-and co-assessment" 1 (1): 293-319, 1998

59 Hartmann, D. P., "Considerations in the choice of interobserver reliability estimates" 10 (10): 103-116, 1977

60 Gibbs, G., "Conditions under which assessment supports students’ learning" 1 : 3-31, 2005

61 Jafarpur, A., "Can naive EFL learners estimate their own proficiency?" 5 (5): 145-157, 1991

62 Boud, D., "Assessment for learning in higher education" Kogan 35-48, 1995

63 Black, P., "Assessment and classroom learning. Assessment in Education : Principles" 5 (5): 7-74, 1998

64 Hanrahan, S. J., "Assessing self-and peer-assessment : The students' views" 20 (20): 53-70, 2001

65 Hays, R. D., "Assessing quality of life in clinical trials: Methods and practice" Oxford University Press 25-39, 2005

66 Howard, C. D., "Anonymity to promote peer feedback : Pre-service teachers' comments in asynchronous computer-mediated communication" 43 (43): 89-112, 2010

67 Dollisso, A., "An integrated framework for assessing oral presentations using peer, self, and instructor assessment strategies" 55 (55): 39-44, 2011

68 Orsmond, P., "A study in self‐assessment : Tutor and students’ perceptions of performance criteria" 22 (22): 357-368, 1997

69 Stemler, S. E., "A comparison of consensus, consistency, and measurement approaches to estimating interrater reliability" 9 (9): 2004

70 Chang, C. C., "A comparative analysis of the consistency and difference among teacher-assessment, student self-assessment and peer-assessment in a Web-based portfolio assessment environment for high school students" 58 (58): 303-320, 2012

71 Race, P., "500 tips on assessment" Routledge 2005