Incongruity of the RSM-based knowledge state estimates of an individual and dealing with the incongruences = 규칙장이론에 근거한 두 가지 인지상태 진단 불일치 및 그 대응 방안

국문 초록 (Abstract)

이 연구는 규칙장 이론에 근거한 인지상태 진단을 위한 두 가지 추정치가 불일치할 경우, 어느 것이 더 정확할 것인지를 어떻게 확인할 수 있으며, 두 가지의 추정치를 어떻게 활용할 것인지를 규명하고자 하였다. 규칙장 이론에 의한 인지상태 추정치 두 가지는 사후확률이 가장 높은 인지상태(TMPS)와 몇 개의 TMPS의 평균치(AMPS)이다. 그 둘이 불일치할 수 있음을 보여주기 위해서 상위의 동점자 두 명과 중위의 동점자 두 명의 사례의 인지상태 추정 결과를 대비하였다. 그 결과 4명 모두 정도의 차이는 있지만 두 추정치간에 불일치하는 인지요소들이 있었다. Q-matrx와 실제 응답결과를 토대로 내용분석적으로 검토함으로써 어느 추정치가 더 정확한 상태인지 판단이 가능한 경우도 있지만, 그렇지 못한 경우도 있었다. 그리고 두 가지 진단결과 모두를 교육적으로 활용한다면, 어느 추정치이든 미습득 인지요소를 학생의 상태로 간주할 때 보다 충분한 학습을 보장할 수 있음과, 그러한 접근의 장단점을 논의하였다.

다국어 초록 (Multilingual Abstract)

This study is to show that two types of Rule Space Model (RSM)-based estimates of an individual's knowledge stare might be incongruent at the attribute level, and to deal with those incongruences. RSM produces a pair of knowledge state estimates of an individual, the most probable stare (TMPS) and the averaged several TMPS's (AMPS). To check the congruity of the knowledge stare estimates two pairs of students having identical scores, one in the highest score range and the other in a middle range, were chosen. The congruity was checked by correlation coefficient of dements of attribute attainment patterns between the two estimates in a pair, and then by identifying the specific attributes causing the incongruity. Dealing with the incongruent knowledge states 'Was demonstrated by determining a more correct knowledge stare, and by interpreting both of the estimates for instructional purpose. The pros and cons of them were discussed.

목차 (Table of Contents)

• Ⅰ. Introduction
• Ⅱ. Knowledge State Estimates in Rule-Space Model(RSM)
• Ⅲ. Method
• Ⅳ. Results
• Ⅴ. Summary and Discussions
• Reference
• <요 약>

참고문헌 (Reference)

1 Tatsuoka, K. K., "Toward an integration of item-response theory and cognitive diagnosis, In Diagnostic monitoring of skill and knowledge acquisition" Hillsdale 453-488, 1990

2 Kim, S. H., "Statistical classification of item-response patterns into misconception groups in rule space" University of Illinois 1990

3 Kim, S. H., "Statistical classification of item response patterns into clustered rule-groups in rule space" 10 (10): 139-175, 1997

4 Kim, S. H., "Statistical classification of item response patterns in rule-space and in principal component space" 34 (34): 63-88, 1996

5 ACT, "Standards for Transition"

6 Tatsuoka, K. K., "Rule space : An approach for dealing with misconceptions based on item response theory" 20 (20): 345-354, 1983

7 ACT, "Preparing for the ACT: 2004-2005"

8 Tatsuoka, K., "Patterns of diagnosed mathematical content and process skills in TIMMS-R Across a sample of 20 countries" 41 (41): 901-926, 2004

9 Fukunaga, K., "Introduction to statistical pattern recognition" Academic Press 1990

10 김성훈, "Individual Level Diagnoses with Group Level Standards:Applying Rule-Space Model on the ACT Assessment Mathematics Data and the Standards for Transition" 한국교육평가학회 20 (20): 165-194, 2007

11 Mislevy, R. J., "Evidence and inference in educational assessment" 59 (59): 439-483, 1994

12 Tatsuoka, K. K., "Computerized cognitive diagnostic adaptive testing" 34 (34): 3-20, 1997

13 Mislevy, R. J., "Cognitive psychology and educational assessment, In Educational Measurement" American Council on Education and National Council on Educational Measurement 257-305, 2006

14 Tatsuoka, K. K., "Bug distribution and statistical pattern classification" 52 (52): 193-206, 1987

15 Tatsuoka, K. K., "Boolean algebra applied to determination of universal set of knowledge states" 1991

16 Tatsuoka, K. K., "Architecture of knowledge structure and cognitive diagnosis: A statistical pattern recognition and classification approach, In Cognitively Diagnostic Assessment" Erlbaum 327-360, 1995

17 Tatsuoka, K. K., "A probabilistic model for diagnosing the misconceptions by the pattern classification approach" 10 (10): 55-73, 1985

18 Varadi, F., "A computer program" Tanar Software 1992

19 Debello, L. V., ", In Cognitively Diagnostic Assessment" Lawrence Erlbaum Associates, Pub 361-389, 1995