성과평가제도의 평가결과 요인이 직무태도에 미치는 영향

임재현(Jae Hyun Lim),조자경(Ja Khyung Cho),차용진(Yong Jin Cha) 한국인사행정학회 2017 한국인사행정학회보 Vol.16 No.3

The purpose of this study is to analyze the effects of the evaluation-result factors on the job attitudes of the employees in 11 entities funded by Seoul city. Three components of the evaluation-result factors are the availability of the evaluation-result, the feedback of the evaluation-result, the linckage with personnel and rewards. The job attitudes consist of the organizational commitment and the job satisfaction. The analytical framework of this study is that the evaluation-result factors have the effects on the organizational commitment which influences the job satisfaction. The analytical results are: (1) three evaluation-result factors impact the organizational commitment positively, (2) the influence of the availability of the evaluation-result is the highest, and (3) the three factors is positively related to the job satisfaction through the organizational commitment. The structure analysis, the effect analysis, the open questionaire and so on show the following problems of Seoul-city performance evaluation system: (1) the system is not highly helpful to the performance improvement, (2) the evaluation experts are not sufficient, (3) the feedback of the evaluation-result is required to be reformed, and (4) the linkage of the evaluation-result to personnel and rewards is not satisfactory. The alternatives are: (1) the information useful to improve performance should be provided, (2) the evaluation experts are recruited, (3) the reports on the performance evaluation are needed to include feasible requests and alternatives, and (4) the promotion and the rewards should be based on the evaluation results.

GEE모형을 이용한 지방자치단체 합동평가 영향요인 조절효과 분석

김기만,권영상 국회입법조사처 2025 입법과 정책 Vol.17 No.1

본 연구는 지방자치단체에 대한 중앙행정기관의 합동평가와 민원평가, 청렴도 평가, 재 난안전평가 등 개별평가와의 상관성을 확인하는 한편, 그 영향력을 분석하고 지방자치단 체의 역량요소 중 인구규모, 지방재정력지수, 지역총생산성이 평가에 미치는 영향력을 조절효과로 검증하는 것이다. 2018년부터 2023년까지 평가자료를 패널데이터로 만든 후, 패널 간 상관성 문제를 반영할 수 있는 일반화추정방정식(Generalized Estimating Equation: GEE)모형을 제시하고 유용성을 분석하였다. 자원동원 역량이 높은 지방자치 단체는 위임사무에 대한 평가보다 지역 평판이나 주민 관심이 큰 자치사무 성격의 업무 평가에 집중하는 경향을 보였다. 본 연구가 검증한 역량요소 중 인구규모가 평가에 가장 많은 영향을 준다는 점이 확인되었다. 다음으로 행정서비스 전달체계가 간소화 된 단층 제 광역자치단체가 평가에 유리하다는 점이 발견되었다. 평가 측면에서도 역량이 강한 지방자치단체는 주민 생활과 밀접한 사업 평가에 관심과 역량을 집중하고 있다. 따라서 이는 지방자치 활성화를 위해서는 지역재정력, 지역규모 등 독자적 자원동원 능력이 충 분히 뒷받침되어야 한다는 종래 연구 결과와 맥락을 같이한다고 할 것이다. The purpose of this study is to verify the correlation between two evaluations of metropolitan local governments, combined evaluation(conducted by the central administrative agencies) and individual evaluation(cf. civil service evaluation and integrity evaluation) and to evaluate the influence of competency factors of local governments(population size, local financial power index and Gross Regional Domestic Product per capita, GRDP per capita) on evaluations by using moderating effect variable. For this study, data from 2018 to 2023 were converted into panel data and those of local governments that were highly rated in the combined evaluation were analyzed by an generalized estimating equation model or a Tobit model. Firstly, the result indicated that individual evaluations had strong tendency toward self-governing affairs and had a significant influence on the combined evaluation, which evaluated national delegated affairs. Secondly, local governments tended to focus on self-governing affairs rather than national delegated affairs when they had a high capacity of resource mobilization and, in particular, the size of the population had a great influence on the combined evaluation. Finally, the result showed that single-story metropolitan local governments with simple administrative service delivery system were advantageous in the evaluations. In conclusion, local governments with strong self-governing capability seemed to focus their attention and capability on evaluations of projects that were close to residents' lives, which had not much different from previous studies that had suggested independent resource mobilization capabilities such as local financial power and Gross Regional Domestic Product(GRDP) per capita should be fully supported in order to revitalize local autonomy.

스포츠경영학에서의 구조방정식모형 연구에 관한 문헌조사: 연구동향과 논점을 중심으로

김용만 ( Yong Man Kim ),변경원 ( Kyung Won Byeon ),이정우 ( Jung Woo Lee ) 한국스포츠산업경영학회 2013 한국스포츠산업경영학회지 Vol.18 No.1

구조방정식모형은 행동과학 및 사회과학 분야에서 유용하게 사용할 있는 연구방법론으로 주목받고 있으며, 스포츠경영학 연구에서도 이러한 연구가 증가하는 추세이다. 구조방정식 모형은 잠재변수를 이용하여 연구가설을 보다 명시적으로 모형화할 수 있으며, 복잡하게 구성된 변수들 간의 관계도 추정할 수 있다. 하지만 SEM은 비교적 복잡한 통계기법이기 때문에 연구자의 부주의 등으로 인해 잘못 적용되는 사례들도 나타나고 있다. 스포츠경영학 연구에서도 SEM 연구의 증가로 인해서 이러한 사례가 나타나고 있다. 따라서 SEM에 대한 오용사례를 밝힐 필요성이 높아지고 있으나 이에 대한 연구는 부족한 실정이다. 따라서 이 연구에서는 스포츠경영학 분야의 SEM 관련 문헌을 조사하여 적절하게 사용하고 있는지를 파악하고 활용하는데 있어서의 문제점을 파악하여 이에 대한 적절한 기준을 제시하고자 한다. 이를 위하여 2003년부터 2012년(4호)까지 스포츠산업.경영학회지에 게재된 162편의 SEM 논문을 대상으로 조사하였다. 이 연구에서 구조방정식 모형의 활용에 대한 분석주제는 모형개발과 모형추정, 모형평가이다. The structural equation modeling has attracted attention as a research methodology that can be useful in behavioral and social science, and studies utilizing, structural equation modeling show a tendency to increase in sports management study. Structural equation modeling is able to make the hypothesis more explicitly by using latent variables, it can also estimate the complex relationship constructed between variables. However, the case that was misused the structure equation modeling by researcher can be seen in academic journal because the structure equation modeling is a relatively complex statistical methods that include a lot of statistical assumptions. Therefore, this study endeavor to examine whether there were any problems appear when structure equation model is used in sports management study by literature review. Also, this study intend to suggest alternatives for future researcher using structure equation modeling to avoid the problem due to misuse. For the study, 162 studies using structure equation modeling in Korean Journal of Sport Management between 2003 and 2012(4) were analyzed to literature review. The issue of using structural equation modeling in this study are model specification, model estimation, and model evaluation.

평가 이해관계자들의 평가 의미 분석

권순달(Soon-Dal, Kwon) 한국교육평가학회 2018 교육평가연구 Vol.31 No.3

본 연구는 ‘평가’에 대한 이해관계자들의 ‘평가’ 의미를 분석하는데 있다. 이를 위하여 평가의 개념에 대한 의미 분석(semantic differential methods)을 사용하였다. 이를 위하여 ‘평가’ 개념에 대한 3차원(활동차원, 능력차원, 평가차원)을 나타내는 형용사를 선정하고, 교사들에게 논리적 타당도를 검정하였다. 활동차원 12개 형용사, 능력차원 10개 형용사, 평가차원 4개 모두 26개 형용사를 사용하여 초중등학교 학생 및 대학생, 그리고 교사 등 604명을 대상으로 자료를 수집하여 탐색적 요인분석(EFA)을 하였다. 프로파일분석과 ANOVA을 실시하였으며, 구조관계를 파악하기 위하여 구조방정식모형으로 분석하였다. 연구결과 3차원 중에서 활동차원의 점수가 가장 높게 나타났으며, 초등학생을 제외한 중고등학생, 교사 모두 능력차원에서 부정적으로 인식하고 있는 것으로 나타났다. 3개 차원의 요인계수는 모두 유의하게 나타났으며, 모형은 적합한 것으로 나타났다. This study is to analyze the meaning of stakeholders in ‘evaluation’. To do this, semantic differential methods were used. For this purpose, the adjectives representing the three dimensions (ability, activity, and evaluation) of the concept of ‘evaluation’ were selected and the logical validity of the teachers was tested. With 12 activity dimension adjectives, 10 ability dimension adjectives, and 4 evaluation dimension adjectives are selected 26 adjectives. 604 subjects were collected and exploratory factor analysis (EFA) was performed. Profile analysis and ANOVA were conducted. Structural equation modeling were used to analyze structural relationships. As a result of this study, the score of activity dimension was the highest among the three dimensions, and both middle and high school students and teachers except the elementary students recognized that they were negative in the ability dimension. Therefore, it is necessary to have a positive perception of the actual evaluation, and it is necessary to raise fairness in the evaluation activities. These results are highly suggestive to teachers in charge of teaching evaluation.

평가염려 완벽주의의 직무열의와 직무소진에 관한 연구: 리더의 사회적 지지가 조절된 자기자비의 매개효과

김민경(Min-Kyung Kim),신제구(Je-Goo Shin) 한국인사조직학회 2018 한국인사ㆍ조직학회 발표논문집 Vol.2017 No.3

조직 구성원은 과도한 경쟁과 성과지향적인 조직사회에서 강요된 완벽으로 인해 부정적인 심리적ㆍ정신적 특성을 나타내고 있으나, 긍정 조직학 관점에서 완벽주의에 대한 측정이 부족한 상황이다. 따라서 본 연구는 조직 구성원의 평가염려 완벽주의(evaluative concerns perfectionism)가 직무열의와 직무소진에 긍정적인 영향을 미치는 메커니즘을 밝히고자 한다. 첫째, 평가염려 완벽주의의 부정적인 특성이 자기자 비(self-compassion)의 매개효과를 통해 직무열의와 직무소진에 긍정적인 영향을 나타내는 인과관계를 검증하고 둘째, 리더의 사회적 지지가 평가염려 완벽주의의 자기자비 활동에 어떠한 영향력을 미치는지 탐색하였다. 연구의 정확한 검증을 위하여 국내 300인 이상 기업의 다양한 업종에서 근무하는 직장인을 대상으로 독립변수와 종속변수의 측정시기를 2주 간격으로 분리하고 측정항목의 순서를 상이하게 배열 함으로써 동일방법편의(common method bias) 문제를 해결하고자 하였다. 통제변수는 종속변수에 영향을 미치는 정서 상태와 각 종속변수에 통계적으로 유의적인 관계가 있는 인구통계학 변수로써 직책과 근속 개월을 선별하여 사용하였다. 매개변수인 자기자비는 2요인 구조로 구성됨에 따라 구조방정식에서 팬텀 변수(phantom variable)를 활용하여 병렬다중매개모델과 연속다중매개모델을 비교 분석하였다. 연구결과 첫째, 자기자비가 평가염려 완벽주의와 직무열의, 직무소진 간에 관계에서 긍정적인 영향을 미치는 중요한 매개변수임을 확인하였다. 즉, 평가염려 완벽주의의 부정적인 특성이 직무태도에 부정적인 결과를 보이지만, 자기자비 행동을 높게 할수록 직무열의를 증가시키고 직무소진을 감소시키는 긍정적인 결과를 나타냈다. 둘째, 연속다중매개모델을 통해 자기자비의 두 가지 요인에 대한 매개효과 유의성이 검증되었는데 이는 평가염려 완벽주의가 자기자비의 긍정적인 요인에 직접적으로 영향을 주지 않고 자기자비에 방해되는 부정적인 요인을 하지 않을수록 자기자비의 긍정적인 요인에 유의한 영향을 미칠 수 있다는 메커니즘을 확인하였다. 셋째, 리더의 사회적 지지는 평가염려 완벽주의와 직무열의 간의 관계에서 조절효과가 있는 것으로 나타났으며 사회적 지지가 높은 집단일수록 자기자비의 긍정적인 요인과 직무열의 간에 조절효과는 강화되었다. 따라서 리더의 높은 사회적 지지는 구성원의 자기자비 활동을 높여주며 직무열의를 증가시키는 작용을 한다. 본 연구는 평가염려 완벽주의와 직무열의, 직무소진 간의 관계를 실증적으로 연구하여 평가염려 완벽주의에 대한 긍정적인 인식을 강화시켰다는 점에서 기존 연구를 확장하는데 의의가 있다. 또한 긍정 조직학(positive organizational scholarship) 관점에서 평가염려 완벽주의의 긍정적 심리상태와 과업 성과를 향상시키는데 초점을 두어 개인과 리더, 조직의 역할을 조명하고 이론적ㆍ실무적 논의와 새로운 시사점을 제시함으로써 조직의 성공적인 발전에 기여하고자 하였다. Although organizational members exhibit negative psychological and psychological characteristics due to intense competition and perfection in achievement-oriented modern society, there is a lack of perfectionism in terms of positive histology. Therefore, this study aims to reveal the mechanism that positively affects work engagement and job burnout, focusing on evaluator concerns perfectionism. First, the negative characteristics of evaluative concerns perfectionism have a positive effect on job engagement and job burnout through the mediating effect of self-compassion. Second, we investigated how leader s social support has an influence on self - compassion of evaluative concerns perfectionism. In order to verify the research accurately, it is necessary to divide the measurement periods of independent variables and dependent variables into two separate intervals and to arrange the order of the measurement items for the common method bias problem Respectively. he control variables are emotional states that affect dependent variables and demographic variables that have a statistically significant relationship with each dependent variable. As the parametric self - proportion is composed of two - factor structure, the parallel multiple model and the serial multiple mediator model are compared and analyzed using the phantom variable in the structural equation. The results of this study are as follows. First, Self - compassion is an important parameter affecting the relationship between evaluative concerns perfectionism and work engagement and job burnout. Assessment Anxiety The negative characteristics of perfectionism have negative consequences on job attitude, but the higher the self-compassion behavior, the more positive the work engagement and the decrease job burnout. Second, serial mediator model was used to test the mediating effects of two factors on self-affirmation. evaluative concerns perfectionism does not directly affect positive factors of self-affinity but negatively affects self-affinity. negative factors that interfere with self-compassion may have a significant effect on the positive factors of self-compassion. Third, the social support of the leader showed a moderating effect on the relationship between evaluative concerns perfectionism and work engagement. The higher the level of social support, the stronger the moderator between positive and negative enthusiasm. Therefore, the high social support of the leader increases the self -compassion of the employee and increases the enthusiasm of the job. This study is meaningful in expanding the existing study in that it has strengthened the positive perception of evaluative concerns perfectionism by empirically studying the relationship between evaluative concerns perfectionism and work engagement and job burnout. From a Positive Organizational Scholarship perspective suggests new implications for understanding and contributing to the role of organization, leader, and individual in positive psychological and task performance of evaluative concerns perfectionism.

휠체어 이용자의 안전성 향상을 위한 보도 평탄성 측정 방법 개발

김지호,오흥운 한국도로학회 2020 한국도로학회논문집 Vol.22 No.5

PURPOSES : In this study, the flatness of a sidewalk surface was evaluated by measuring the vibration acceleration experienced by wheelchair users passing the sidewalk using a walking measure. The objective of this study is to derive a linear equation for converting the vibration acceleration of a sidewalk surface measured using a walking measure into vibration acceleration of a wheelchair. METHODS : To this end, field measurements were obtained. Twenty sites with different sidewalk surface materials were selected to measure the vibration accelerations of the walking measure and wheelchair. A regression analysis was conducted with the measured root mean square value of the vibration acceleration, and a linear equation expressing the walking measure and wheelchair vibration acceleration was derived. RESULTS : The regression analysis was conducted by inputting the vibration acceleration of the wheelchair into the Y-axis and that of the walking measure into the X-axis. Thus, a linear equation between the walking measure and wheelchair acceleration could be derived. Further, linear equations could be derived and applied based on the situation using various standard walking measures and wheelchairs. These equations could be used to convert the vibration acceleration of the walking measure into that of the wheelchair. Substituting the converted vibration acceleration into the comfort level specified in ISO 2631-1 was expected to indicate the flatness of the sidewalk. CONCLUSIONS : This study confirmed that a linear equation for the two vibration accelerations could be derived by measuring the vibration accelerations of the walking measure and wheelchairs of 20 different sites. The vibration acceleration measured using the walking measure could be converted into that of the wheelchair using this linear equation. In addition, the flatness of the sidewalk could be evaluated by measuring the vibration acceleration of the walking measure using this linear equation.

Instructor factors associated with medical students’ lecture evaluation: a longitudinal analysis

Jeongbae Rhie,Yoo-Mi Chae,Seok Gun Park,Jae-hyun Kim,Hong Ja Kim 한국의학교육학회 2023 Korean journal of medical education Vol.35 No.2

Purpose: This study identified factors that affect lecture evaluation by analyzing sophomores from Dankook University, examining each cluster’s characteristics, and comparing differences among trajectories. Methods: This study identified factors that affect lecture evaluation by analyzing sophomores from Dankook University, examining each cluster’s characteristics, and comparing differences among trajectories. Results: The lecture evaluation score decreased as the teaching hours per instructor in a year increased by an hour, and the number of instructors per lecture increased by one individual. During trajectory analysis, the first trajectory had lower lecture evaluation scores overall but relatively high appropriateness of the textbook and punctuality of class, whereas the second trajectory had higher lecture evaluation scores overall for all four items. Conclusion: The two trajectories showed differences in teaching methods (understanding of lecture content and usefulness of the lecture) rather than in external factors (appropriateness of the textbook and punctuality of class). Therefore, to improve lecture satisfaction, enhancing instructors’ instructional competencies through lectures and adjusting the teaching hours by assigning an adequate number of instructors per lecture are recommended.

내부회계관리제도의 취약점과 이익의 질, 정보비대칭 및 자본시장평가

장석진,이명곤 韓國公認會計士會 2013 회계·세무와 감사 연구 Vol.55 No.2

엔론(Enron), 월드컴(WorldCom), 대우 등과 같은 대규모 회계부정사건은 회계정보 신뢰성의 훼손이 자본시장의 효율적 운영에 장애 요인으로 작용할 수 있다는 점을 보여준 가장 대표적인 사건이라 할 수 있다. 대규모 회계부정사건을 계기로 회계처리기준뿐만 아니라 회계정보 및 공시정보를 산출하는 과정인 내부통제시스템의 투명성 확보를 위한 규정의 필요성이 제기됨에 따라 국내에서 내부회계관리제도가 제정되어 시행되고 있다. 이러한 배경에서 본 연구는 내부회계관리제도의 효익에 대한 종합적인 고찰을 수행하고자 한다. 구체적으로 본 연구는 내부회계관리제도의 취약점이 이익의 질, 정보비대칭 및 자본시장평가에 미치는 영향을 분석한다. 여러 선행연구에서 이익의 질은 회계정보 신뢰성에 대한 대용치로 널리 사용되고 있다. 내부회계관리제도의 취약점을 보고한다는 것은 회계정보 및 공시정보를 산출하는 과정에 문제점이 존재한다는 것을 의미하므로 취약기업일수록 회계정보의 신뢰성이 낮을 것으로 예상된다. 따라서 내부회계관리제도의 취약점이 이익의 질에 미치는 영향은 직접적인 영향이지만, 정보비대칭과 자본시장평가에 미치는 영향은 직접적인 영향과 간접적인 영향으로 구분될 수 있다. 즉, 내부회계관리제도의 취약점은 직접적으로 정보비대칭에 영향을 미칠 뿐만 아니라 이익의 질을 낮춤으로써 간접적으로 정보비대칭에 영향을 줄 수 있다. 또한 내부회계관리제도의 취약점이 자본시장평가에 직접적으로 부정적인 영향을 미칠 수 있으나, 내부회계관리제도 취약점으로 인해 낮아진 이익의 질과 정보비대칭의 심화를 통해서 간접적으로 영향을 줄 수 있다. 종합해보면 내부회계관리제도의 효익을 정확하게 파악하기 위해서는 내부회계관리제도 취약점의 직접적인 영향뿐만 아니라 간접적인 영향에 대해서도 살펴볼 필요가 있다. 이를 위해 본 연구는 구조방정식 모형을 통해 내부회계관리제도 취약점이 정보비대칭 및 자본시장평가에 미치는 직ㆍ간접적인 영향이 존재하는지를 분석한다. 분석결과에 의하면 내부회계관리제도가 취약할수록 이익의 질은 낮아지는 것으로 나타났다. 또한 내부회계관리제도의 취약점이 직ㆍ간접적으로 정보비대칭을 심화시킨다는 결과를 확인할 수 있었다. 뿐만 아니라 내부회계관리제도 취약점에 대한 자본시장의 평가는 부정적인 것으로 나타났다. 특히 내부회계관리제도의 취약점이 자본시장평가에 미치는 영향은 직접적인 영향보다 이익의 질 훼손 및 정보비대칭 심화를 통한 간접적인 영향이 강하다는 것을 확인하였다. 본 연구의 공헌점은 다음과 같이 요약할 수 있다. 첫째, 본 연구는 구조방정식 모형을 사용하여 매개변수에 대한 고려를 통해 내부회계관리제도의 효익을 종합적으로 분석한다는 점에서 선행연구와 차별된다. 둘째, 본 연구는 내부회계관리제도의 효익과 비용에 대한 많은 논의가 이루어지고 있는 상황에서 내부회계관리제도의 유용성에 대한 단편적인 증거가 아닌 종합적인 증거를 제시한다는 점에서 의의를 가질 것이다. 셋째, 본 연구는 자본시장이 내부회계관리제도 취약점을 부정적으로 평가한다는 결과를 제시함으로써 내부회계관리제도를 운영하는 기업, 감독을 수행하는 감독기관, 자본시장 참여자, 감사인 등에게 중요한 시사점을 제공할 것이다. A series of accounting scandals that started with the Enron, WorldCom, and Daewoo implies that the loss of accounting reliability may interrupt capital market operation. In response to accounting scandals, implementation of Internal Accounting Control System (IACS) has become a mandatory requirement in 2003. IACS has been effective since April 2004 in Korea. This study examines the effectiveness of IACS in three aspects using firm-year sample of all companies listed on KOSPI and KOSDAQ. In concrete, this study examines the effect of material weaknesses in internal accounting control system (ICW) on earnings quality, information asymmetry, and capital market evaluation. In general, reporting ICW implies the existence of problems in accounting information generation and disclosure process. Companies reporting ICW are expected to show lower level of earnings quality. The effect of ICW on earnings quality is only direct effect, but information asymmetry and capital market evaluation can be classified into two: direct effect and indirect effect. That is, ICW indirectly affect information asymmetry through lowering earnings quality as well as ICW directly affects information asymmetry. Moreover, ICW have both direct and indirect effect on capital market evaluation. To the extent of indirect effect, ICW decrease earnings quality and increase information asymmetry, and ultimately, affect investment decisions of market participants. Therefore not only direct effect of ICW, but also indirect effect of ICW should be recognized so as to figure out the effectiveness of IACS. This study analyzes direct effect and indirect effect of ICW through structural equation model. As a result, this study finds that ICW lower earnings quality and increases information asymmetry. Also, this study suggests that capital market have propensity to undervalue companies reporting ICW. Moreover, the result implies that lowering earnings quality and increasing information asymmetry, rather than direct effect of ICW, attribute the undervaluation for companies reporting ICW. This study makes several contributions. Firstly, this study differentiates from prior studies in that it delivered a comprehensive analysis the benefits of the internal accounting control system using structural equation model by considering moderating variables. Secondly, this study proposes supportive, timely, and comprehensive evidences for the argument that the benefits of internal control system exceeds the costs. Lastly, this study contributes to the companies operating the internal accounting control system, supervisory institutions, market participants, and auditors by providing the results suggesting that capital market tend to undervalue companies with ICW.

다층퍼셉트론 신경망을 이용한 강의평가점수 동등화

이문규 한국경영공학회 2020 한국경영공학회지 Vol.25 No.2

Purpose Course evaluation scores are usually distorted by several factors related with student, lecture, class environment, and lecturer. The objective of score equating is to remove score distortions such that only pure errors are remained in the adjusted scores. Methods A multi-layer perceptron neural network is proposed as a score equating tool. The proposed neural network is composed of one input layer, two hidden layers, and one output layer. The performance of the neural network was evaluated comparatively with the stepwise-variable-selection based regression model. The specific factors considered in the analysis include class size, average grade of class students, type of course, type of lecture, class grade point average, and language used. Performance measures used for the comparison were the mean square and the degree of significant difference among levels of each factor, quartile ranges across levels in each factor, and each factor level’s average, standard deviation, and interquartile range. Results The proposed neural network outperforms for all the measures except the quartile ranges across levels in each factor. Conclusion The results illustrate the validity and the usefulness of the proposed neural network in real applications of course-evaluation score equating.

의과대학 한 과목 시험에서 문항반응이론에 따른 검사 동등화 예

허선 한국의학교육학회 2005 Korean journal of medical education Vol.17 No.1

Purpose: To determine possible differences in the ability of students from two consecutive medical school class years, test equating based on item response theory was performed on the results of a lecture examination. Methods: The dataset for this study of the results of a medical school lecture exam was composed of the number of items and examinees: 75 students tested on 60 items in 2002, and 82 students tested on 50 items in 2003. We used common item non-equivalent group design and tested the assumption of unidimensionality and data-fitness. Item parameter estimates were based on the Rasch model, and the scale transformation was performed using mean/sigma moment methods. Equating was applied to both true and observed scores, and the results were analyzed. Results: The slope and intercept for the scale transformation of the 2003 exam to the 2002 exam were 1.2796 and 0.9630, respectively. The mean and standard deviation of the ability parameter of the students taking the 2003 exam were 1.69 and 0.66, respectively. After scale transformation, the mean increased to 3.13 and the standard deviation increased to 0.85. For the 2002 exam, the mean was 0.70 and the standard deviation was 0.66. The correlation coefficient between the true and observed scores was 0.9994(P=0.00). Conclusion: The difference in the ability parameter of students between the two years increased after scale transformation. Both the true and observed scores could be used interchangeably after equating. Thus, test equating based on item response theory may be applicable to medical school lecture examinations.