
http://chineseinput.net/에서 pinyin(병음)방식으로 중국어를 변환할 수 있습니다.
변환된 중국어를 복사하여 사용하시면 됩니다.
대규모 언어 모델 기반 한국어 말하기 평가 자동화의 가능성과 한계 분석
홍예림(Yerim Hong),손소현(Sohyun Son),성무진(Mujeen Sung) Korean Institute of Information Scientists and Eng 2025 한국정보과학회 학술발표논문집 Vol.2025 No.7
본 연구는 대규모 언어 모델(LLM)을 활용한 한국어 말하기 자동 평가의 가능성과 타당성을 탐색하였다. 외국인 학습자와 모어 화자의 발화에 대해 LLM이 산출한 점수와 전문가 점수를 비교하고, Pearson 상관계수 및 Mann-Whitney U 검정을 통해 평가의 신뢰성과 숙련도 구분력을 분석하였다. 그 결과, 일부 모델은 전문가 평가와 높은 상관을 보였으며, 화자의 숙련도 차이에도 민감하게 반응하였다. 본 연구는 LLM 기반 말하기 평가 자동화의 실현 가능성을 제시하고, 향후 평가 설계에 필요한 기초를 제공한다.
신호전달수단으로 미국의 대북억제(對北抑制)와 대한보장(對韓保障)에 대한 한국인의 신뢰
홍예림 ( Hong Ye Rim ),조동준 ( Jo Dong-joon ) 서울대학교 통일평화연구원 2024 통일과 평화 Vol.16 No.3
This study conducted a survey experiment to demonstrate that (1) South Koreans evaluate the credibility of US deterrence against North Korea and assurance toward South Korea regardless of changes in North Korea’s threat level, and (2) they perceive measures involving sunk costs as more effective than those involving audience costs in deterring North Korean aggression. These findings suggest two key implications: (1) Contrary to the common expectation that increasing North Korean threats would weaken the credibility of US extended deterrence and assurance due to America’s risk aversion, South Koreans’ perception remains unaffected by the intensity of North Korea’s threat. (2) South Koreans place greater trust in ex ante measures, such as joint military exercises and the stationing of US forces in South Korea, over verbal commitments which bring ex post audience costs.
학문 목적 한국어 말하기 능력 평가 도구 개발을 위한 요구 분석
홍은실,박현정,조수진,민병곤,안현기,오예림,강석한 국제한국어교육학회 2016 한국어 교육 Vol.27 No.4
Eunsil Hong, Hyunjeong Park, Sujin Cho, Byeonggon Min, Hyunkee Ahn, Yelim Oh & Seokhan Kang. 2016. The Needs Analysis of Korean Speaking Test for the Academic Purposes. Journal of Korean Language Education 27-4: 243-268. The purpose of this study is to analyze the interested groups’ needs for Korean speaking test for academic purposes. Two hundred twenty nine foreign university students who have studied in undergraduate and graduate schools, one hundred three professors who have taught foreign students, and forty one university institutional staff members whose work is related to foreign students have taken part in the survey. The direction for testing Korean speaking test for academic purposes and the considerations in developing Korean speaking test for academic purposes were investigated through the needs survey. The results indicate that Korean speaking test for the academic purposes should be adopted because the tests for the general purposes could not cover the academic ability for the foreign students. Also the criteria for the test are needed to be set up to mitigate the perception gap of interested groups’ academic speaking proficiency. Futhermore, we reviewed various constructs beyond linguistic competence and considered test takers’ background variables when we develop Korean speaking test for academic purposes.
한국어 말하기 평가의 채점 타당도 연구 -워크숍 기반의 채점자 훈련을 중심으로-
홍은실 ( Hong Eun-sil ),오예림 ( Oh Ye-lim ),이성준 ( Lee Sung-jun ),조수진 ( Cho Su-jin ),안현기 ( Ahn Hyun-kee ),이승원 ( Lee Seung-won ),민병곤 ( Min Byeong-gon ) 국제어문학회(구 국제어문학연구회) 2020 국제어문 Vol.0 No.84
본 연구는 한국어 말하기 평가의 채점 타당도를 확보하기 위해 워크숍 기반의 채점자 훈련을 설계 및 실행하고 채점자 훈련에서 나타난 채점 근거의 유형을 분석하는 것을 목적으로 한다. 이를 위하여 대규모 학문 목적 한국어 말하기 평가를 위한 워크숍 기반의 채점자 훈련을 설계하였다. 채점자 훈련 과정에서 평가 도구에 명시된 채점 기준을 채점자가 능동적으로 적용할 수 있도록 하였으며 수집된 채점자 담화를 통해 채점자들이 점수 결정 과정에서 주목하는 채점의 근거들을 분석하였다. 분석 결과 채점자들이 수험자의 응답에 점수를 부여할 때 문항의 내용 및 특성, 평가 준거, 채점 척도를 근거로 삼는다는 것을 확인하였다. 또한 채점자들은 채점자 간 협의를 통해 정신적 채점 기준과 응답 표상을 수립하여 채점에 참여하고 있었다. 채점자 훈련의 결과로 과제의 특성을 고려한 채점 접근의 전략화와 주관적 평가 준거 비중의 객관화, 평가 척도의 조정과 정교화의 효과를 확인할 수 있었다. This study investigates scoring validity through rater training workshops for the Korean Speaking Test for Academic Purposes (KoSTAP). The rater training workshops in this study were designed to ensure the raters can discuss scoring rubric, clarify and modify the intended rating criteria, and reach an agreement through discussions. The rater training procedure was composed of orientation about KoSTAP and scoring rubric, sample item scoring, group discussion, group scoring, and general discussion. The study results showed that discussions conducted through the workshops served as a necessary process for the raters to make the scoring rubric increasingly tangible and concrete. The results also showed that the raters scored based on the contents and characteristics of the tasks, the criteria, and the scoring scale. In addition, the raters participated in scoring by establishing mental response representations and scoring criteria through negotiations among them. As a result of the rater training, we were able to identify the effectiveness of rating strategies based on the characteristics of the task, objectification of criteria weights, and adjustments and refinements in the evaluation scales.
Impact of medical crisis on the critical care system in South Korea
장예림,조재화,조중범,하태순,고보건,김은혜,김임경,이동현,홍석경 대한중환자의학회 2025 Acute and Critical Care Vol.40 No.3
Background: The ongoing medical crisis in Korea has severely impacted the operational environment of intensive care units (ICU), posing significant challenges to quality care for critically ill patients. This study aimed to evaluate the effects of the ongoing crisis on ICUs. Methods: A survey was conducted in July 2024 among intensivists in charge of ICUs at institutions accredited by the Korean Society of Critical Care Medicine for critical care. The survey compared data from January 2024 (pre-crisis) and June 2024 (post-crisis) on the number ICU beds, staffing composition, work hours, and the number and roles of nurse practitioners. Results: Among the total of 71 participating ICUs, 22 experienced a reduction in the number of operational beds, with a median decrease of six beds per unit, totaling 127 beds across these ICUs. The numbers of residents and interns decreased from an average of 2.3 to 0.1 per ICU, and the average weekly working hours of intensivists increased from 62.3 to 78.8 hours. Nurse practitioners helped fill staffing gaps, with their numbers rising from 150 to 242 across ICUs, and their scope of practice expanded accordingly.Conclusions: The medical crisis has led to major changes in the critical care system, including staffing shortages, increased workloads, and an expanded role for nurse practitioners. This is a critical moment to foster interest and engage in active discussions aimed at creating a sustainable and resilient ICU system.