공공부문 EA 성과평가 지표 설정 및 적용방안 연구

이석균 숭실대학교 대학원 2009 국내박사

Stability Prediction and Control of Anaerobic Digestion Process Based on Artificial Intelligence

JIA RU 국립한국해양대학교 대학원 2025 국내박사

This study investigated the process stability of anaerobic digestion and enhanced intelligent control through applications of machine learning. One stability indicator characterized the dynamic balance of anaerobic biochemical reactions by introducing Recovery Potential (RP) and Deterioration Potential (DP). Another stability indicator diagnosed the state of anaerobic digestion through a comprehensive indicator derived using Principal Component Analysis (PCA). A deep learning model combining a Convolutional Neural Network (CNN) and Bidirectional Long Short-Term Memory (BdLSTM) utilized real-time sensor data to provide insights into system state and performance, ensuring economical and stable digester operation. Finally, intelligent control of anaerobic digestion was implemented using a Deep Q-Network (DQN) reinforcement learning model, integrating stability indicators with the CNN-BdLSTM network. RP and DP were formulated to shed light on the kinetic balance between anaerobic biochemical reactions. RP is gauged by the ratio of the methanogenesis rate (MR) to the acidogenesis rate (AR), while the DP is the sum of the accumulation rate (AcR) and dilution rate (DR) of total VFAs, normalized using the AR. In an anaerobic digester for a mixture of pulverized food waste and liquified sewage sludge, an RP above 1.0 signifies a restorative state in the kinetic balance of anaerobic biochemical reactions across various operational phases, including startup and steady state, and shifts in organic loading rate. Conversely, a DP value of 0.0 or higher denotes a deterioration in the kinetic balance. The instability index (ISI), calculated as the DP to RP ratio, serves as an indicator of an anaerobic digestion state. When the standard deviation of ISI surpasses 0.2, it signifies instability in biochemical reactions; however, an average ISI below 0.05 indicates a stable digestion process. The study underscores the efficacy of RP, DP, and ISI as robust indicators for assessing the stability of anaerobic digestion based on the kinetics of biochemical reactions. A comprehensive indicator based on PCA has been proposed for diagnosing the state of anaerobic digestion. Various state and performance variables were monitored under different operational modes, including start-up, interruption and resumption of substrate supply, and impulse organic loading rates. While these individual variables are useful for estimating the state of anaerobic digestion, they must be interpreted by experts. Coupled indicators combine these variables with the effect of offering more detailed insights, but they are limited in their universal applicability. Time-series eigenvalues reflected the anaerobic digestion process occurring in response to operational changes: Stable states were identified by eigenvalue peaks below 1.0, and they had an average below 0.2. Slightly perturbed states were identified by a consistent decrease in eigenvalue peaks from a value of below 4.0 or by observing isolated peaks below 3.0. Disturbed states were identified by repeated eigenvalue peaks over 3.0, and they had an average above 0.6. The long-term persistence of these peaks signals an increasing kinetic imbalance, which could lead to process failure. Ultimately, this study demonstrates that time-series eigenvalue analysis is an effective comprehensive indicator for identifying kinetic imbalances in anaerobic digestion. The immediate response to the state disturbances of anaerobic digestion is essential to prevent anaerobic digestion failure. However, frequent monitoring of the state and performance of anaerobic digestion is challenging. Thus, deep learning models were investigated to predict the state and performance variables from online sensor data. The online sensor data, including pH, electric conductivity, and oxidation-reduction potential, were used as the input features to build deep learning models. The state and performance data measured offline were used as the labels. The model performance was compared for several deep learning models of CNN, LSTM, dense layer, and their combinations. The combined model of CNN and BdLSTM was robust and well-generalized in predicting the state and performance variables (R2=0.978, root mean square error=0.031). The combined model is an excellent soft sensor for monitoring the state and performance of anaerobic digestion from electrochemical sensors. Reinforcement learning (RL) based on a deep Q-network (DQN) was studied to enable intelligent control of anaerobic digestion processes. Anaerobic digesters operated under statistically designed organic loading rate (OLR) conditions provided sensor data on process states and performance. Variable importance analysis identified key RL components—pH, EC, and ORP as states; OLR (flow rate and COD) as actions; and total reward combining stability and methane production. A deep learning-based environment model was trained to simulate process dynamics, predicting the next states and total reward based on the current states and actions. The architecture of the DQN with ε-greedy and prioritized experience replay was optimized by interacting with the environment model. Offline training effectively pre-trained model parameters, enhancing initial learning performance. The pre-trained DDQN was activated above a total reward threshold, stabilizing process instability and improving methane production under variable OLR conditions. The dueling DDQN (TDQN) showed slower pre-training but rapidly adapted to variability, stabilizing the process and significantly improving methane production. Both pre-trained DDQN and TDQN provide intelligent control frameworks for optimizing anaerobic digestion performance under variable OLR conditions.

Evaluating Criteria for Green Port Performance in China : A Study incorporating Delphi, AHP and IPA Matrix Methods

진탁 성균관대학교 일반대학원 2016 국내박사

This is a study on China’s green port performance incorporating the Delphi, AHP and IPA methods. The ‘green port’ concept has been gaining significant attention worldwide. Diverse approaches have been made increasingly from both the green practices of the port industry and a wide range of studies from academicians. Accordingly, a great many ports, regional and international organizations have made various guidelines for green port performance, while the emphases on green performance have changed over time as well. As a country with the biggest number of top ports in terms of container volume, it is of great significance for China to do a thorough and effective green performance both for the global environment and Chinese government’s green goal incorporated in the national “Five-year-plan”. However, China has never been considered to be a “role model” for a green port performance due to the lack of a set of clear and practical criteria for a green port performance and the limited range of its green practices. Given the fact that China has a special and unique port management system, it is very necessary to create applicable green performance indicators for Chinese ports and to indicate the priorities of China’s green port performances. Since no port could possibly have unlimited resources for green performance, a great many ports have started to seek a sustainable development with high efficiency. The green practices of global ports were reviewed for practical references and a great many previous studies made both domestic and abroad were examined as well for a theoretical framework. This study attempts to create a set of applicable and practical green port performance indicators and prioritize the green indicators to see each port’s performance level. Also, this study indicates each port’s green port performance efficiency as well. Shanghai Port, Qingdao Port and Ningbo Port were selected as the targeted ports for their geographic location, top level of container volume and their strategic position in future developments. This study, therefore, constructed an expert panel for three rounds of Delphi surveys and eventually extracted a set of green criteria for Chinese port performance. Based on the results of the Delphi, all green indicators were prioritized on three levels, i.e. the global level of all green dimensions, the local level of all sub-criteria under each dimension and all green sub-criteria overall levels. On each level the relative weights were estimated from two aspects i.e. the overall level and by port. In the end, with the important degree of perception obtained from the 3rd round Delphi and the performance level from the results of AHP, the relative degree of importance perception and performance level were measured to indicate the green port performance’s efficiency. The Delphi results clearly show that the green performance in Chinese ports has great consistency with government’s major policies, i.e. focuses on the CO2 emissions and energy saving, which is highly consistent with and greatly resulted from the port management system in China. This study, furthermore, found that in the AHP, firstly, green port performance in China is not quite as community-concerned and motivated as other global ports such as Rotterdam Port, Sydney Port, etc. Secondly, in China, a port’s geographic location and type of hinterland economy significantly influences a port’s priority regarding its port performance. Thirdly, two types of focuses were clearly observed in Chinese ports’ green performances, i.e. government’s policies and indicators could be easily seen, heard or felt, such as noise control, dust control and energy-saving criteria. The overall IPA result shows that the ports’ green performances in China are staying at a relatively low efficiency since the indicators falling in the quadrant with a high degree of perception and low degree of performance are consequently much more than the quadrant with possible over performance. As regards to each port’s green efficiency, Shanghai Port has the best performance efficiency compared to the other two; while Qingdao Port has the most indicators requiring immediate improvement and resource reallocation. Based on the set of green indices extracted from this study and the priorities of green port performance estimated by the AHP, implications could be drawn on two aspects: both the policy maker and the port authorities, for more effective and efficient policies. Firstly, the central government and local governments should be completely aware of the features of the green performance in China, and that they are strongly national policy-oriented and cost-saving oriented. In the future policy making process, the government should take sufficient consideration to guiding the ports to be more global market-oriented and community-concerned motivated. Secondly, the government could launch a clear and official green port evaluation system based on the criteria extracted from the reliable Delphi surveys made by experts from diverse affiliations. With the clear evaluation system, the government would be able to annually rank the ports in China to practically motivate the ports for better green performances. With the clear and applicable green port evaluating indicators, the port authorities would be able to make concessional rate policies and penalty policies for their “green” suppliers and customers, which is exactly what other global ports are doing. Furthermore, based on the IPA results, port authorities could possibly reallocate some of their resources in the fields where the indicators require immediate and vast improvement. Instead of only “taking orders”, port authorities should proactively participate in further international collaboration and at the same time, still be more competitive. This study greatly contributes to a set of green indices for Chinese ports based on three rounds of expert surveys targeted on three representative ports. It is of relative significance to keep the green evaluation indicators upgraded and tracking on the green port performance, which requires sufficient time and labor, wide social connections and tremendous funding. It would be extremely difficult for scholars to conduct this kind of large scale country wide project. Hopefully, this study will call for interest from the research institutes and/or the government for further in-depth studies not only on upgrading the green port performance indicators but also prioritizing the performance criteria to reveal the focuses and the green performance efficiency on the overall level.

Genetic and Phenotypic Indicator Traits for Reproductive Performance in Commercial Sows

Pereira Sanglard, Leticia Maria Iowa State University ProQuest Dissertations & The 2021 해외박사(DDOD)

The objective of this dissertation was to study potential indicator traits for reproductive performance in sows, including testis size, response (antibody and vaginal microbiome) to Porcine Reproductive and Respiratory Syndrome virus (PRRSV), and antibody response to other common infectious pathogens in swine (Mycoplasma hyopneumoniae, MH; swine Influenza A virus, IAV; porcine circovirus type 2, PCV2; and Actinobacillus pleropneumoniae, APP). To determine the effectiveness of measuring testis size in the sires to identify sows with superior reproduction, 161 Yorkshire and Landrace boars were measured for testis width and area, and 384 sows (daughters of 13 of the boars) had farrowing performance recorded. The heritability of testis size traits was high (~0.67). Larger testis width was associated with greater litter size without increasing piglet mortality. These results indicate the possibility of a phenotypic assessment of testis size in sires as a useful tool to cull boars for breeding, improving female performance and the possibility of indirect early selection for female reproductive performance traits in boars. The genetic basis of response to PRRSV vaccination, measured as sample-to-positive (S/P) ratio, was investigated. A total of 906 gilts had blood samples collected at ~50 days after a PRRSV vaccination. From those, 302 gilts had vaginal microbiome data collected at 4 and 52 days after the PRRSV vaccination, and 807 sows had farrowing performance collected. Heritability estimates of the relative abundance of the microbes varied from low to high (~0–0.60), and genomic regions were identified that were associated with several microbes, including a potential pleiotropic region on chromosome 12. Estimates of microbiability (i.e., the proportion of the phenotypic variance explained by the microbiome) for reproductive performance and antibody response to PRRSV were, in general, low (< 0.15). However, the discriminant analyses revealed that the vaginal microbiota was able to classify gilts into groups of high and low antibody responders to PRRSV vaccination with a misclassification rate of less than 2%. Further, we identified eighteen microbes that were differentially abundant between the low and high reproductive performance sows. The discriminant analyses revealed that the vaginal microbiota was able to classify gilts into groups of high and low reproductive performance with a misclassification rate of less than 12%. Among the microbes that overlapped between these two analyses, Campylobacter, Bacteroides, Porphyromonas, Lachnospiraceae_unclassified, Prevotella, and Phascolarctobacterium are potential biomarkers for reproductive outcomes. In the same project, we investigated the genetic basis of antibody response to PRRSV vaccination, measured as sample-to-positive ratio (S/PVx), as a potential genetic indicator for reproductive performance in commercial sows. Estimates of heritability (~0.38) and genomic prediction accuracy (~0.60) were high. Based on a SNP-based and haplotype-based genome-wide association studies, we identified a major SNP on chromosome 7 with large effects on S/PVx along with several haplotypes on chromosomes 4, 7, and 9 associated with S/PVx. The SNP and haplotype on chromosome 7 were located in the Major Histocompatibility Complex (MHC). In addition, genomic regions with high levels of homozygosity or heterozygosity were associated with S/PVx. Also, S/PVx was favorably genetically correlated with reproductive performance in vaccinated commercial sows and non-infected purebred sows. For example, the genetic correlation of S/PVx with the number of piglets born alive was 0.61 and 0.50 in commercial and purebred sows, respectively. These results suggest that S/PVx could be used as an accurate and efficient genetic indicator to improve reproductive performance. We estimated the genetic correlation of S/PVx with antibody response following a natural PRRSV outbreak (S/POutbreak) to be 0.72, which shows that these two traits are under similar genetic control. In another project, antibody response to IAV, MH, PCV2, and APP were collected for ~2,300 sows in four time-points: at entry into a commercial sow farm, after post-acclimation, during parity 1, and during parity 2. Reproductive data from 1 to 4 parities were available on a subset of 2,000 sows. In general, the heritability estimates were low to moderate, depending on the pathogen and the time of antibody response. Estimates of heritability for antibody response to APP, IAV, MH, and PCV2 ranged from 0 to 0.76. The region on chromosome 14 (2 Mb) was associated with several serotypes of APP, explaining up to 4.3% of the genetic variance. In general, genomic prediction accuracies for antibody response were low to moderate. Estimates of genetic correlation of antibody response to infectious pathogens with lifetime reproductive traits varied with time of antibody collection. Estimates of genetic correlation of antibody responses to PRRSV and MH were mostly negative with lifetime performance, ranging from -0.85 to 0.70. Estimates of genetic correlation of antibody responses to PCV2 and APP MEAN were constantly positive with all reproductive traits, ranging from 0.03 to 0.97. In summary, there was a substantial genetic correlation of antibody response to infectious pathogens with reproductive performance depending on the time of antibody collection. It is worth to investigate this relationship at specific time-points after vaccination or infection as an alternative to select for resilience in commercial sows. In conclusion, we have identified several traits with the potential to be used for culling proposes (e.g., testis size and vaginal microbiome) and genetic selection (e.g., antibody response to PRRSV vaccination and to several other infectious pathogens). Several biomarkers associated with these traits were identified and could be used to improve farrowing performance phenotypically and genetically.

경영평가 수익성 지표의 가중치가 공기업 재무성과에 미치는 영향

전정원 서울대학교 대학원 2021 국내석사

정부는 공기업의 비효율성을 해소하기 위해 다양한 정책들을 시행하여왔으며, 이 중 대표적인 정책이 경영평가제도이다. 경영평가제도는 지난 1984년 공기업의 경영목표를 명확하게 하여 공기업으로 하여금 ‘공공성’과 ‘수익성’간의 조화로운 추구를 시도하게 하며, 지대추구 행위 등 비효율성을 발생시킬 수 있는 행위에 대한 제재 및 더 나아가 공기업의 적극적인 경제행위를 촉구하기 위한 체계적인 관리·감독을 위해 도입되었다. 경영평가의 지표는 해당 공기업의 경영목표와 방향을 제시하는 역할을 함으로써, 정부가 공기업의 자율경영 체제를 보장하면서도 추구해야 할 구체적인 목표를 공기업에 투입할 수 있는 통로를 제공하는 역할을 한다. 정부는 평가 지표를 매년 수정․변경함으로써 공기업으로 하여금 새로운 경영목표를 설정하고 경영환경 변화에 탄력적으로 대응할 수 있게 하고자 한다. 본 연구에서는 최근 정부의 정책 변경에 따른 ‘수익성’ 지표 가중치의 변화에 주목하여, 경영평가 지표구성에 있어 ‘수익성’ 지표의 가중치 변화가 공기업의 재무성과에 미치는 영향을 실증 분석하였다. 특히 경영평가지표의 변경 중 ‘수익성’ 가중치의 변경이 실제 공기업의 재무성과에 어떠한 변화를 가져오는지 살펴봄으로써 평가지표 가중치 변경이 정책 목표 달성에 미치는 영향력에 대한 시사점을 도출하고자 하였다. 2015년부터 2019년까지 35개 공기업을 연구 분석 대상으로 하여 독립변수를 경영평가 수익성 지표의 가중치로 설정하고, 종속변수는 대표적 재무성과 지표인 부채규모, 노동생산성, 총자산순이익률, 영업이익, 경상이익, 관리업무비비율로 설정하였다. 통제변수로는 공기업의 재무성과에 영향을 미치는 요소들로 익히 알려진 경제성장률, 기관의 연령, 기관규모(자산, 인원)을 설정하였으며, 시장형/준시장형의 공기업 유형, 상장 여부, 요금규제 여부를 더미변수로 추가하였다. 분석 결과 경영평가의 수익성 지표의 가중치의 변화는 공기업의 영업이익/경상이익에는 정(+)의 영향을 미치는 것으로 나타난 반면, 공기업의 부채규모/노동생산성/총자산순이익률/매출액대비 관리업무비비율에는 영향을 미치지 않는 것으로 밝혀졌다. 본 연구는 경영평가 도입 이후 경영평가제도가 지속적으로 재무적인 경영실적 개선을 이끌어내고 있는지 특히 “평가지표의 구성이 공공기관이 경영실적의 지속적 개선에 실질적인 영향력을 미치는가”에 대한 검증의 일부로서의 그 의의가 있다 할 수 있으나, 분석 결과는 경영평가지표의 세부항목별 구성 및 가중치 부여로 공공기관의 재무성과의 개선을 유도하는 것은 대체적으로 유의미하지 않거나 혹은 정부가 기대하는 것과는 다른 방향으로 작동하고 있음을 나타내었다. 따라서 경영평가제도를 통한 공기업 재무성과 개선을 위해서는 경영평가지표의 설정에 있어 공기업의 수익성 측정 지표 선정 및 가중치의 적정성과 관련하여 그 효과성을 고려한 추가적인 고찰이 필요한 것으로 보인다. 마지막으로 본 연구는 연구대상이 협소하여 연구 결과의 일반화에 한계가 있을 수 있으며, 종속변수에 따라 다르게 나타난 연구 결과에 대한 논리적 인과관계 및 원인에 대한 분석이 이루어지지 못한 한계점을 보유하고 있다. 특히, 경영평가지표 개선과 이를 경영목표로 하여 공기업 내부 프로세스의 개선 등 일련의 경영활동이 재무성과의 변화를 이끌어내는 과정에 소요되는 시차 및 경로에 대한 고려가 이루어질 경우 평가 지표의 선정, 내용 및 가중치 등의 구성에 대한 전반적인 개선점을 도출하는 기여할 수 있을 것이라 여겨진다. The Korean government has introduced various policies to increase the efficiency of public enterprises. One representative policy is the management and performance assessment system that was introduced in 1984 to clarify the management goals of public enterprises and allow them to attempt a harmonious pursuit of both 'publicity' and 'profitability'. Proponents argue that these assessments allow for systematic management and supervision that reduce inefficient behaviors, such as rent seeking. The indicators of management and performance assessment system play a role in presenting the management goals and directions of the public enterprises, providing a channel for the government to insert specific goals while guaranteeing an autonomous management system. The assessment indicators are revised annually in accordance with the government's policy changes related to public enterprises. The assumption is that these annual revisions urge public enterprises to respond to changes in the management environment by setting new management goals. This study analyzes how changes in the weight of 'profitability' assessment indicators are related to financial performance of public enterprises. In short, the study asks whether and how the weight of ‘profitability’ indicators are related to the financial performance of public enterprises. Using 2015-2019 data of 35 public enterprises in Korea, regression models with the weights of profitability indicators for management and performance assessment as independent variables and financial performance measures as dependent variables (i.e. debt size, labor productivity, net income to total asset ratio, operating profit, ordinary profit and general administrative cost ratio) were built. Control variables include economic growth rate, age of the enterprises, size of the institution (asset and person), types of public enterprises (market or quasi-market), listing status, and charge regulation status. The results show that changes in the weight of profitability indicators in management and performance assessments do not affect the debt size, labor productivity, net income to total asset ratio, general administrative cost ratio of public enterprises, whereas they have a positive and statistically significant effect on operating profit and ordinary profit. This study contributes to the verification of whether the management performance assessment system has continued to improve financial performance since the introduction of management assessment, particularly on whether "the composition of assessment indicators has a substantial impact on continuous improvement of performance of public enterprises." The results show that profitability indicators do not have significant effects on financial performance or have different effects from what the government expects. Therefore, in order to improve the financial performance of public enterprises through the management and performance assessment system, it seems that a reexamination of profitability measurement indicators and the appropriateness of their weights are necessary. Some limitations of this study are as follows. First, there may be limits to generalizing the findings of this research due to its narrow scope of subjects. Second, the study does not analyze for logical causality and cannot explain why there are different results depending on the choice of dependent variables. Future studies should include a comprehensive analysis on the time lag and logic channel for the series of management activities, such as improvement of management indicators, the change of management goals, the improvement of internal processes for achieving the changed objectives, and the change of performance after the improvement of assessment indicators.

The Effects of various factors in particulate matter projects on related budget allocations : the case of Republic of Korea

엄소영 KDI School of Public Policy and Management 2020 국내석사

Even though the Korean government directs the majority of the funds allocated to solving poor air quality into projects related to transportation on the road, why is the performance of these projects not as good as other projects? To answer this question, this paper explores the impact of various factors on the budget of particulate matter in Korea by using a panel data analysis tool, the pooled OLS. After examining the relationship between factors and budget allocation in particulate matter projects, this research examined various features of projects with larger budget allocation. This paper focused on the performance indicator used in managing projects, the field, and the characteristic of projects through the ANOVA and Chi-square analysis. As a result, field factors can affect the budget of particulate matter response projects. This paper also found that there are relationships between field factors and performance indicator factors. Specifically, the transportation_road project which showed low performance with rich financial sources mainly used output indicators. On the other hand, industry projects which had a good performance result in reducing particulate matter emission with a small budget used both output and outcome indicators, not focusing on only output indicator. This gives implications for performance management and for budget allocation with performance information. Simultaneously, this paper showed that the performance achievement rate used by the government in the evaluation of each project did not relate to the budget. This foundation means that the performance evaluation tool the government used was not so effective. The Korean government needs to improve performance management and evaluation, thus encouraging use of outcome performance indicators could better align with desired goals. This research had limitations in gathering performance results from a whole field approach, not from each project. The limitation is natural given that tracking real performance results from each and every individual project is beyond the reach of any government. To verify the cause and effect between performance indicators and real results, further studies are needed to give more detailed implications to governments.

Performance Evaluation of the Chinese Real Estate Developer’s Quality Management

당연니 서울대학교 대학원 2017 국내석사

In recent years, the real estate industry in a rapid development, but at the same time, a lot of capital investment still has not change back to quality improvement, the complaints about building quality in the real estate industry accounted for the first in China. Real estate project quality accident continue to occur. In fact, the real estate developers to strengthen quality management can significantly improve the project quality, but now the problem is lack of related practice and theory about quality management evaluation for real estate developers. In order to evaluate developer’s current quality management level accurately, and find out the deficiencies for targeted improvement, this paper attempts to establish a reasonable and effective evaluation indicator system on developer’s quality evaluation, so as to ultimately improve the quality management performance of developers. The developer’s responsibility of quality management in existing legal norms, and the research and best practice on developer’s effective measures of quality management at home and abroad are the basis foundation of developer’s quality management evaluation. This paper summarized the responsibility and effective measures of the quality management of the developers through a lot of literature research also and summarized the general process and main contents of the quality management of real estate developers, then summed up the main points of developer’s quality management. This prepared a theoretical basis. for developer’s quality management performance evaluation. Based on the above content, developers’ quality management can be divided into two main parts. The first part is developer’s self-management in the early stage of project when the other project participants like designer and contractors has not involved in. After entering the design survey stage, with the participation of designer, contractor and supervisor, the main responsibility of developer became to participant’s management. Therefore, this paper starts from the two aspects of the developer's own management and the participant’s management established and indicator system, which contained 2 first-level indicators, 8 second-level indicators, 17 third-level indicators. Afterwards, this research used the questionnaire survey and Analytic Hierarchy Process (AHP) to assign the weight of the indictors. Finally, the developer could understand own quality management through the Quality Management Performance Evaluation Indictors System established in this research, and basis on the evaluation results could find out the shortcomings in management process and make corresponding improvement measures.

시공사 수행도 평가모형(KPM)의 적용성에 대한 사례연구

이명한 부경대학교 대학원 2008 국내석사

There are numerous studies about project performance evaluation of contractor. whether contractor is going in the right direction or not in an undertaking project, it is necessary to evaluate their performance on site. Owner’s satisfaction will be affected by the quality of service delivery and quality of constructed facility. Merely handing over a project of high quality might not be sufficient. Process of service quality and performance during construction works are also considered. Hence, this study will establish different performance criteria to evaluate the contractor company on-site in construction projects. So, the purpose of this study is to verify the application of performance model[Key Performance Measuring Model(KPM)] developed in the previous study. Key Performance Measuring Model(KPM) has the 12 prone performance measurement factor(12 KPPFs) including 53 Performance Predictive Indicators(PPI)]cc To verify the application of KPM, it was tested in the 15 construction sites of 5 major contractors, the results from this study was as follows. It is proofed that the application of KPM was suitable measures to maintain or improve the project performance on sites. the values of performance of contractors lies between 71∼74 with regardless of contractors. KPPF4(Schedule) was well managed in the most of contractors, and KPPF1(Work progress&smooth) and KPPF7(Innovative contractor) were poorly managed relatively because of increasing costs and causing of popular complaints. It is believed that using KPFs developed by this study, an interested owner could measure the performance of its contractor company on site and could apply suitable measures to maintain or improve the project performance. And also, a Contractor Company could measure its own performance on site and take proactive or correction measures if the performance is found below than standard level.

Quantitative performance measurement for construction R&D projects through a multi-attribute performance indices and data envelopment analysis

박상혁 Graduate School, Yonsei University 2008 국내박사

점차 대형화되고 있는 건설R&D과제의 객관적인 평가자료와 지속적인 건설R&D예산을 확보하기 위해서는 정량적인 성과자료가 필요하다. 본 연구에서는 건설R&D사업 성과평가의 중요성을 인식하고 기존 평가방식에 대한 문제점을 극복하기 위한 성과측정방법론을 제시하고 실제 사례를 통해 측정결과를 산출하였다.성과측정지료를 활용한 방법은 정량적인 성과측정을 위한 40개의 성과측정지표를 도출하고 성과측정모델을 개발하여 이를 통한 355건의 건설R&D사업의 성과를 측정하였다. 본 연구에서 개발한 모델에 의한 측정결과는 실제 결과를 비교하여 기존 평가방식에서 발생 가능한 오류를 보완할 수 있다. ANOVA분석은 연구유형에 따라 평가결과를 달리 적용해야 함을 확인하여 기존의 획일적인 성과평가방식이 문제 있음을 검증하였다. 또한 연구유형에 따른 성과는 연구수행 주체에 따라 그 성과가 발현에 특성이 있음을 대응일치분석을 통해 확인하였다.효율성분석은 산출물 중심의 평가결과를 보완하기 위해 과제규모(비용, 참여인원)를 고려한 성과측정 결과이다. 측정대상은 40개 성과측정지표의 성과영역에서 지식축적 분야의 성과측정지표를 이용하여 산출요소로 활용하였다. 측정결과는 건설R&D사업을 수행하는데 있어 성과발현을 위한 기준을 제시하였다.본 논문에서 제시하는 성과측정 방법은 건설R&D사업의 객관적이고 합리적인 성과평가를 위해 기초자료를 제공할 수 있으며 성과향상을 위한 가이드라인을 제시했다는 점에서 의의가 있다. 또한 성과측정결과는 선정평가와 최종평가 등 기존의 평가절차에서 부족하였던 평가위원의 사전검토 단계에서 참고자료로 활용이 가능하다.연구결과는 건설프로젝트를 수행하고 있는 의사결정자에게 현재 진행 중이거나 종료한 프로젝트에 정량적인 성과결과를 제공하며 추후 추진할 건설프로젝트에는 성과를 예측하는데 도움이 될 것이다. In order to obtain objective evaluation data for construction R&D projects that are becoming larger in scale and are acquiring continuous construction R&D budgets, quantitative performance evaluation is needed. In this paper, the importance of construction R&D project performance evaluation is recognized. A performance measurement method is presented in order to overcome the problems of existing evaluation methods, and measurement results are derived through actual cases.The method using the performance measurement data derived 40 performance measurement indices for quantitative performance measurements, and developed a performance measurement model. Using the model, we measured the performances of 355 construction R&D projects. The measurement results achieved through the model developed in this study can compare actual results and supplement errors that could possibly occur in existing evaluation methods. The ANOVA analysis confirmed that evaluation results must be applied differently according to research types, and verified that there is a problem with the existing uniform performance evaluation method. It was also confirmed through correspondence analysis that the results of research types showed different manifestations according to the subject being researched. Efficiency analysis is the result of measuring performance that takes into account project size (cost and participating members) in order to supplement the production-centered evaluation results. From the performances of 40 performance measurement indices, the performance measurement indices of the knowledge accumulation field were selected as elements to be measured. The measurement results presented a standard for performance manifestation in carrying out construction R&D projects.The performance measurement method proposed in this paper is meaningful in that it can provide basic data for objective and rational performance evaluation of construction R&D projects, and suggested a guideline for improving performance. The results of performance measurements can also be used as reference material at the evaluation committee’s preliminary investigation stage for such activities as selection evaluation and final evaluation that have been insufficiently dealt with in the existing evaluation process. Future studies should focus on evaluating the research outcome and impact, which shows true, long-term research performance. Effort also must be under taken to understand how these proposed method-based evaluation results can be connected to the governmental research budgeting process.

(A) Balanced Performance Measurement Model for Office Building Facility Management

신현지 서울대학교 대학원 2020 국내박사

Facility management is gaining more importance as office building becomes high-rise and large, its facilities and systems get more sophisticated, and performance requirements on office building increase. As financial market evolves, office building has been recognized as one of the preferred alternative assets, and the importance of facility management has been increasingly emphasized due to its mission to fulfill the expectations and requirements of tenants on environment and services office building provides under financial constraints imposed by building owner, usually a financial investor in case of commercial office building. Furthermore, facility management has expanded to the core business area that affects the profits of office building. Performance measurement of office building facility management should consider the conflicts generated from the different objectives of building owner as investor and tenant as user as well as the characteristics of building as physical property. Thus, it requires the use of a balanced, holistic, and multi-faceted performance measurement model covering various perspectives. The author derived five performance factors that comprise Financial, Function, Organization, Safety-Health-Environment, and Satisfaction. They represent the perspectives of building owner and tenants, and reflect the role of facility management organization that drives the facility management performance as well as the characteristics of the facility management activities. The author found that prioritization of five factors can be different depending on building grade and investigated the relationship of five factors. As a result, five factors cycle structure is presented, which can progressively improve facility management performance by resolving the conflicts that exist amongst the stakeholders. To derive Key Performance Indicators (“KPIs”) for measuring the performance of five factors, a Delphi survey was conducted. The Delphi panels were composed of facility management experts and building owners. Thirty KPIs commonly recognized as important by both groups were identified. The author developed FFOSS model that measures office building facility management performance, based on the thirty KPIs which were categorized into five performance factors. FFOSS model is a balanced and full-fledged performance measurement model that covers various facets of facility management and presents a cycle structure amongst the five factors. The cost-effective expenditure made to the facilities of building is evaluated as important financial performance, which is a salient feature of this model distinguishing it from existing model. Investment made by building owner on building’s function and facility management organization leads to improved performance of the building’s physical facilities, and together with rising capability of the organization, it enhances Safety-Health-Environment performance. Then, tenant satisfaction rises, and eventually a better financial performance is achieved through rising rents paid by satisfied tenants. FFOSS model provides a balanced evaluation framework to office building owners and can be used by customizing five factors’ weightings. Weighting of five factors is a strategic method of tailored performance evaluation that can reflect the varying characteristics by building grades. The author proposes Financial and Function priority strategy as a standard for general building and Satisfaction and Safety priority strategy for prime grade office building. It also allows building owners to effectively communicate their objectives and intentions to facility management organization. The author verified the applicability, adequacy and effectiveness of FFOSS model through experts’ evaluation. The evaluation scores showed the validity of model. In order to increase the objectivity, a comparison model was also selected and evaluated at the same time. But it failed to show as much validity as FFOSS model as it obtained low evaluation score and was assessed to have poor applicability. Also, the performance measurement of facility management of six office buildings was conducted with FFOSS model. The measurement score for each building was verified as valid, representing the current overall facility management performance in view of the grade of building. 퍼실리티 매니지먼트 (Facility management)는 건축물이 고층, 대형화되고 설비와 시스템이 정교해지며, 성능에 대한 요구사항이 증대됨에 따라 중요도가 높아지고 있다. 금융시장의 발전에 따라 오피스빌딩은 투자자산으로서 선호되고 있으며, 퍼실리티 매니지먼트는 상업용 오피스빌딩의 투자 수익을 좌우하는 핵심적인 비즈니스 영역으로 확장되었다. 이에 투자자의 수익을 위한 재정적인 제약 가운데에서 사용자인 기업 테넌트 (Tenant)의 업무 환경과 서비스에 대한 다양한 필요와 기대를 충족시켜야 하므로 그 역할이 더욱 강조되고 있다. 오피스빌딩 퍼실리티 매니지먼트의 성과 측정은 건축물로서의 물리적인 특성을 반영하고, 퍼실리티 매니지먼트 역할과 책임의 넓은 범위를 포괄하며, 소유자인 투자자의 특성과 사용자인 기업 테넌트의 이해 충돌을 인정하는 균형 잡힌 성과 측정 모델의 사용이 요구된다. 저자는 오피스빌딩 퍼실리티 매니지먼트 조직에 요구되는 다양한 성과의 영역을 구분하는 5개 인자 (Factor)를 도출하고, 그 우선순위와 상호 관계를 규명하여, 5개 인자의 순환 구조에 기반한 성과 측정 모델을 개발하였다. 퍼실리티 매니지먼트 성과의 5개 인자는 재정 (Financial), 기능 (Function), 조직 (Organization), 안전-건강-환경 (Safety-Health-Environment), 만족 (Satisfaction)으로 도출되었다. 이는 성과 평가 주체인 빌딩 소유자 및 사용자인 테넌트의 관점과 함께, 성과를 이끌어내는 퍼실리티 매니지먼트 조직의 역할과 업무의 특성을 반영한 것이다. 빌딩 소유자는 빌딩 비용의 절감을 통하여 재정적 성과를 극대화하고자 한다. 그러나 오피스빌딩은 지속적인 유지관리 노력과 비용이 투입되지 않으면 노후화가 빠르게 진행되는 건축물로서의 물리적 특성을 갖고 있기 때문에, 이러한 접근은 테넌트의 만족도를 저해하여 오히려 수익을 손상시킬 수 있다. 이에 본 저자는 빌딩의 수익 증대에 기여하는 유지관리 비용의 효용적 지출을 퍼실리티 매니지먼트의 중요한 성과로 평가함으로서, 균형 잡힌 재정적 성과 평가의 관점을 제시하였다. 빌딩 소유자의 빌딩 기능과 퍼실리티 매니지먼트 조직 역량에 대한 적절한 재정적 투자가 빌딩의 기능을 향상시키고, 테넌트가 필요로 하는 안전-건강-환경 성과를 제고한다. 이러한 성과를 바탕으로 테넌트 만족이 증진될 수 있으며, 만족한 테넌트가 지불하는 임대료를 통하여 빌딩 소유자가 추구하는 재정적 성과가 성취된다. 이러한 순환은 빌딩 오너와 테넌트의 이해 충돌을 발전적으로 해소하면서 퍼실리티 매니지먼트 성과를 총체적으로 증진한다. 또한 저자는 퍼실리티 매니지먼트 5개 인자의 성과를 가장 효과적으로 측정하는 주요 성과 지표들 (Key performance indicators)을 도출하여 성과 측정 모델을 완성하였다. 전문가 델파이 그룹을 빌딩 소유자 측 전문가 7인과 빌딩 퍼실리티 매니지먼트 조직 팀장급 7인으로 구성하여, 3차에 걸친 설문을 통하여 빌딩 소유자와 퍼실리티 매니지먼트 조직이 모두 중요성을 인정한 주요 성과 지표 30개를 규명하여 성과 측정 기준과 함께 제시하였다. FFOSS모델은 각 인자들의 우선순위와 평가 비중을 평가자가 직접 설정할 수 있으며, 저자는 오피스 빌딩 등급의 특성을 반영한 두 가지의 평가 전략을 제시하였다. 재정과 기능을 우선시하여 높은 비중으로 평가하는 일반 등급 빌딩을 위한 표준 전략과 함께, 테넌트 만족과 안전을 우선시하는 프라임 등급 빌딩을 위한 전략이 제시되었다. 평가 비중의 설정을 통해 빌딩 소유자는 빌딩 운영 우선순위를 퍼실리티 매니지먼트 조직에 효과적으로 전달할 수 있다. FFOSS 모델의 5개 인자와 30개 주요 성과 지표를 사용한 성과 측정은 저성과의 요인을 지적하는 동시에 해당 저성과의 영향 범위가 제한적인지 아니면 광범위한지를 알려 준다. 따라서 빌딩 소유자가 한정된 자원을 성과 개선에 효과적으로 배분하기 위한 의사 결정 도구로서도 효과적이다. 모델의 검증을 위하여 선행연구들 중 완성도가 가장 높은 비교모델을 선정하여 빌딩 소유자 측 전문가들을 통하여 두 모델을 동일한 기준으로 평가하도록 하였다. 평가 결과 FFOSS 모델의 적용성, 적정성, 효과성이 모두 우수함이 입증되었으며. 비교모델보다 높은 평가 점수로 상대적인 우수성도 입증되었다. 또한 6개 오피스빌딩 퍼실리티 매니지먼트의 성과를 두 모델을 사용하여 측정하도록 하였으며, 비교모델은 실제로 평가가 불가한 지표들이 많아서 종합 점수가 산출되지 못하였다. 그러나 FFOSS 모델은 모든 빌딩들에서 종합 점수가 산출되었으며, 해당 빌딩의 등급과 상태를 감안할 때 현행 성과에 부합하는 점수임에, 실제로 성과 측정과 적용이 우수한 모델임이 입증되었다.