공공부문 EA 성과평가 지표 설정 및 적용방안 연구

이석균 숭실대학교 대학원 2009 국내박사

Evaluating Criteria for Green Port Performance in China : A Study incorporating Delphi, AHP and IPA Matrix Methods

진탁 성균관대학교 일반대학원 2016 국내박사

This is a study on China’s green port performance incorporating the Delphi, AHP and IPA methods. The ‘green port’ concept has been gaining significant attention worldwide. Diverse approaches have been made increasingly from both the green practices of the port industry and a wide range of studies from academicians. Accordingly, a great many ports, regional and international organizations have made various guidelines for green port performance, while the emphases on green performance have changed over time as well. As a country with the biggest number of top ports in terms of container volume, it is of great significance for China to do a thorough and effective green performance both for the global environment and Chinese government’s green goal incorporated in the national “Five-year-plan”. However, China has never been considered to be a “role model” for a green port performance due to the lack of a set of clear and practical criteria for a green port performance and the limited range of its green practices. Given the fact that China has a special and unique port management system, it is very necessary to create applicable green performance indicators for Chinese ports and to indicate the priorities of China’s green port performances. Since no port could possibly have unlimited resources for green performance, a great many ports have started to seek a sustainable development with high efficiency. The green practices of global ports were reviewed for practical references and a great many previous studies made both domestic and abroad were examined as well for a theoretical framework. This study attempts to create a set of applicable and practical green port performance indicators and prioritize the green indicators to see each port’s performance level. Also, this study indicates each port’s green port performance efficiency as well. Shanghai Port, Qingdao Port and Ningbo Port were selected as the targeted ports for their geographic location, top level of container volume and their strategic position in future developments. This study, therefore, constructed an expert panel for three rounds of Delphi surveys and eventually extracted a set of green criteria for Chinese port performance. Based on the results of the Delphi, all green indicators were prioritized on three levels, i.e. the global level of all green dimensions, the local level of all sub-criteria under each dimension and all green sub-criteria overall levels. On each level the relative weights were estimated from two aspects i.e. the overall level and by port. In the end, with the important degree of perception obtained from the 3rd round Delphi and the performance level from the results of AHP, the relative degree of importance perception and performance level were measured to indicate the green port performance’s efficiency. The Delphi results clearly show that the green performance in Chinese ports has great consistency with government’s major policies, i.e. focuses on the CO2 emissions and energy saving, which is highly consistent with and greatly resulted from the port management system in China. This study, furthermore, found that in the AHP, firstly, green port performance in China is not quite as community-concerned and motivated as other global ports such as Rotterdam Port, Sydney Port, etc. Secondly, in China, a port’s geographic location and type of hinterland economy significantly influences a port’s priority regarding its port performance. Thirdly, two types of focuses were clearly observed in Chinese ports’ green performances, i.e. government’s policies and indicators could be easily seen, heard or felt, such as noise control, dust control and energy-saving criteria. The overall IPA result shows that the ports’ green performances in China are staying at a relatively low efficiency since the indicators falling in the quadrant with a high degree of perception and low degree of performance are consequently much more than the quadrant with possible over performance. As regards to each port’s green efficiency, Shanghai Port has the best performance efficiency compared to the other two; while Qingdao Port has the most indicators requiring immediate improvement and resource reallocation. Based on the set of green indices extracted from this study and the priorities of green port performance estimated by the AHP, implications could be drawn on two aspects: both the policy maker and the port authorities, for more effective and efficient policies. Firstly, the central government and local governments should be completely aware of the features of the green performance in China, and that they are strongly national policy-oriented and cost-saving oriented. In the future policy making process, the government should take sufficient consideration to guiding the ports to be more global market-oriented and community-concerned motivated. Secondly, the government could launch a clear and official green port evaluation system based on the criteria extracted from the reliable Delphi surveys made by experts from diverse affiliations. With the clear evaluation system, the government would be able to annually rank the ports in China to practically motivate the ports for better green performances. With the clear and applicable green port evaluating indicators, the port authorities would be able to make concessional rate policies and penalty policies for their “green” suppliers and customers, which is exactly what other global ports are doing. Furthermore, based on the IPA results, port authorities could possibly reallocate some of their resources in the fields where the indicators require immediate and vast improvement. Instead of only “taking orders”, port authorities should proactively participate in further international collaboration and at the same time, still be more competitive. This study greatly contributes to a set of green indices for Chinese ports based on three rounds of expert surveys targeted on three representative ports. It is of relative significance to keep the green evaluation indicators upgraded and tracking on the green port performance, which requires sufficient time and labor, wide social connections and tremendous funding. It would be extremely difficult for scholars to conduct this kind of large scale country wide project. Hopefully, this study will call for interest from the research institutes and/or the government for further in-depth studies not only on upgrading the green port performance indicators but also prioritizing the performance criteria to reveal the focuses and the green performance efficiency on the overall level.

Genetic and Phenotypic Indicator Traits for Reproductive Performance in Commercial Sows

Pereira Sanglard, Leticia Maria Iowa State University ProQuest Dissertations & The 2021 해외박사(DDOD)

The objective of this dissertation was to study potential indicator traits for reproductive performance in sows, including testis size, response (antibody and vaginal microbiome) to Porcine Reproductive and Respiratory Syndrome virus (PRRSV), and antibody response to other common infectious pathogens in swine (Mycoplasma hyopneumoniae, MH; swine Influenza A virus, IAV; porcine circovirus type 2, PCV2; and Actinobacillus pleropneumoniae, APP). To determine the effectiveness of measuring testis size in the sires to identify sows with superior reproduction, 161 Yorkshire and Landrace boars were measured for testis width and area, and 384 sows (daughters of 13 of the boars) had farrowing performance recorded. The heritability of testis size traits was high (~0.67). Larger testis width was associated with greater litter size without increasing piglet mortality. These results indicate the possibility of a phenotypic assessment of testis size in sires as a useful tool to cull boars for breeding, improving female performance and the possibility of indirect early selection for female reproductive performance traits in boars. The genetic basis of response to PRRSV vaccination, measured as sample-to-positive (S/P) ratio, was investigated. A total of 906 gilts had blood samples collected at ~50 days after a PRRSV vaccination. From those, 302 gilts had vaginal microbiome data collected at 4 and 52 days after the PRRSV vaccination, and 807 sows had farrowing performance collected. Heritability estimates of the relative abundance of the microbes varied from low to high (~0–0.60), and genomic regions were identified that were associated with several microbes, including a potential pleiotropic region on chromosome 12. Estimates of microbiability (i.e., the proportion of the phenotypic variance explained by the microbiome) for reproductive performance and antibody response to PRRSV were, in general, low (< 0.15). However, the discriminant analyses revealed that the vaginal microbiota was able to classify gilts into groups of high and low antibody responders to PRRSV vaccination with a misclassification rate of less than 2%. Further, we identified eighteen microbes that were differentially abundant between the low and high reproductive performance sows. The discriminant analyses revealed that the vaginal microbiota was able to classify gilts into groups of high and low reproductive performance with a misclassification rate of less than 12%. Among the microbes that overlapped between these two analyses, Campylobacter, Bacteroides, Porphyromonas, Lachnospiraceae_unclassified, Prevotella, and Phascolarctobacterium are potential biomarkers for reproductive outcomes. In the same project, we investigated the genetic basis of antibody response to PRRSV vaccination, measured as sample-to-positive ratio (S/PVx), as a potential genetic indicator for reproductive performance in commercial sows. Estimates of heritability (~0.38) and genomic prediction accuracy (~0.60) were high. Based on a SNP-based and haplotype-based genome-wide association studies, we identified a major SNP on chromosome 7 with large effects on S/PVx along with several haplotypes on chromosomes 4, 7, and 9 associated with S/PVx. The SNP and haplotype on chromosome 7 were located in the Major Histocompatibility Complex (MHC). In addition, genomic regions with high levels of homozygosity or heterozygosity were associated with S/PVx. Also, S/PVx was favorably genetically correlated with reproductive performance in vaccinated commercial sows and non-infected purebred sows. For example, the genetic correlation of S/PVx with the number of piglets born alive was 0.61 and 0.50 in commercial and purebred sows, respectively. These results suggest that S/PVx could be used as an accurate and efficient genetic indicator to improve reproductive performance. We estimated the genetic correlation of S/PVx with antibody response following a natural PRRSV outbreak (S/POutbreak) to be 0.72, which shows that these two traits are under similar genetic control. In another project, antibody response to IAV, MH, PCV2, and APP were collected for ~2,300 sows in four time-points: at entry into a commercial sow farm, after post-acclimation, during parity 1, and during parity 2. Reproductive data from 1 to 4 parities were available on a subset of 2,000 sows. In general, the heritability estimates were low to moderate, depending on the pathogen and the time of antibody response. Estimates of heritability for antibody response to APP, IAV, MH, and PCV2 ranged from 0 to 0.76. The region on chromosome 14 (2 Mb) was associated with several serotypes of APP, explaining up to 4.3% of the genetic variance. In general, genomic prediction accuracies for antibody response were low to moderate. Estimates of genetic correlation of antibody response to infectious pathogens with lifetime reproductive traits varied with time of antibody collection. Estimates of genetic correlation of antibody responses to PRRSV and MH were mostly negative with lifetime performance, ranging from -0.85 to 0.70. Estimates of genetic correlation of antibody responses to PCV2 and APP MEAN were constantly positive with all reproductive traits, ranging from 0.03 to 0.97. In summary, there was a substantial genetic correlation of antibody response to infectious pathogens with reproductive performance depending on the time of antibody collection. It is worth to investigate this relationship at specific time-points after vaccination or infection as an alternative to select for resilience in commercial sows. In conclusion, we have identified several traits with the potential to be used for culling proposes (e.g., testis size and vaginal microbiome) and genetic selection (e.g., antibody response to PRRSV vaccination and to several other infectious pathogens). Several biomarkers associated with these traits were identified and could be used to improve farrowing performance phenotypically and genetically.

경영평가 수익성 지표의 가중치가 공기업 재무성과에 미치는 영향

전정원 서울대학교 대학원 2021 국내석사

정부는 공기업의 비효율성을 해소하기 위해 다양한 정책들을 시행하여왔으며, 이 중 대표적인 정책이 경영평가제도이다. 경영평가제도는 지난 1984년 공기업의 경영목표를 명확하게 하여 공기업으로 하여금 ‘공공성’과 ‘수익성’간의 조화로운 추구를 시도하게 하며, 지대추구 행위 등 비효율성을 발생시킬 수 있는 행위에 대한 제재 및 더 나아가 공기업의 적극적인 경제행위를 촉구하기 위한 체계적인 관리·감독을 위해 도입되었다. 경영평가의 지표는 해당 공기업의 경영목표와 방향을 제시하는 역할을 함으로써, 정부가 공기업의 자율경영 체제를 보장하면서도 추구해야 할 구체적인 목표를 공기업에 투입할 수 있는 통로를 제공하는 역할을 한다. 정부는 평가 지표를 매년 수정․변경함으로써 공기업으로 하여금 새로운 경영목표를 설정하고 경영환경 변화에 탄력적으로 대응할 수 있게 하고자 한다. 본 연구에서는 최근 정부의 정책 변경에 따른 ‘수익성’ 지표 가중치의 변화에 주목하여, 경영평가 지표구성에 있어 ‘수익성’ 지표의 가중치 변화가 공기업의 재무성과에 미치는 영향을 실증 분석하였다. 특히 경영평가지표의 변경 중 ‘수익성’ 가중치의 변경이 실제 공기업의 재무성과에 어떠한 변화를 가져오는지 살펴봄으로써 평가지표 가중치 변경이 정책 목표 달성에 미치는 영향력에 대한 시사점을 도출하고자 하였다. 2015년부터 2019년까지 35개 공기업을 연구 분석 대상으로 하여 독립변수를 경영평가 수익성 지표의 가중치로 설정하고, 종속변수는 대표적 재무성과 지표인 부채규모, 노동생산성, 총자산순이익률, 영업이익, 경상이익, 관리업무비비율로 설정하였다. 통제변수로는 공기업의 재무성과에 영향을 미치는 요소들로 익히 알려진 경제성장률, 기관의 연령, 기관규모(자산, 인원)을 설정하였으며, 시장형/준시장형의 공기업 유형, 상장 여부, 요금규제 여부를 더미변수로 추가하였다. 분석 결과 경영평가의 수익성 지표의 가중치의 변화는 공기업의 영업이익/경상이익에는 정(+)의 영향을 미치는 것으로 나타난 반면, 공기업의 부채규모/노동생산성/총자산순이익률/매출액대비 관리업무비비율에는 영향을 미치지 않는 것으로 밝혀졌다. 본 연구는 경영평가 도입 이후 경영평가제도가 지속적으로 재무적인 경영실적 개선을 이끌어내고 있는지 특히 “평가지표의 구성이 공공기관이 경영실적의 지속적 개선에 실질적인 영향력을 미치는가”에 대한 검증의 일부로서의 그 의의가 있다 할 수 있으나, 분석 결과는 경영평가지표의 세부항목별 구성 및 가중치 부여로 공공기관의 재무성과의 개선을 유도하는 것은 대체적으로 유의미하지 않거나 혹은 정부가 기대하는 것과는 다른 방향으로 작동하고 있음을 나타내었다. 따라서 경영평가제도를 통한 공기업 재무성과 개선을 위해서는 경영평가지표의 설정에 있어 공기업의 수익성 측정 지표 선정 및 가중치의 적정성과 관련하여 그 효과성을 고려한 추가적인 고찰이 필요한 것으로 보인다. 마지막으로 본 연구는 연구대상이 협소하여 연구 결과의 일반화에 한계가 있을 수 있으며, 종속변수에 따라 다르게 나타난 연구 결과에 대한 논리적 인과관계 및 원인에 대한 분석이 이루어지지 못한 한계점을 보유하고 있다. 특히, 경영평가지표 개선과 이를 경영목표로 하여 공기업 내부 프로세스의 개선 등 일련의 경영활동이 재무성과의 변화를 이끌어내는 과정에 소요되는 시차 및 경로에 대한 고려가 이루어질 경우 평가 지표의 선정, 내용 및 가중치 등의 구성에 대한 전반적인 개선점을 도출하는 기여할 수 있을 것이라 여겨진다. The Korean government has introduced various policies to increase the efficiency of public enterprises. One representative policy is the management and performance assessment system that was introduced in 1984 to clarify the management goals of public enterprises and allow them to attempt a harmonious pursuit of both 'publicity' and 'profitability'. Proponents argue that these assessments allow for systematic management and supervision that reduce inefficient behaviors, such as rent seeking. The indicators of management and performance assessment system play a role in presenting the management goals and directions of the public enterprises, providing a channel for the government to insert specific goals while guaranteeing an autonomous management system. The assessment indicators are revised annually in accordance with the government's policy changes related to public enterprises. The assumption is that these annual revisions urge public enterprises to respond to changes in the management environment by setting new management goals. This study analyzes how changes in the weight of 'profitability' assessment indicators are related to financial performance of public enterprises. In short, the study asks whether and how the weight of ‘profitability’ indicators are related to the financial performance of public enterprises. Using 2015-2019 data of 35 public enterprises in Korea, regression models with the weights of profitability indicators for management and performance assessment as independent variables and financial performance measures as dependent variables (i.e. debt size, labor productivity, net income to total asset ratio, operating profit, ordinary profit and general administrative cost ratio) were built. Control variables include economic growth rate, age of the enterprises, size of the institution (asset and person), types of public enterprises (market or quasi-market), listing status, and charge regulation status. The results show that changes in the weight of profitability indicators in management and performance assessments do not affect the debt size, labor productivity, net income to total asset ratio, general administrative cost ratio of public enterprises, whereas they have a positive and statistically significant effect on operating profit and ordinary profit. This study contributes to the verification of whether the management performance assessment system has continued to improve financial performance since the introduction of management assessment, particularly on whether "the composition of assessment indicators has a substantial impact on continuous improvement of performance of public enterprises." The results show that profitability indicators do not have significant effects on financial performance or have different effects from what the government expects. Therefore, in order to improve the financial performance of public enterprises through the management and performance assessment system, it seems that a reexamination of profitability measurement indicators and the appropriateness of their weights are necessary. Some limitations of this study are as follows. First, there may be limits to generalizing the findings of this research due to its narrow scope of subjects. Second, the study does not analyze for logical causality and cannot explain why there are different results depending on the choice of dependent variables. Future studies should include a comprehensive analysis on the time lag and logic channel for the series of management activities, such as improvement of management indicators, the change of management goals, the improvement of internal processes for achieving the changed objectives, and the change of performance after the improvement of assessment indicators.

The Effects of various factors in particulate matter projects on related budget allocations : the case of Republic of Korea

엄소영 KDI School of Public Policy and Management 2020 국내석사

Even though the Korean government directs the majority of the funds allocated to solving poor air quality into projects related to transportation on the road, why is the performance of these projects not as good as other projects? To answer this question, this paper explores the impact of various factors on the budget of particulate matter in Korea by using a panel data analysis tool, the pooled OLS. After examining the relationship between factors and budget allocation in particulate matter projects, this research examined various features of projects with larger budget allocation. This paper focused on the performance indicator used in managing projects, the field, and the characteristic of projects through the ANOVA and Chi-square analysis. As a result, field factors can affect the budget of particulate matter response projects. This paper also found that there are relationships between field factors and performance indicator factors. Specifically, the transportation_road project which showed low performance with rich financial sources mainly used output indicators. On the other hand, industry projects which had a good performance result in reducing particulate matter emission with a small budget used both output and outcome indicators, not focusing on only output indicator. This gives implications for performance management and for budget allocation with performance information. Simultaneously, this paper showed that the performance achievement rate used by the government in the evaluation of each project did not relate to the budget. This foundation means that the performance evaluation tool the government used was not so effective. The Korean government needs to improve performance management and evaluation, thus encouraging use of outcome performance indicators could better align with desired goals. This research had limitations in gathering performance results from a whole field approach, not from each project. The limitation is natural given that tracking real performance results from each and every individual project is beyond the reach of any government. To verify the cause and effect between performance indicators and real results, further studies are needed to give more detailed implications to governments.

시공사 수행도 평가모형(KPM)의 적용성에 대한 사례연구

이명한 부경대학교 대학원 2008 국내석사

There are numerous studies about project performance evaluation of contractor. whether contractor is going in the right direction or not in an undertaking project, it is necessary to evaluate their performance on site. Owner’s satisfaction will be affected by the quality of service delivery and quality of constructed facility. Merely handing over a project of high quality might not be sufficient. Process of service quality and performance during construction works are also considered. Hence, this study will establish different performance criteria to evaluate the contractor company on-site in construction projects. So, the purpose of this study is to verify the application of performance model[Key Performance Measuring Model(KPM)] developed in the previous study. Key Performance Measuring Model(KPM) has the 12 prone performance measurement factor(12 KPPFs) including 53 Performance Predictive Indicators(PPI)]cc To verify the application of KPM, it was tested in the 15 construction sites of 5 major contractors, the results from this study was as follows. It is proofed that the application of KPM was suitable measures to maintain or improve the project performance on sites. the values of performance of contractors lies between 71∼74 with regardless of contractors. KPPF4(Schedule) was well managed in the most of contractors, and KPPF1(Work progress&smooth) and KPPF7(Innovative contractor) were poorly managed relatively because of increasing costs and causing of popular complaints. It is believed that using KPFs developed by this study, an interested owner could measure the performance of its contractor company on site and could apply suitable measures to maintain or improve the project performance. And also, a Contractor Company could measure its own performance on site and take proactive or correction measures if the performance is found below than standard level.

Performance Evaluation of the Chinese Real Estate Developer’s Quality Management

당연니 서울대학교 대학원 2017 국내석사

In recent years, the real estate industry in a rapid development, but at the same time, a lot of capital investment still has not change back to quality improvement, the complaints about building quality in the real estate industry accounted for the first in China. Real estate project quality accident continue to occur. In fact, the real estate developers to strengthen quality management can significantly improve the project quality, but now the problem is lack of related practice and theory about quality management evaluation for real estate developers. In order to evaluate developer’s current quality management level accurately, and find out the deficiencies for targeted improvement, this paper attempts to establish a reasonable and effective evaluation indicator system on developer’s quality evaluation, so as to ultimately improve the quality management performance of developers. The developer’s responsibility of quality management in existing legal norms, and the research and best practice on developer’s effective measures of quality management at home and abroad are the basis foundation of developer’s quality management evaluation. This paper summarized the responsibility and effective measures of the quality management of the developers through a lot of literature research also and summarized the general process and main contents of the quality management of real estate developers, then summed up the main points of developer’s quality management. This prepared a theoretical basis. for developer’s quality management performance evaluation. Based on the above content, developers’ quality management can be divided into two main parts. The first part is developer’s self-management in the early stage of project when the other project participants like designer and contractors has not involved in. After entering the design survey stage, with the participation of designer, contractor and supervisor, the main responsibility of developer became to participant’s management. Therefore, this paper starts from the two aspects of the developer's own management and the participant’s management established and indicator system, which contained 2 first-level indicators, 8 second-level indicators, 17 third-level indicators. Afterwards, this research used the questionnaire survey and Analytic Hierarchy Process (AHP) to assign the weight of the indictors. Finally, the developer could understand own quality management through the Quality Management Performance Evaluation Indictors System established in this research, and basis on the evaluation results could find out the shortcomings in management process and make corresponding improvement measures.

Quantitative performance measurement for construction R&D projects through a multi-attribute performance indices and data envelopment analysis

박상혁 Graduate School, Yonsei University 2008 국내박사

점차 대형화되고 있는 건설R&D과제의 객관적인 평가자료와 지속적인 건설R&D예산을 확보하기 위해서는 정량적인 성과자료가 필요하다. 본 연구에서는 건설R&D사업 성과평가의 중요성을 인식하고 기존 평가방식에 대한 문제점을 극복하기 위한 성과측정방법론을 제시하고 실제 사례를 통해 측정결과를 산출하였다.성과측정지료를 활용한 방법은 정량적인 성과측정을 위한 40개의 성과측정지표를 도출하고 성과측정모델을 개발하여 이를 통한 355건의 건설R&D사업의 성과를 측정하였다. 본 연구에서 개발한 모델에 의한 측정결과는 실제 결과를 비교하여 기존 평가방식에서 발생 가능한 오류를 보완할 수 있다. ANOVA분석은 연구유형에 따라 평가결과를 달리 적용해야 함을 확인하여 기존의 획일적인 성과평가방식이 문제 있음을 검증하였다. 또한 연구유형에 따른 성과는 연구수행 주체에 따라 그 성과가 발현에 특성이 있음을 대응일치분석을 통해 확인하였다.효율성분석은 산출물 중심의 평가결과를 보완하기 위해 과제규모(비용, 참여인원)를 고려한 성과측정 결과이다. 측정대상은 40개 성과측정지표의 성과영역에서 지식축적 분야의 성과측정지표를 이용하여 산출요소로 활용하였다. 측정결과는 건설R&D사업을 수행하는데 있어 성과발현을 위한 기준을 제시하였다.본 논문에서 제시하는 성과측정 방법은 건설R&D사업의 객관적이고 합리적인 성과평가를 위해 기초자료를 제공할 수 있으며 성과향상을 위한 가이드라인을 제시했다는 점에서 의의가 있다. 또한 성과측정결과는 선정평가와 최종평가 등 기존의 평가절차에서 부족하였던 평가위원의 사전검토 단계에서 참고자료로 활용이 가능하다.연구결과는 건설프로젝트를 수행하고 있는 의사결정자에게 현재 진행 중이거나 종료한 프로젝트에 정량적인 성과결과를 제공하며 추후 추진할 건설프로젝트에는 성과를 예측하는데 도움이 될 것이다. In order to obtain objective evaluation data for construction R&D projects that are becoming larger in scale and are acquiring continuous construction R&D budgets, quantitative performance evaluation is needed. In this paper, the importance of construction R&D project performance evaluation is recognized. A performance measurement method is presented in order to overcome the problems of existing evaluation methods, and measurement results are derived through actual cases.The method using the performance measurement data derived 40 performance measurement indices for quantitative performance measurements, and developed a performance measurement model. Using the model, we measured the performances of 355 construction R&D projects. The measurement results achieved through the model developed in this study can compare actual results and supplement errors that could possibly occur in existing evaluation methods. The ANOVA analysis confirmed that evaluation results must be applied differently according to research types, and verified that there is a problem with the existing uniform performance evaluation method. It was also confirmed through correspondence analysis that the results of research types showed different manifestations according to the subject being researched. Efficiency analysis is the result of measuring performance that takes into account project size (cost and participating members) in order to supplement the production-centered evaluation results. From the performances of 40 performance measurement indices, the performance measurement indices of the knowledge accumulation field were selected as elements to be measured. The measurement results presented a standard for performance manifestation in carrying out construction R&D projects.The performance measurement method proposed in this paper is meaningful in that it can provide basic data for objective and rational performance evaluation of construction R&D projects, and suggested a guideline for improving performance. The results of performance measurements can also be used as reference material at the evaluation committee’s preliminary investigation stage for such activities as selection evaluation and final evaluation that have been insufficiently dealt with in the existing evaluation process. Future studies should focus on evaluating the research outcome and impact, which shows true, long-term research performance. Effort also must be under taken to understand how these proposed method-based evaluation results can be connected to the governmental research budgeting process.

(A) Balanced Performance Measurement Model for Office Building Facility Management

신현지 서울대학교 대학원 2020 국내박사

Facility management is gaining more importance as office building becomes high-rise and large, its facilities and systems get more sophisticated, and performance requirements on office building increase. As financial market evolves, office building has been recognized as one of the preferred alternative assets, and the importance of facility management has been increasingly emphasized due to its mission to fulfill the expectations and requirements of tenants on environment and services office building provides under financial constraints imposed by building owner, usually a financial investor in case of commercial office building. Furthermore, facility management has expanded to the core business area that affects the profits of office building. Performance measurement of office building facility management should consider the conflicts generated from the different objectives of building owner as investor and tenant as user as well as the characteristics of building as physical property. Thus, it requires the use of a balanced, holistic, and multi-faceted performance measurement model covering various perspectives. The author derived five performance factors that comprise Financial, Function, Organization, Safety-Health-Environment, and Satisfaction. They represent the perspectives of building owner and tenants, and reflect the role of facility management organization that drives the facility management performance as well as the characteristics of the facility management activities. The author found that prioritization of five factors can be different depending on building grade and investigated the relationship of five factors. As a result, five factors cycle structure is presented, which can progressively improve facility management performance by resolving the conflicts that exist amongst the stakeholders. To derive Key Performance Indicators (“KPIs”) for measuring the performance of five factors, a Delphi survey was conducted. The Delphi panels were composed of facility management experts and building owners. Thirty KPIs commonly recognized as important by both groups were identified. The author developed FFOSS model that measures office building facility management performance, based on the thirty KPIs which were categorized into five performance factors. FFOSS model is a balanced and full-fledged performance measurement model that covers various facets of facility management and presents a cycle structure amongst the five factors. The cost-effective expenditure made to the facilities of building is evaluated as important financial performance, which is a salient feature of this model distinguishing it from existing model. Investment made by building owner on building’s function and facility management organization leads to improved performance of the building’s physical facilities, and together with rising capability of the organization, it enhances Safety-Health-Environment performance. Then, tenant satisfaction rises, and eventually a better financial performance is achieved through rising rents paid by satisfied tenants. FFOSS model provides a balanced evaluation framework to office building owners and can be used by customizing five factors’ weightings. Weighting of five factors is a strategic method of tailored performance evaluation that can reflect the varying characteristics by building grades. The author proposes Financial and Function priority strategy as a standard for general building and Satisfaction and Safety priority strategy for prime grade office building. It also allows building owners to effectively communicate their objectives and intentions to facility management organization. The author verified the applicability, adequacy and effectiveness of FFOSS model through experts’ evaluation. The evaluation scores showed the validity of model. In order to increase the objectivity, a comparison model was also selected and evaluated at the same time. But it failed to show as much validity as FFOSS model as it obtained low evaluation score and was assessed to have poor applicability. Also, the performance measurement of facility management of six office buildings was conducted with FFOSS model. The measurement score for each building was verified as valid, representing the current overall facility management performance in view of the grade of building. 퍼실리티 매니지먼트 (Facility management)는 건축물이 고층, 대형화되고 설비와 시스템이 정교해지며, 성능에 대한 요구사항이 증대됨에 따라 중요도가 높아지고 있다. 금융시장의 발전에 따라 오피스빌딩은 투자자산으로서 선호되고 있으며, 퍼실리티 매니지먼트는 상업용 오피스빌딩의 투자 수익을 좌우하는 핵심적인 비즈니스 영역으로 확장되었다. 이에 투자자의 수익을 위한 재정적인 제약 가운데에서 사용자인 기업 테넌트 (Tenant)의 업무 환경과 서비스에 대한 다양한 필요와 기대를 충족시켜야 하므로 그 역할이 더욱 강조되고 있다. 오피스빌딩 퍼실리티 매니지먼트의 성과 측정은 건축물로서의 물리적인 특성을 반영하고, 퍼실리티 매니지먼트 역할과 책임의 넓은 범위를 포괄하며, 소유자인 투자자의 특성과 사용자인 기업 테넌트의 이해 충돌을 인정하는 균형 잡힌 성과 측정 모델의 사용이 요구된다. 저자는 오피스빌딩 퍼실리티 매니지먼트 조직에 요구되는 다양한 성과의 영역을 구분하는 5개 인자 (Factor)를 도출하고, 그 우선순위와 상호 관계를 규명하여, 5개 인자의 순환 구조에 기반한 성과 측정 모델을 개발하였다. 퍼실리티 매니지먼트 성과의 5개 인자는 재정 (Financial), 기능 (Function), 조직 (Organization), 안전-건강-환경 (Safety-Health-Environment), 만족 (Satisfaction)으로 도출되었다. 이는 성과 평가 주체인 빌딩 소유자 및 사용자인 테넌트의 관점과 함께, 성과를 이끌어내는 퍼실리티 매니지먼트 조직의 역할과 업무의 특성을 반영한 것이다. 빌딩 소유자는 빌딩 비용의 절감을 통하여 재정적 성과를 극대화하고자 한다. 그러나 오피스빌딩은 지속적인 유지관리 노력과 비용이 투입되지 않으면 노후화가 빠르게 진행되는 건축물로서의 물리적 특성을 갖고 있기 때문에, 이러한 접근은 테넌트의 만족도를 저해하여 오히려 수익을 손상시킬 수 있다. 이에 본 저자는 빌딩의 수익 증대에 기여하는 유지관리 비용의 효용적 지출을 퍼실리티 매니지먼트의 중요한 성과로 평가함으로서, 균형 잡힌 재정적 성과 평가의 관점을 제시하였다. 빌딩 소유자의 빌딩 기능과 퍼실리티 매니지먼트 조직 역량에 대한 적절한 재정적 투자가 빌딩의 기능을 향상시키고, 테넌트가 필요로 하는 안전-건강-환경 성과를 제고한다. 이러한 성과를 바탕으로 테넌트 만족이 증진될 수 있으며, 만족한 테넌트가 지불하는 임대료를 통하여 빌딩 소유자가 추구하는 재정적 성과가 성취된다. 이러한 순환은 빌딩 오너와 테넌트의 이해 충돌을 발전적으로 해소하면서 퍼실리티 매니지먼트 성과를 총체적으로 증진한다. 또한 저자는 퍼실리티 매니지먼트 5개 인자의 성과를 가장 효과적으로 측정하는 주요 성과 지표들 (Key performance indicators)을 도출하여 성과 측정 모델을 완성하였다. 전문가 델파이 그룹을 빌딩 소유자 측 전문가 7인과 빌딩 퍼실리티 매니지먼트 조직 팀장급 7인으로 구성하여, 3차에 걸친 설문을 통하여 빌딩 소유자와 퍼실리티 매니지먼트 조직이 모두 중요성을 인정한 주요 성과 지표 30개를 규명하여 성과 측정 기준과 함께 제시하였다. FFOSS모델은 각 인자들의 우선순위와 평가 비중을 평가자가 직접 설정할 수 있으며, 저자는 오피스 빌딩 등급의 특성을 반영한 두 가지의 평가 전략을 제시하였다. 재정과 기능을 우선시하여 높은 비중으로 평가하는 일반 등급 빌딩을 위한 표준 전략과 함께, 테넌트 만족과 안전을 우선시하는 프라임 등급 빌딩을 위한 전략이 제시되었다. 평가 비중의 설정을 통해 빌딩 소유자는 빌딩 운영 우선순위를 퍼실리티 매니지먼트 조직에 효과적으로 전달할 수 있다. FFOSS 모델의 5개 인자와 30개 주요 성과 지표를 사용한 성과 측정은 저성과의 요인을 지적하는 동시에 해당 저성과의 영향 범위가 제한적인지 아니면 광범위한지를 알려 준다. 따라서 빌딩 소유자가 한정된 자원을 성과 개선에 효과적으로 배분하기 위한 의사 결정 도구로서도 효과적이다. 모델의 검증을 위하여 선행연구들 중 완성도가 가장 높은 비교모델을 선정하여 빌딩 소유자 측 전문가들을 통하여 두 모델을 동일한 기준으로 평가하도록 하였다. 평가 결과 FFOSS 모델의 적용성, 적정성, 효과성이 모두 우수함이 입증되었으며. 비교모델보다 높은 평가 점수로 상대적인 우수성도 입증되었다. 또한 6개 오피스빌딩 퍼실리티 매니지먼트의 성과를 두 모델을 사용하여 측정하도록 하였으며, 비교모델은 실제로 평가가 불가한 지표들이 많아서 종합 점수가 산출되지 못하였다. 그러나 FFOSS 모델은 모든 빌딩들에서 종합 점수가 산출되었으며, 해당 빌딩의 등급과 상태를 감안할 때 현행 성과에 부합하는 점수임에, 실제로 성과 측정과 적용이 우수한 모델임이 입증되었다.

Development and Evaluation of Performance Indicators for Seniors Welfare Center Foodservice Operations : Application of Balanced Score Card

Gang, Gyoungok 연세대학교 일반대학원 2017 국내박사

우리나라의 고령화는 서구 다른 나라들과 이웃 국가인 일본에 비해서도 유래가 없이 빠른 속도로 진행되고 있으며, 현재 65세 이상 노인이 인구의 13% 가량을 차지하며, 2026년에는 20%를 넘어설 것으로 예상되고 있다. 이런 사회의 변화에 따라 노인 복지시설 역시 많이 확충되었으며, 지속적인 고령화로 인한 노인인구의 증가에 따라 시설의 수요가 완만하게 증가될 것으로 예측되며, 특히 시설의 규모나 양보다는 서비스 내용 등의 시설 운영의 질적인 요소가 중요하게 작용하게 될 것이다. 이런 이유로 노인복지관에서 제공하는 식사프로그램에 의존하는 노인들의 적절한 영양공급과 균형 잡힌 식생활 유지를 위하여 보다 객관화된 지표로 급식 프로그램을 평가할 필요가 있다. 그러므로 노인복지관의 급식 프로그램 운영방식에 대한 적절한 평가 기준을 마련하고 객관화된 평가지표를 개발하는 것이 중요하고 시급한 과제라고 판단된다. 이 연구에서는 현행 노인복지관의 급식 프로그램에 대한 평가 기준으로 적용되고 있는 노인복지법 및 식품위생법의 해당 항목 등을 분석하고 국내·외 노인복지관 급식 프로그램 운영과 관련된 연구와 문헌을 조사하여 내용을 분석하였다. 그리고, 노인복지관의 급식 프로그램을 담당하고 있는 영양사 등의 실무자와의 심층면접을 실시하여 노인복지관의 급식 프로그램에 대한 전반적인 내용과 시행 상의 문제점 및 개선사항에 대한 의견을 수렴하였다. 분석된 내용을 바탕으로BSC 개념을 적용하여 예비균형성과표를 구성하고 개발된 성과표를 노인복지관의 업무를 담당하는 실무자, 학계의 학자로 구성된 전문가들의 자문을 구하여 델파이 분석을 진행하였다. 성과표에서 설정한 목표와 각 평가지표 내용에 대하여 델파이 조사를 통해서 타당도를 검증한 후 최종적으로 노인복지관 급식운영 성과에 대한 평가지표를 도출하였다. 도출된 평가지표를 바탕으로 개발된 설문지를 활용하여 전국에 위치한 노인복지관의 영양사, 사회복지사, 관리자들을 대상으로 설문조사를 실시하였으며, 회수된 설문조사지의 내용을 토대로 노인복지관의 급식운영 내용을 평가하고 분석하였다. 그리고, 서울, 경기 인근의 노인복지관 30곳을 현장방문하여 영양사를 대상으로 개발된 평가 항목을 적용하여 현장조사를 시행하였다. 노인복지관의 급식 운영과 관련하여 재무적인 부분은 운영 성과가 양호한 것으로 확인되었다. 하지만, 영양사들의 과중한 업무로 인하여 경로식당 운영을 제외한 영양상담이나 영양교육 시행 정도는 낮았으며 게시판을 통한 정보 제공에 그치는 것으로 확인되었다. 노인들에게 제공되는 급식의 영양관리 부분은 열량과 염도 부분만이 고려되고 있었으며, 영양의 균형적인 제공에는 수행도가 낮은 것으로 파악되어, 보완 및 개선이 필요함을 확인하였다. 영양사 및 조리 인원의 부족과 노후된 시설 및 설비 등으로 인하여 위생관련 수행 사항에 제약이 발생하는 것으로 나타났으며, 이 부분에 관한 정부와 지역 자치 단체로부터의 예산 지원 확대가 필요하다고 판단되었다. 설문조사와 현장조사의 평가 결과들을 평가 기준에 따라 점수로 산출한 결과, 설문조사에서는 62.6%, 현장조사에서는 70.0%의 조사 대상들이 양호하거나 우수한 수준으로 급식운영을 하고 있는 것으로 나타났다. 직군별 비교에서는 영양사, 사회복지사, 관리자의 점수가 81.6, 80.1, 81.8로 비교적 비슷하게 분포하였다. 특히, 관리자 그룹은 평가 점수를 80점 이상 획득한 비율이 61.6%를 나타내어, 영양사 55.2%, 사회복지사 54.9%에 비하여 높은 편이었다. 네 가지 관점별 비교에서는 재무적 관점이 수행도가 높은 편이었으나, 고객 관점과 학습 및 성장 관점은 성취도가 낮게 파악되어, 개선이 필요함을 확인하였다. 급식 운영에 관한 설문조사와 현장방문조사의 총점에 대한 평균은 각각 81.3, 84.7로 확인되어, 현장방문 대상자들에 대한 급식 운영 성과가 설문조사 대상자들에 비하여 높은 것을 알 수 있었다. 본 연구를 통하여 노인 급식 프로그램에 일원화된 객관적이고 과학적인 운영평가 기준을 마련하고자 하였으며, 노인복지관의 급식 프로그램의 전반적인 품질을 개선하여 노인의 건강 생활의 유지 및 증진, 질병 예방에 기여할 수 있을 것으로 예상한다. 또, 노인복지관의 급식 프로그램을 효율적으로 관리하여 노인 급식 프로그램을 확대할 수 있으며, 노인 급식 시설의 지속적인 평가를 통하여 노인 급식의 안전성을 확보하고 신뢰성을 제고하는데 효과적인 도구로 사용될 것이라고 생각한다. In Korea, the elderly population has been rapidly increasing and the Korean population is aging dramatically nowadays. Many of the rising elderly population who face financial and physical difficulties cooking for themselves can use foodservice or lunch box delivery services by a growing number of local senior welfare or community centers to meet their basic nutritional needs. These foodservice programs from senior welfare centers help many elderly people not only to manage to feed themselves but also provide adequate nutrients for the maintenance of life. However, the regulation and research basis for fair supervision of foodservice management have not properly provided, and there are no well-established evaluation tools for foodservice in use in senior welfare centers now. Therefore, the main purpose of this study is to develop a set of integrated and objective performance indicators based on Balanced Score Card (BSC) for foodservice programs in senior welfare centers, and then to properly evaluate foodservice management in senior welfare centers in Korea from the aspects of finance, customers, learning and growth, and the internal business process by applying developed performance indicators. This study developed preliminary performance indicators based on the analysis of existing evaluation indicators and a framework of conceptual reference based on BSC. Expert Delphi analysis was conducted to evaluate the validity of the performance evaluation indicators for the elderly welfare centers. After completion of the Delphi study, a self–evaluation survey was conducted to verify the development of a food service evaluation measurement for the elderly welfare centers and to verify the performance of senior foodservice operations. Self-assessment questionnaires were delivered to the dietitians, social workers, and directors of 270 elderly welfare centers nationwide by mail, fax, and e–mail to analyze the current level of foodservice operations in order to compare the degree of performance by their positions. Among the centers participating in the survey, 30 located in Seoul and Gyeonggi Province were visited during May 2017. For each indicator related to the evaluation, the status of the preparation of the requested documents was confirmed, and the operational status and performance of the work were verified during on-site evaluation. The overall operation of the elderly welfare center foodservice was found to be in good condition and the performance of the social welfare workers was slightly lower than that of the dietitians and the directors. The overall on-site evaluation score for food service operations was found to be higher than that of the survey study. The on-site evaluation results showed that the rate of food service operation in good performance range was higher than that of the survey study, but the rate of operation in low performance range was low compare to the survey study. This study found that foodservice in elderly welfare centers needs to be improved in many ways. Nutrition management and nutrition counseling programs need to be actively adopted to improve the health status of the elderly. Since the placement of dietitians is established by law in facilities where the number of customers served is greater than 50, job descriptions for both dietitians and cooks should be described logically and understandably for both dietitians and cooks. Regarding food sanitation management, more details need to be added to the Elderly Welfare Act, and financial support for improving facilities and utilities are necessary. Food sanitation manuals for workers need to be developed thoroughly, and be utilized on-site to maintain adequate levels of sanitation. To improve the nutrition of the elderly, appropriate manpower should be recruited and nutrition management and diet education should be strengthened. It is also necessary to effectively cooperate with the local governments supporting the budget administration and the food service operations. Government management of elderly welfare centers’ foodservice programs should be promoted in an integrated manner or linked closely with the operation of established foodservice centers so that resources are efficiently utilized and professional support roles provided.