연구개발 사업화 성과 평가 = DEA 기반 3단계 R&BD 성과 모형

다국어 초록 (Multilingual Abstract)

This study proposes a three-stage model of R&BD performance which captures commercialization outcomes as well as conventional R&D performance. The model is composed of three factors：inputs (R&D budgets and researchers), outputs (patents and papers), and outcomes (technical fees, products sales, and cost savings). Three stages are defined for each transformation process between the three factors：efficiency stage from input to output (stage 1), effectiveness stage from output to outcome (stage 2), and productivity stage from input to outcome (stage 3). The performance of each stage is measured by data envelopment analysis (DEA). DEA is a non-parametric efficiency measurement technique that has widely been used in R&D performance measurement. We measure the performance of 171 projects of 6 public R&BD programs managed by Seoul Business Agency using the proposed three-stage model. In order to provide a balanced and holistic view of R&BD performance, the R&BD performance map is also constructed based on performance of efficiency and productivity stages.

참고문헌 (Reference)

1 김용환, "창조경제와 R&D정책에 대한 연구" 한국생산성학회 27 (27): 285-307, 2013

2 Meng, W., "Two-level DEA approaches in research evaluation" 36 (36): 950-957, 2008

3 Thompson, R. G., "The role of multiplier bounds in efficiency analysis with application to Kansas farming" 46 (46): 93-108, 1990

4 Bickman, L., "The functions of program theory, New Directions for Program Evaluation" Jossey-Bass 33-, 1987

5 Banker, R. D., "Some models for estimating technical and scale inefficiency in data envelopment analysis" 30 (30): 1078-1092, 1984

6 Georghiou, L., "Socio-economic effects of collaborative R&D-European experiences" 24 (24): 69-79, 1999

7 Keh, H. T., "Retail productivity and scale economies at the firm level：A DEA approach" 31 (31): 75-82, 2003

8 Wang, E. C., "Relative efficiency of R&D activities :A cross-country study accounting for environmental factors in the DEA approach" 36 (36): 260-273, 2007

9 Kerssens-van Drongelen, I., "Performance measurement in industrial R&D" 2 (2): 111-143, 2000

10 Guan, J., "Modeling the relative efficiency of national innovation systems" 41 (41): 102-115, 2012

11 Hsu, F. M, "Measuring relative efficiency of government-sponsored R&D projects：A three-stage approach" 32 (32): 178-186, 2009

12 Kocher, M. G., "Measuring productivity of research in economics：A cross-country study using DEA" 40 (40): 314-332, 2006

13 Lee, H., "Measuring journal performance for multidisciplinary research：An efficiency perspective" 8 (8): 77-88, 2014

14 Jeon, J., "Measuring efficiency of total productive maintenance(TPM)：a three-stage data envelopment analysis(DEA) approach" 22 (22): 911-924, 2011

15 Charnes, A., "Measuring efficiency of decision making units" 2 (2): 429-444, 1978

16 Sharma, S, "Inter-country R&D efficiency analysis：An application of data envelopment analysis" 76 (76): 483-501, 2008

17 박성민, "Identification of DEA Determinant Input-Output Variables : an Illustration for Evaluating the Efficiency of Government-Sponsored R&D Projects" 대한산업공학회 40 (40): 84-99, 2014

18 Guan, J, "Evaluation and interpretation of knowledge production efficiency" 59 (59): 131-155, 2004

19 Farris, J. A., "Evaluating the relative performance of engineering design projects：A case study using data envelopment analysis" 53 (53): 471-482, 2006

20 Revilla, E., "Evaluating performance of public-private research collaborations：A DEA analysis" 54 (54): 165-174, 2003

21 Keh, H. T., "Efficiency, effectiveness and productivity of marketing in services" 170 (170): 265-276, 2006

22 Meng, W., "Efficiency evaluation of basic research in China" 69 (69): 85-101, 2006

23 Cooper, W. W., "Data envelopment analysis：A comprehensive text with models, applications, references and DEA-Solver Software" Springer 490-, 2007

24 Rousseau, S., "Data envelopment analysis as a tool for constructing scientometric indicators" 40 (40): 45-56, 1997

25 이철행, "DEA를 이용한 보건의료기술 R&D사업의 효율성 분석과 전략적 포트폴리오 모형 : 중개연구를 중심으로" 대한산업공학회 40 (40): 172-183, 2014

26 이덕주, "DEA/AHP 모형을 이용한 R&D 프로젝트 선정모형 및 Web 기반 R&D 프로젝트 선정시스템 개발" 대한산업공학회 32 (32): 18-28, 2006

27 전훈, "DEA 기반 온라인 게임 성과 관리 포트폴리오 모형" 대한산업공학회 39 (39): 260-270, 2013

28 Liu, J. S., "DEA and ranking with the network-based approach：a case of R&D performance" 38 (38): 453-464, 2010

29 전훈, "DEA Window 분석을 이용한 국내 온라인 게임 기업의 운영 효율성 평가" 한국경영과학회 39 (39): 23-40, 2014

30 Eilat, H., "Constructing and evaluating balanced portfolios of R&D projects with interactions：A DEA based methodology" 172 (172): 1018-1039, 2006

31 Lee, H., "Comparative evaluation of performance of national R&D programs with heterogeneous objectives ：A DEA approach" 196 (196): 847-855, 2009

32 Garg, K. C., "Assessment of impact of AICTE funding on R&D and educational development" 65 (65): 151-160, 2005

33 Boussofiane, A., "Applied data envelopment analysis" 52 (52): 1-15, 1991

34 Linton, J. D., "Analysis, ranking and selection of R&D projects in a portfolio" 32 (32): 139-148, 2002

35 Banker, R. D., "An introduction to data envelopment analysis with some of its models and their uses" 5 : 125-163, 1989

36 Linton, J. D., "An extension to a DEA support system used for assessing R&D projects" 37 (37): 29-36, 2007

37 이학연, "An International Comparison of R&D Efficiency : DEA Approach" 기술경영경제학회 13 (13): 207-222, 2005

38 Ruegg, R., "A toolkit for evaluating public R&D investment models, methods, and findings from ATP’s first decade" US Department of Commerce 2003

39 Zhang, A., "A study of the R&D efficiency and productivity of Chinese firms" 31 (31): 444-464, 2003

40 Bonaccorsi, A., "A robust nonparametric approach to the analysis of scientific productivity" 12 (12): 47-69, 2003