교육학 연구방법으로서 메타분석(Meta-analysis)의 발전과정 고찰 = Historical development of meta-analysis as an educational research methodology

국문 초록 (Abstract)

이 연구는 교육학 연구방법론으로서 메타분석(meta-analysis)의 발전과정을 고찰함으로써, 기존 문헌연구의 한계 및 메타분석의 의의를 이해하고, 메타분석을 통한 교육학연구의 학문적 발전을 위한 시사점을 찾고자 하였다. 이를 위해 우선 국내·외 메타분석연구의 증가 빈도를 시기별로 살펴보고, 통시적으로 메타분석이 발전된 과정을 연구결과의 종합화라는 메타분석의 본질적 특성 측면에서 고찰하였다. 우선 Glass가 메타분석이라는 용어를 사용한 1976년 이전의 개념적 발전기에서 출발하여 이후 연구결과를 종합하려는 학자들의 노력들을 조망해 보고, 또한 1976년 이후 메타분석에 대한 비판과 그러한 비판을 극복하는 과정을 살펴보았다. 아울러 1980년대의 다양한 교재들의 출현, 1990년대의 증거기반운동(evidence-based movement) 및 현재의 국제적인 네트워크 형성과 주요한 방법론적인 이슈들을 탐색하였다. 이상의 역사적 고찰을 바탕으로 앞으로 교육학 연구에서 메타분석의 발전을 위한 시사점을 몇 가지 제시해 보았다. 첫째, 메타분석과 유사 연구방법과의 개념적 차별화가 필요하고, 둘째, 기존 연구를 양적으로 통합하고 질적으로 종합하는(synthesizing qualitative research) 노력을 통하여 학술적으로도 검증된 지식을 축적하는 노력이 필요하며, 셋째, 경험적 교육학에서 많이 쓰이는 회귀분석 연구들을 종합하는 문제, 내재적 자료(nested data) 구조를 가진 연구물을 종합하는 문제, 메타분석에서의 독립성 가정 위반, 구조방정식 모형을 활용한 연구물들을 종합하여 이론 모형을 형성하려는 접근(model based meta-analysis, Becker 2009) 등 충분한 방법론적 발전이 부가되어야 함을 제시하였다.

다국어 초록 (Multilingual Abstract)

This study attempted to understand the limits of existing research review and the importance of meta-analysis, and to suggest some implication for future development of the method by reviewing the historical development of meta-analysis as an educational research methodology. We compared meta-analysis with other methods of research review such as narrative review and vote counting. Glass coined the term of 'meta-analysis' in 1976 and we investigated the phenomena of synthesizing quantitative research from 1900s to present. Especially, we focused on methodological critiques and overcoming efforts made by several frontiers on the field. Lastly, we presented the current issues and future research implications in addition to the present problems of meta-analysis research in Korea. Conceptual differentiation between meta-analysis and other similar methods, diffusion of the importance and knowledge sharing on meta-analysis, and additional academic efforts to solve some disputes around the data analysis, assumption, and approaches should be made in further research and practices.

참고문헌 (Reference)

1 황용석, "한국 온라인저널리즘 연구의 주제와 접근방법에 대한 메타분석" 한국언론학회 2 (2): 128-169, 2006

2 안민호, "커뮤니케이션 연구들의 일반적 특징과 언급된 주요이론들에 대한 메타분석" 9 (9): 175-198, 2006

3 이종승, "최근 연구방법의 동향, in 교육연구방법론편" 한국교육개발원 1982

4 나장함, "질적 메타분석에 대한 고찰" 한국교육과정학회 26 (26): 229-252, 2008

5 조지민, "유의수준 비교방법의 점근분포 유도와 정확성 검증" 한국교육방법학회 14 (14): 19-34, 2002

6 오성삼, "선행연구 결과의 통합과 재분석을 위한 메타분석의 이론과 실제" 건국대학교 출판부 2009

7 송인섭, "메타분석의 문제" 5 : 43-53, 1990

8 오성삼, "메타분석에 대한 고찰" 25 : 33-62, 1995

9 오성삼, "메타분석방법의 활용동향과 컴퓨터 프로그램을 이용한 메타분석방법" 5 (5): 123-166, 1992

10 이종승, "메타분석: 연구결과의 통계적 종합" 21 (21): 83-92, 1983

11 서미옥, "메타분석 연구의 고찰과 연구방법론적인 제안" 한국교육학회 49 (49): 1-23, 2011

12 이희숙, "교육행정연구에서 메타분석법 적용가능성 탐색" 162-176, 2011

13 한용진, "교육학사(敎育學史) 서설" 교육문제연구소 (29) : 23-43, 2007

14 박세훈, "교육연구에 있어서의 메타분석의 쟁점" 12 : 1-16, 2003

15 오성삼, "古典的 메타분석에 대한 補完的 接近方法의 探索" 한국교육과정평가원 6 (6): 107-124, 2003

16 Oxman, A. D., "for reading literature review" 138 : 697-703, 1988

17 Hanushek, E. A, "When school finance "reform" may not be good policy" 28 : 423-456, 1991

18 Feldman, K. A, "Using the work of others: Some observations on reviewing and integrating" 44 : 86-102, 1969

19 Dunkin, M.J, "Types of errors in synthesizing research in education" 66 (66): 87-97, 1996

20 Hanushek, E. A, "Throwing money at schools" 1 : 19-41, 1981

21 Hyde, J. S., "The psychology of gender: Advances through meta-analysis" Johns Hopkins Press 1986

22 Tippett, L.H.C, "The method of statistics" Williams and Norgate 1931

23 Mulrow, C. D, "The medical review article: State of the science" 106 : 485-488, 1987

24 Hanushek, E. A, "The impact of differential expenditures on school performance" 18 (18): 45-65, 1989

25 Cooper, H., "The handbook of research synthesis" Russell Sage 1994

26 Wacher, K. W., "The future of meta-analysis: A project of the Committee on National Statistics, Commission on Behavioral and Social Sciences and Education, National Research Council" Russell Sage Foundation 1990

27 Winkelstein,W, "The first use of meta-analysis" 147 (147): 717-, 1998

28 Eysenck, "The effects of psychotheraphy: An evaluation" 16 : 319-324, 1952

29 Greenwald, R., "The effect of school resources on student achievement" 66 (66): 361-396, 1996

30 Hanushek, E. A, "The economics of schooling: Production and efficiency in public schools" 24 : 1141-1177, 1986

31 Bickman, L., "The SAGE Handbook of applied social research methods" Sage Publications 2008

32 Rosenthal, R, "The "file drawer problem" and tolerance for null results" 86 : 638-641, 1979

33 Cooper, H..M, "Synthesizing research: A guide for literatitre synthesis" Sage 1998

34 Light, R. J., "Summing up : the science of reviewing research" Harvard University Press 1984

35 Cooper, H.M., "Statistical versus traditional procedures for summarizing research findings" 87 (87): 442-449, 1980

36 Fisher, R. A, "Statistical methods for research workers" Oliver and Boyd 1932

37 Hedges, L. V., "Statistical methods for meta-analysis" Academic Press 1985

38 Cooper, H.M, "Scientific principles for conducting integrative research reviews" 52 : 291-302, 1982

39 Taveggia, T. C, "Resolving research controversy through empirical cumulation: Toward reliable sociological knowledge" 2 : 335-407, 1974

40 Pearson, K, "Report on certain enteric fever inoculation statistics" 3 : 1243-1246, 1904

41 Cochran, W. G, "Problems arising in the analysis of a series of similar experiments" 4 : 102-118, 1937

42 Glass, G. V, "Primary, secondary and meta-analysis of research" 10 : 3-8, 1976

43 Becker, B. J, "Multivariate meta-analysis: Contributions of Ingram Olkin" 22 (22): 401-406, 2007

44 Becker, B. J, "Model based meta-analysis, in The handbook of research synthesis and meta-analysis" Russell Sage Foundation 377-395, 2009

45 Jackson, "Methods for integrative reviews" 50 : 438-460, 1980

46 Jensen, L. A., "Meta-synthesis of qualitative findings" 6 (6): 553-560, 1996

47 Noblit, G.W., "Meta-ethnography: Synthesizing qualitative studies" Sage 1988

48 Rosenthal, R, "Meta-analytic procedures for social research" 1991

49 황정규, "Meta-analysis의 이론과 방법론: 경험과학적 연구 결과의 종합을 위하여" 19 : 1988

50 Rosenthal, R., "Meta-analysis: Recent developments in quantitative methods for literature reviews" 52 : 59-82, 2001

51 Wolf, F. M, "Meta-analysis: Quantitative methods for research synthesis" 1986

52 Olkin, I, "Meta-analysis: Current issues in research synthesis" 15 : 1253-1257, 1996

53 Hunter, J.E., "Meta-analysis: Cumulating research findings across studies" Sage 1982

54 Hunter, J.E., "Meta-analysis: Correcting error and bias research findings" Sage 1990

55 Glass, G. V., "Meta-analysis of the relationship between class size and achievement" 1 : 2-16, 1979

56 Smith, M. L., "Meta-analysis of psychotherapy outcome studies" 32 : 752-760, 1977

57 Glass, G.V., "Meta-analysis in social research" Sage 1981

58 Bergh, J. C., "Meta-analysis in environmental economics" Kluwer Academic Publishers 1997

59 Cook, T. D., "Meta-analysis for future explanation: A case book" Russell Sage Foundation 1992

60 Mosteller, F, "Meta-analysis for explanation" Sage 1992

61 Eddy, D. M., "Meta-analysis by the confidence profile method: The statistical synthesis of evidence" 1992

62 Glass, G. V, "Meta-analysis at 25. Paper presented to Office of Special Education Programs Research Project" 1999

63 Glass, G. V, "Meta-analysis at 25"

64 Valentine, "Judging the quality of primary research, in The handbook of research synthesis and meta-analysis" Russell Sage Foundation 129-146, 2009

65 Borenstein, M., "Introduction to meta-analysis" John Wiley & Sons, Ltd 2009

66 Rosenthal, R., "Interpersonal expectancy effects: The first 345 studies" 3 : 377-415, 1978

67 Cooper, H.M, "Integrating research: A guide for literature reviews" Sage 1989

68 Hunt, M, "How science takes stock: The story of meta-analysis" Russell Sage 1997

69 Olkin, I, "History and goals, in The future of meta analysis" Russell Sage Foundation 3-10, 1990

70 Hedges, L. V, "Distribution thoery for Glass's estimator of effect size and related estimators" 6 (6): 107-128, 1981

71 Hunter, J. E., "Differential validity of employment tests by race: A comprehensive review and analysis" 86 : 721-735, 1979

72 Aguinis, H., "Comparison of three meta-analytic procedures for estimating moderating effects of categorical variables" 11 (11): 9-34, 2008

73 Panel on Statistical Issues and Opportunities for Research in the Combination of Information, "Combining information: Statistical issues and opportunity for research" National Academy Press 1992

74 O'Rourke, K, "An historical perspective on meta-analysis: dealing quantitatively with varying study results" 100 : 579-582, 2007

75 Eysenck, H. J, "An exercise in mega-silliness" 33 (33): 1978

76 Mullen, B, "Advanced BASIC meta-analysis" Erlbaum 1989

77 Light, R. J., "Accumulating evidence: Procedures for resolving contradictions among research studies" 41 : 429-471, 1971

78 Huberty, C. J, "A history of effect size indices" 62 : 227-240, 2002

79 Chalmers, L., "A brief history of research synthesis" 25 (25): 12-37, 2002