프로젝트 구텐베르크를 활용한 텍스트 시각화 및 용례 검색 = Text Visualization and Concordance Retrieval Using Project Gutenberg

다국어 초록 (Multilingual Abstract)

This paper is to introduce our approach in seeking Culturomics, where culture, information, and social science studies are converged. Our studies aim to look into dynamic changes of culture, using text retrieval systems and text visualization techniques using big size text data provided by Project Gutenberg. Our role-model, Google books and Google Ngram Viewers, which contain trillions of words, deal with only text visualization based on preprocessed ngram data. In order to show more detailed micro approach, we show text concordance retrieval data together with macro approach of text visualization. Since Project Gutenberg only provides with copy-right free data and the majorities of the data is concentrated between 1880 and 1910, chronological transition of macro approach can be biased solely depending on frequency measurement. Upon such statistical questions, we found out that relative log frequency is very suitable for seeking our goal. (Ewha Womans University)

참고문헌 (Reference)

1 최재웅, "핵심어로 본 시대상의 변화" 26 (26): 36-76, 2015

2 "프로젝트 구텐베르크 통계 조사 Reeves"

3 배정환, "텍스트 마이닝을 이용한2012년 한국대선 관련 트위터 분석" 한국지능정보시스템학회 19 (19): 141-156, 2013

4 에이든과 미셀, "빅데이터 인문학: 진격의 서막" 사계절 2015

5 정한민, "과학기술 용어에 대한 생명주기 고찰" 4 (4): 84-89, 2006

6 "pattern"

7 Bochkarev, V., "Verifying heap’s law using Google Books Ngram data" 1612 (1612): 1-8, 2016

8 Evert, S., "Twenty-first century corpus workbench" 2011

9 Renouf, A, "The time dimension in modern English corpus linguistics" 27-41, 2002

10 Mair, C., "The Major Varieties of English" 139-158, 1997

11 "Senna"

12 Michel, J., "Quantitative analysis of culture using millions of digitized books" 331 : 176-182, 2011

13 "OCR 오류"

14 Bird, S., "Natural Language Processing with Python" O’Reilly Media 2009

15 Evert, S., "Inside the IMS corpus workbench" Presentation at IULA, Univ. of Pompeu Fabra 2008

16 "Google Ngram Viewer"

17 "Google Books Wikipedia"

18 Gries, S., "Dispersion and adjusted frequencies in corpora" 1 (1): 403-437, 2008

19 Ginzberg, J., "Detecting influenza epidemics using search engine query data" 459 (459): 1012-1014, 2009

20 McEnery, T., "Corpus Linguistics" Edinburgh University Press 1996

21 Gulordava, K., "A distributional similarity approach to the detection of semantic change in the Google Ngram corpus" 67-71, 2011

22 Gries, S., "A Mosaic of Corpus Linguistics: Selected Approach" 269-291, 2010