Inverted Index based Modified Version of KNN for Text Categorization

다국어 초록 (Multilingual Abstract)

This research proposes a new strategy where documents are encoded into string vectors and modified version of KNN to be adaptable to string vectors for text categorization. Traditionally, when KNN are used for pattern classification, raw data should be encoded into numerical vectors. This encoding may be difficult, depending on a given application area of pattern classification. For example, in text categorization, encoding full texts given as raw data into numerical vectors leads to two main problems: huge dimensionality and sparse distribution. In this research, we encode full texts into string vectors, and modify the supervised learning algorithms adaptable to string vectors for text categorization.

참고문헌 (Reference)

1 T. Jo, "Text Clustering using NTSO" 558-563, 2005

2 H. Lodhi, "Text Classification with String Kernels" 2 (2): 419-444, 2002

3 T. Joachims, "Text Categorization with Support Vector Machines: Learning with many Relevant Features" 143-151, 1998

4 H. Drucker, "Support Vector Machines for Spam Categorization" 10 (10): 1048-1054, 1999

5 N. Cristianini, "Support Vector Machines and Other Kernel-based Learning Methods" Cambridge University Press 2000

6 M. Hearst, "Support Vector Machines" 13 (13): 18-28, 1998

7 P. Jackson, "Natural Language Processing for Online Applications: Text Retrieval, Extraction and Categorization" John Benjamins Publishing Company 2002

8 F. Sebastiani, "Machine Learning in Automated Text Categorization" 34 (34): 1-47, 2002

9 T. Mitchell, "Machine Learning" McGraw-Hill 1997

10 R. R. Korfahage, "Information Storage and Retrieval" Wiley Computer Publishing 1997

11 M. E. Ruiz, "Hierarchical Text Categorization Using Neural Networks" 5 (5): 87-118, 2002

12 D. Mladenic, "Feature Selection for unbalanced class distribution and Naïve Bayes" 256-267, 1999

13 B. Massand, "Classifying News Stories using Memory based Reasoning" 59-65, 1992

14 T. Jo, "Class Imbalances versus Small Disjuncts" 6 (6): 40-49, 2004

15 Y. Yang, "An evaluation of statistical approaches to text categorization" 1 (1): 67-88, 1999

16 Androutsopoulos, K. Koutsias, "An Experimental Comparison of Naïve Bayes and Keyword-based Anti-spam Filtering with personal email message" 160-167, 2000

17 E. D. Wiener, "A Neural Network Approach to Topic Spotting in Text" University of Colorado 1995

18 A. Estabrooks, "A Multiple Resampling Method for Learning from Imbalanced Data Sets" 28 (28): 18-26, 2004