Near Duplicate Document Detection using Document Image

다국어 초록 (Multilingual Abstract)

With development, access of Internet has allowed storage of huge documents containing information. Identifying near duplicate documents among those documents is a major problem in information retrieval due to their dimensionality which leads to high cost time. We propose an algorithm based on tf-idf method with importance and discriminative power of a term within a single document to speed up search process for detecting how documents are similar in collection. Using only 26.6% of original document size, our method performs well on efficiency and memory usage as we have reduced compare to the original one and that leads to a decreased time in searching process for similar documents in a collection.

목차 (Table of Contents)

• Abstract
• 1. Introduction
• 2. Related Works
• 3. Proposed Method
• 3.1. Document Image
• 3.2. Algorithm Description
• 3.3. Time Complexity
• 4. Experiment and Analysis
• 5. Conclusion
• Acknowledgements
• References