음성 질의 기반 디지털 사진 검색 기법 = A Query-by-Speech Scheme for Photo Albuming

다국어 초록 (Multilingual Abstract)

In this paper, we introduce two retrieval methods for photos with speech documents. We compare the pattern of speech query with those of speech documents recorded in digital cameras, and measure the similarities, and retrieve photos corresponding to the speech documents which have high similarity scores. As the first approach, a phoneme recognition scheme is used as the pre-processor for the pattern matching, and in the second one, the vector quantization (VQ) and the dynamic time warping (DTW) are applied to match the speech query with the documents in signal domain itself. Experimental results show that the performance of the first approach is highly dependent on that of phoneme recognition while the processing time is short. The second method provides a great improvement of performance. While the processing time is longer than that of the first method due to DTW, but we can reduce it by taking approximated methods.

참고문헌 (Reference)

1 김태성, "음소 인식기를 이용한 음성정보 검색시스템의 구현" 숭실대학교 21-24, 2005

2 X. Huang, "Spoken Language Processing: A Guide to Theory, Algorithm, and System Development" Prentice Hall PTR 2001

3 N. Moreau, "Phone-based spoken document retrieval in conformance with the MPEG-7 standard" 2004

4 B. Yates, "Modern Information Retrieval" ACM Press 1999

5 "HTK (Hidden Markov Model ToolKit)"

6 L. Rabiner, "Fundamentals of Speech Recognition" Prentice-Hall, Inc. 1993

7 L. R. Rabiner, "Digital Processing of Speech Signals" Prentice Hall 1978