발화구간 검출을 위해 학습된 CNN 기반 입 모양 인식 방법

목차 (Table of Contents)

• 요약
• Abstract
• 1. 서론
• 2. 이전 연구들의 분석
• 3. 발화구간 검출 CNN을 이용한 입 모양 인식 방법
• 3.1 전처리 및 입술 영역 검출
• 3.2 발화구간 검출
• 3.3 CNN을 이용한 특징 생성 및 인식
• 4. 실험 및 결과
• 4.1 실험 DB
• 4.2 실험 내용
• 4.3 실험 결과
• 5. 결론
• REFERENCES

참고문헌 (Reference)

1 이종석, "컬러 입술영상과 주성분분석을 이용한 자동 독순" 한국정보처리학회 15 (15): 229-236, 2008

2 김응규, "입술 움직임 영상 신호를 이용한 음성 구간 검출" 한국신호처리시스템학회 11 (11): 289-297, 2010

3 김기백, "입술 영역의 움직임과 밝기 변화를 이용한 음성구간 검출 알고리즘 개발" 한국방송∙미디어공학회 17 (17): 519-528, 2012

4 Siatras, S., "Visual lip activity detection and speaker detection using mouth region intensities" 19 (19): 133-137, 2009

5 G. J. Jang, "Visual Object Recognition Based on Deep Neural Networks Implemented by CAFFE" 33 (33): 49-54, 2015

6 허윤아, "U-Healthcare 기기에서 DRDoS공격 보안위협과 Big Data를 융합한 대응방안 연구" 한국융합학회 6 (6): 243-248, 2015

7 이준연, "Time PLOT과 이동평균 융합 시계열 데이터 예측" 한국융합학회 6 (6): 161-167, 2015

8 Maini, Raman, "Study and comparison of various image edge detection techniques" 3 (3): 1-11, 2009

9 Luettin, Juergen, "Speechreading using probabilistic models" 65 (65): 163-178, 1997

10 Ibrahim, M. Z., "Robust geometrical-based lip-reading using Hidden Markov models" 2011-2016, 2013

11 Viola, Paul, "Rapid object detection using a boosted cascade of simple features" 1 : 2001

12 E. K. Kim, "Neural Network Vowel-Recongition Jointly Using Voice Features and Mouth Shape Image" 23 (23): 693-696, 1996

13 Lim, Jong Gwan, "Multidimensional evaluation and analysis of motion segmentation for inertial measurement unit applications" 1-28, 2015

14 Shaikh, A. A., "Lip reading using optical flow and support vector machines." Image and Signal Processing (CISP)" 1 : 2010

15 Werda, Salah, "Lip localization and viseme classification for visual speech recognition" 5 (5): 62-75, 2013

16 Kim Y. K., "Lip Reading Algorithm Using Bool Matrix and SVM" 267-268, 2015

17 Lan, Y., "Improving visual features for lip-reading" 7-3, 2010

18 Arsic, Aleksandra, "Improved lip detection algorithm based on region segmentation and edge detection" 2015

19 Y. K. Kim, "Feature Generations Analysis of Lip Image Streams for Isolate Words Recognition" 10 (10): 337-346, 2015

20 S.I. Chien, "Face and Facial Landmarks Location Based on Log-Polar Mapping" 379-386, 2000

21 Lim, Jong Gwan, "Empirical Validation of Objective Functions in Feature Selection Based on Acceleration Motion Segmentation Data" 2015

22 Cetingul, H. E., "Discriminative analysis of lip motion features for speaker identification and speech-reading" 15 (15): 2879-2891, 2006

23 J. S. Kim, "Deep Learning-based Video Analysis Techniques" 33 (33): 21-31, 2015

24 Krizhevsky, Alex, "Convolutional deep belief networks on cifar-10" 2010

25 Shaikh, Ayaz A., "Automatic visual speech segmentation and recognition using directional motion history images and Zernike moments" 29 (29): 969-982, 2010

26 Krizhevsky, Alex, "Advances in neural information processing systems" 1097-1105, 2012

27 Wang, S. L., "A real-time automatic lipreading system" 2 : 2004

28 Sujatha, B., "A novel approach integrating geometric and Gabor wavelet approaches to improvise visual lip-reading" 5 : 13-18, 2010