육하원칙 정보에 기반한 홈비디오 키프레임 추출

국문 초록 (Abstract)

본 논문에서는 육하원칙 정보를 기반으로 홈비디오에서 키프레임을 추출하는 방법을 제시한다. 키프레임 추출 방법이란 비디오에서 중요하다고 생각되는 특정 프레임만을 선출하여 비디오를 요약하는 방법이다. 홈비디오의 경우 그 주제가 다양하여 특별한 가정을 통한 정보 추출이 어렵고, 주로 인물이 비디오의 중심이 되기 때문에 인물의 행동을 중심으로 요약을 수행하여야 한다. 본 논문에서는 인물의 얼굴, 인물의 행동, 전체 배경 정보를 분석하여 인물 중심의 보편적인 요약 기준인 육하원칙의 주요 정보를 추출한다. 추가적으로 비디오의 매 프레임의 블러 크기를 측정하여 이용함으로써 프레임별로 얼마나 많은 정보를 포함하고 있는지 측정하고, 가장 많은 정보를 포함한 프레임을 키프레임으로 선출한다. 사용자 실험을 통해 사용자가 홈비디오에서 여러 개의 키프레임을 선택할 경우, 기존의 방법보다 사용자의 선택과 유사함을 확인할 수 있다.

다국어 초록 (Multilingual Abstract)

We propose a novel method to extract keyframes from home videos based on the 5W and 1H information. Keyframe extraction is a kind of video summarization which selects only specific frames containing important information of a video. As a home video may have content with a variety of topics, we cannot make specific assumptions for information extraction. In addition, to summarize a home video we must analyze human behaviors, because people are important subjects in home videos. In this paper, we extract 5W and 1H information by analyzing human faces, human behaviors, and the global information of background. Experimental results demonstrate that our technique extract more similar keyframes to human selections than previous methods.

목차 (Table of Contents)

• 요약
• Abstract
• 1. 서론
• 2. 관련연구
• 3. 전달해야하는 정보 정의
• 4. 키프레임 선출
• 5. 실험
• 6. 결론 및 토의
• 참고문헌

참고문헌 (Reference)

1 B. Yu, "Video Summarization based on User Log Enhanced Link Analysis" ACM MM 382-391, 2004

2 B.T. Truong, "Video Abstraction: A Systematic Review and Classification" 3 (3): 2007

3 J. Luo, "Towards Extracting Semantically Meaningful Key Frames From Personal Video Clips: From Humans to Computers" 289-301, 2009

4 S. Han, "Scalable temporal interest points for abstraction and classification of video events" 4-, 2005

5 A. Doshi, "Robust processing of optical flow of fluids" IEEE Transactions on Image Processing 2232-2344, 2010

6 M. A. Fischler, "Random sample consensus: a paradigm for model fitting with application to image analysis and automated cartography" 24 (24): 381-395, 1981

7 T. Liu, "Optimization algorithms for the selection of key frame sequences of variable length" 403-417, 2002

8 C. Kim, "Object-Based video abstraction for video surveillance systems" 1128-1138, 2002

9 T. Liu, "Novel Video Key-Frame-Extraction Algorithm Based on Perceived Motion Energy Model" 1006-1013, 2003

10 M. Werlberger, "Motion Estimation with Non-Local Total Variation Regularization" IEEE 2464-2471, 2010

11 J. Rong, "Key frame extraction using inter-shot information" 571-574, 2004

12 W. Wolf, "Key Frame Selection by Motion Analysis" ICASSP 1228-1231, 1996

13 Y. Matsushita, "Full-frame video stabilization with motion inpainting" IEEE Transactions on Pattern Analysis and Machine Intelligence 1150-1163, 2006

14 H.S. Chang, "Efficient video indexing scheme for content-based retrieval" 1269-1279, 1999

15 X. Zhang, "Dynamic selection and effective compression of key frames for video abstraction" 1523-1532, 2003

16 M. Cooper, "Discriminative techniques for keyframe selection" 4-, 2005

17 F. Arman, "Content-based Browsing of Video Sequences" 97-103, 1994

18 S.W. Smoliar, "Content-Based Video Indexing and Retrieval" IEEE MultiMedia, IEEE Computer Society Press 62-72, 1994

19 B. Gunsel, "Content-Based Video Abstraction" 128-132, 1998

20 H. Ueda, "Automatic structure visualization for video editing" ACM 137-141, 1993

21 M. Werlberger, "Anisotropic Huber-L1 Optical Flow" 1-11, 2009

22 Y. Li, "An overview of video abstraction techniques" HP Laboratory 2001

23 B. D. Lucas, "An iterative image registration technique with an application to stereo vision" 1981

24 G. Ciocca, "An innovative algorithm for key frame extraction in video summarization" 69-88, 2006

25 T. Liu, "An efficient error-minimizing algorithm for variable-rate temporal video sampling" 413-416, 2002

26 H. Zhang, "An Integrated System for Content-Based Video Retrieval and Browsing" 643-658, 1997

27 A. Hanjalic, "An Integrated Scheme for Automated Video Abstraction Based on Unsupervised Cluster-Validity Analysis" TCSVT 1280-1289, 1999

28 Y. Zhuang, "Adaptive Key Frame Extraction using Unsupervised Clustering" 866-870, 1998