A framework for video object extraction, deformation, and interactive authoring

다국어 초록 (Multilingual Abstract)

In this dissertation, we introduce several user interactive video editing systems. First

we present a video matting system for extracting an object from a video. The state-of-the-art matting algorithm for still images is significantly advanced in terms of speed and
quality. However, we cannot directly extend existing matting systems to video, because
it would require considerable manual efforts; moreover, it would lead to artifacts due
to the temporal incoherence problem. Thus, we present a temporally coherent approach
for video matting. Our system extends an existing matting algorithm from 2D to 3D
by considering several frames simultaneously rather than frame-by-frame. This method
is better than previous techniques in terms of consistency and preservation of temporal
coherence.
Second, we present a system for transforming the motion and shape of a video object
into cartoon-style animation. We apply the cartoon principles that are mainly employed
in traditional 2D animation, such as squash-and-stretch, anticipation effects, and follow-and-through, and etc. Furthermore, this method can generate a variety of effects with
minimal user input.
Finally, we propose a semi-automatic system for adding word balloons to a video us-ing caption information for a movie or TV drama. Previous caption systems used fixed
position; hence, viewers would experience a problem during disturbances in the line of
sight, and they could not focus on the video content. Our system computes the appro-priate position for word balloons by detecting the faces of characters. For this purpose,
we develop a new user authoring tool that minimizes the manual effort required for au-tomatic face and voice verification. Accordingly, we show that our system optimizes the
overlaying of word balloons in videos.
This dissertation proposes various video editing techniques that can create intuitive
and simple tools for non-professional users.