Video sketch summarization, interaction and cognition analysis（基于草图交互的视频摘要方法及认知分析）
Published in Scientia Sinica Informationis, 2013
Abstract: Video, as one typical digital media, is important for message communication. For efficient video content visualization and natural interaction such as video browsing and searching, we propose a sketch-based video summarization with fluent sketch interaction in this paper. Firstly, we present the sketch representation for video semantics, which takes the advantages of abstractness and generality of sketches. The concept of semantic sketch is proposed, which supports annotating video contents with sketches. Furthermore, an optimized layout algorithm for sketch summarization is presented. Secondly, we present the interaction techniques for sketch summarization and natural sketch gesture operations. From the viewpoint of cognitive psychology, we analyze the sketch representation, as well as the effects and relations of cognitive units in sketch interaction. Finally, user studies show that the proposed sketch summarization and sketch interaction improve user efficiency in terms of acquiring the main video content and reduce users’ cognitive load.
Recommended citation: Cui-Xia Ma, Yong-Jin Liu, Qiu-Fang Fu, Ye Liu, Xiao-Lan Fu, Guo-Zhong Dai, Hong-An Wang (2013) Video sketch summarization, interaction and cognition analysis（基于草图交互的视频摘要方法及认知分析）. Scientia Sinica Informationis, Vol. 43, No. 8, pp.1012-1023, in Chinese, 2013.