TEMPORAL VIDEO SUMMARIZATION METHOD AND DEVICE USING THE DEGREE OF SPATIAL OVERLAP OF VISUAL OBJECTS

摘要

A time direction video summarization method taking into account the degree of overlap of spatial direction objects performed by a time direction video summarization apparatus, and the time direction video summarization method comprises: (a) input video with respect to a reference time interval with a time axis and a two-dimensional image plane. Forming into a considered three-dimensional space, (b) detecting an object for each of a plurality of frames included in the input video, and extracting object information, (c) based on the object information, object track information for the object Extracting, (d) calculating a region change rate of the object track based on the object track information, and (e) if the region change rate is equal to or less than a preset threshold, the object track adjusted by subsampling the object track in a time direction And (f) generating a summary video using the object track maintained or adjusted in consideration of the area change rate and the background generated for the reference time period.