Skip to main content

Research Repository

Advanced Search

Enhanced Deep Video Summarization Network

Gonuguntla, N; Mandal, B; Puhan, NB

Enhanced Deep Video Summarization Network Thumbnail


Authors

N Gonuguntla

NB Puhan



Abstract

Video summarization is understanding video which aims to get an abstract view of the original video sequence by the concatenation of keyframes representing the highlights of the video. In this work, we propose an enhanced deep summarization network (EDSN) to summarize videos. We implement a reinforcement learning based framework to train our EDSN, where we design a novel reward function which considers the spatial and temporal features of the original video to be included in the summary. The reward function is formulated using the spatial and temporal scores obtained for each frame of the video using the temporal segment networks. During training, the reward function seeks to generate a summary by including the frames with high temporal and spatial scores, while the EDSN strives for earning higher rewards by learning to produce more diverse summaries. The method is completely unsupervised since no labels are required during training. Extensive experiments on two benchmark datasets show that the proposed approach achieves state-of-the-art performance.

Presentation Conference Type Conference Paper (unpublished)
Conference Name 30th British Machine Vision Conference
Conference Location Cardiff
Start Date Sep 9, 2019
End Date Sep 12, 2019
Acceptance Date Aug 5, 2019
Publication Date Aug 5, 2019
Publicly Available Date Mar 28, 2024
Series Title British Machine Vision Conference 2019 (BMVC)
Related Public URLs https://bmvc2019.org/programme/detailed-programme/
https://researchr.org/publication/bmvc-2019

Files




You might also like



Downloadable Citations