Skip to main content

Research Repository

Advanced Search

Improved Lifelog Ego-centric Video Summarization Using Ensemble of Deep Learned Object Features

Mandal, Bappaditya; Mainwaring, Philip

Improved Lifelog Ego-centric Video Summarization Using Ensemble of Deep Learned Object Features Thumbnail


Authors

Philip Mainwaring



Abstract

The ImageCLEF 2017 lifelog summarization challenge [10, 12] was established to develop a benchmark for summarizing egocentric lifelogging videos based on our daily activities, such as ‘commute to work’ or ‘cooking at home’. In this paper, we propose an iterative approach for summarizing lifelogging activities based on task queries provided by the ImageCLEF 2017 lifelog summarization challenge. YoloV3 image detection, TensorFlow GoogleNet image classification and Places365 environment classification resources are used to generate low level deep learned features from the lifelogging images. A nearest neighbor classifier is used to generate high level descriptors to classify lifelogger activities per image basis, which is also a requirement as provided in the ground truth labels. Finally, key frame images per activity are selected via hierarchical clustering to create an accurate and diverse static storyboard of summarized lifelog activities. Experimental results show the superiority of the proposed approach as compared to the highest reported results achieved in the ImageCLEF 2017 lifelog summarization competition.

Presentation Conference Type Speech
Conference Name 30th British Machine Vision Conference
Conference Location Cardiff
Start Date Sep 9, 2019
End Date Sep 12, 2019
Acceptance Date Aug 5, 2019
Publication Date Aug 5, 2019
Publicly Available Date Mar 28, 2024
Series Title British Machine Vision Conference 2019 (BMVC)
Publisher URL https://bmvc2019.org/
Related Public URLs https://egoappworkshop.wordpress.com/informazioni/

Files




You might also like



Downloadable Citations