Mainwaring, P and Mandal, B (2019) Improved Lifelog Ego-centric Video Summarization Using Ensemble of Deep Learned Object Features. In: 30th British Machine Vision Conference, 9-12 Sep 2019, Cardiff. (In Press)

[thumbnail of 0003Downloaded.pdf]
0003Downloaded.pdf - Accepted Version

Download (4MB) | Preview


The ImageCLEF 2017 lifelog summarization challenge [10, 12] was established to develop a benchmark for summarizing egocentric lifelogging videos based on our daily activities, such as ‘commute to work’ or ‘cooking at home’. In this paper, we propose an iterative approach for summarizing lifelogging activities based on task queries provided by the ImageCLEF 2017 lifelog summarization challenge. YoloV3 image detection, TensorFlow GoogleNet image classification and Places365 environment classification resources are used to generate low level deep learned features from the lifelogging images. A nearest neighbor classifier is used to generate high level descriptors to classify lifelogger activities per image basis, which is also a requirement as provided in the ground truth labels. Finally, key frame images per activity are selected via hierarchical clustering to create an accurate and diverse static storyboard of summarized lifelog activities. Experimental results show the superiority of the proposed approach as compared to the highest reported results achieved in the ImageCLEF 2017 lifelog summarization competition.

Item Type: Conference or Workshop Item (Paper)
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Natural Sciences > School of Computing and Mathematics
Depositing User: Symplectic
Date Deposited: 25 Oct 2019 08:21
Last Modified: 25 Oct 2019 11:50

Actions (login required)

View Item
View Item