You are here

Semantically Smoothed Refinement for Everyday Concept Indexing


Peng Wang, Lifeng Sun, Shiqiang Yang, Alan Smeaton

Publication Type: 
Refereed Conference Meeting Proceeding
Instead of occurring independently, semantic concepts pairs tend to co-occur within a single image and it is intuitive that concept detection accuracy for visual concepts can be enhanced if concept correlation can be leveraged in some way. In everyday concept detection for visual lifelogging using wearable cameras to automatically record everyday activities, the captured images usually have a diversity of concepts which challenges the performance of concept detection. In this paper a semantically smoothed refinement algorithm is proposed using concept correlations which exploit topic-related concept relationships, modeled externally in a user experiment rather than extracted from training data. Results for initial concept detection are factorized based on semantic smoothness and adjusted in compliance with the extracted concept correlations. Refinement performance is demonstrated in experiments to show the effectiveness of our algorithm and the extracted correlations.
Conference Name: 
Pacific Rim Conference on Multimedia 2016
PCM 2016: Advances in Multimedia Information Processing - PCM 2016
Digital Object Identifer (DOI): 
10.1007/978-3-319-48890-5 31
Publication Date: 
Conference Location: 
Research Group: 
Dublin City University (DCU)
Open access repository: