You are here

Improving the Classification of Quantified Self Activities and Behaviour Using a Fisher Kernel


Peng Wang, Shining Yang, Lifeng Sun, Alan Smeaton

Publication Type: 
Refereed Conference Meeting Proceeding
Visual recording of everyday human activities and behaviour over the long term is now feasible and with the widespread use of wearable devices embedded with cameras this offers the potential to gain real insights into wearers’ activities and behaviour. To date we have concentrated on automatically detecting semantic concepts from within visual lifelogs yet identifying human activities from such lifelogged images or videos is still a major challenge if we are to use lifelogs to maximum benefit. In this paper, we propose an activity classification method from visual lifelogs based on Fisher kernels, which extract discriminative embeddings from Hid- den Markov Models (HMMs) of occurrences of semantic concepts. By using the gradients as features, the resulting classifiers can better distinguish different activities and from that we can make inferences about human behaviour. Ex- periments show the effectiveness of this method in improv- ing classification accuracy, especially when the semantic concepts are initially detected with low degrees of accuracy.
Conference Name: 
ACM International Joint Conference on Pervasive and Ubiquitous Computing
UbiComp '15 Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers
Digital Object Identifer (DOI): 
Publication Date: 
Research Group: 
Dublin City University (DCU)
Open access repository: