You are here

Bags of Local Convolutional Features for Scalable Instance Search

Authors: 

Eva Mohedano, Kevin McGuinness, Noel O'Connor, Amaia Salvador, Xavier Giró-i-Nieto, Ferran Marqués

Publication Type: 
Refereed Conference Meeting Proceeding
Abstract: 
This work proposes a simple instance retrieval pipeline based on encoding the convolutional features of CNN using the bag of words aggregation scheme (BoW). Assigning each local array of activations in a convolutional layer to a visual word produces an assignment map, a compact representation that relates regions of an image with a visual word. We use the assignment map for fast spatial reranking, obtain- ing object localizations that are used for query expansion. We demonstrate the suitability of the BoW representation based on local CNN features for instance retrieval, achieving competitive performance on the Oxford and Paris buildings benchmarks. We show that our proposed system for CNN feature aggregation with BoW outperforms state-of-the-art techniques using sum pooling at a subset of the challenging TRECVid INS benchmark.
Conference Name: 
ACM International Conference on Multimedia Retrieval
Proceedings: 
Proceedings of ACM International Conference on Multimedia Retrieval
Digital Object Identifer (DOI): 
10.1145/2911996.2912061
Publication Date: 
06/06/2016
Conference Location: 
United States of America
Research Group: 
Institution: 
Dublin City University (DCU)
Open access repository: 
Yes