Imperial College London


Faculty of EngineeringDepartment of Electrical and Electronic Engineering

Reader in Computer Vision



+44 (0)20 7594 6220k.mikolajczyk




Electrical EngineeringSouth Kensington Campus






BibTex format

author = {Koniusz, P and Yan, F and Gosselin, P-H and Mikolajczyk, K},
doi = {10.1109/TPAMI.2016.2545667},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
pages = {313--326},
title = {Higher-order occurrence pooling for bags-of-words: visual concept detection},
url = {},
volume = {39},
year = {2016}

RIS format (EndNote, RefMan)

AB - In object recognition, the Bag-of-Words model assumes: i) extraction of local descriptors from images, ii) embedding the descriptors by a coder to a given visual vocabulary space which results in mid-level features, iii) extracting statistics from mid-level features with a pooling operator that aggregates occurrences of visual words in images into signatures, which we refer to as First-order Occurrence Pooling. This paper investigates higher-order pooling that aggregates over co-occurrences of visual words. We derive Bag-of-Words with Higher-order Occurrence Pooling based on linearisation of Minor Polynomial Kernel, and extend this model to work with various pooling operators. This approach is then effectively used for fusion of various descriptor types. Moreover, we introduce Higher-order Occurrence Pooling performed directly on local image descriptors as well as a novel pooling operator that reduces the correlation in the image signatures. Finally, First-, Second-, and Third-order Occurrence Pooling are evaluated given various coders and pooling operators on several widely used benchmarks. The proposed methods are compared to other approaches such as Fisher Vector Encoding and demonstrate improved results.
AU - Koniusz,P
AU - Yan,F
AU - Gosselin,P-H
AU - Mikolajczyk,K
DO - 10.1109/TPAMI.2016.2545667
EP - 326
PY - 2016///
SN - 0162-8828
SP - 313
TI - Higher-order occurrence pooling for bags-of-words: visual concept detection
T2 - IEEE Transactions on Pattern Analysis and Machine Intelligence
UR -
UR -
VL - 39
ER -