Deep Spatial Pyramid: The Devil is Once Again in the Details
Bin-Bin Gao, Xiu-Shen Wei, Jianxin Wu, Weiyao Lin

TL;DR
This paper demonstrates that careful selection of detailed factors in deep learning-based visual recognition, such as normalization and spatial pyramid design, significantly improves image classification accuracy with a simple, efficient system.
Contribution
It identifies and validates key detailed factors, including normalization and spatial pyramid design, that enhance deep learning image classification performance.
Findings
L2 matrix normalization outperforms other normalization methods.
Natural deep spatial pyramid significantly boosts accuracy.
Small Fisher Vector K values outperform larger ones.
Abstract
In this paper we show that by carefully making good choices for various detailed but important factors in a visual recognition framework using deep learning features, one can achieve a simple, efficient, yet highly accurate image classification system. We first list 5 important factors, based on both existing researches and ideas proposed in this paper. These important detailed factors include: 1) matrix normalization is more effective than unnormalized or vector normalization, 2) the proposed natural deep spatial pyramid is very effective, and 3) a very small in Fisher Vectors surprisingly achieves higher accuracy than normally used large values. Along with other choices (convolutional activations and multiple scales), the proposed DSP framework is not only intuitive and efficient, but also achieves excellent classification accuracy on many benchmark datasets.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Image and Video Retrieval Techniques · Advanced Neural Network Applications · Image Retrieval and Classification Techniques
