Evaluating Content Based Image Retrieval Techniques with the One Million Images CLIC Test Bed

Authors: Pierre-Alain Moëllic, Patrick Hède, Gr egory Grefenstette, Christophe Millet

Abstract:

Pattern recognition and image recognition methods are commonly developed and tested using testbeds, which contain known responses to a query set. Until now, testbeds available for image analysis and content-based image retrieval (CBIR) have been scarce and small-scale. Here we present the one million images CEA-List Image Collection (CLIC) testbed that we have produced, and report on our use of this testbed to evaluate image analysis merging techniques. This testbed will soon be made publicly available through the EU MUSCLE Network of Excellence.

Keywords: CBIR, CLIC, evaluation, image indexing and retrieval, testbed.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1070959

References:

[1] http://www1.cs.columbia.edu/CAVE/
[2] http://wang.ist.psu.edu/docs/related/
[3] http://vismod.media.mit.edu/vismod/imagery/VisionTexture/vistex.html
[4] M.Flickners, H.Sawhney, W.Niblack, J.Ashley. "Query by image and video content: the Qbic system". IEEE Computer, September 1995.
[5] C.Carson, S.Belongie, H.Greenspan, J.Malik. "Blobworld : Image segmentation using expectation-maximization and its application to image querying". February 1999.
[6] J.Smith, S.Chang "Querying by color regions using the visualseek content-based visual query system". Intelligence Multimedia Information Retrieval AAAI Press, 1997.
[7] James Z. Wang, Jia Li, Gio Wied erhold, ``SIMPLIcity: Semantics- Sensitive Integrated Matching for Picture Libraries,'' IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 9, pp. 947- 963, 2001.
[8] N. Boujemaa, J. Fauqueur, M. Ferecatu "IKONA: Interactive Generic and Specific Image Retrieval". International workshop on Multimedia Content-Based Indexing and Retrieval, 2001, Rocquencourt, France.
[9] M.Joint, P.A. Mo├½llic, P. Hède, P. Adam. "PIRIA: A General Tool for Indexing, Search and Retrieval of Multimedia Content". SPIE.Electronic Imaging, Vol. 5298, Algorithms and Systems III, Session 3, San Jose 2004.
[10] Chen-Chin Chiang, Wen-Kai Tai, Mau-Tsuen Yang, "A novel method for detecting lips, eyes and faces in real time". Real-Time Imaging 9, pp. 277-287, 2003.