A method for evaluating the performance of content-based image retrieval systems based on subjectively determined similarity between images

John A. Black, Gamal Fahmy, Sethuraman Panchanathan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

In recent years multimedia researchers have attempted to design content-based image retrieval systems. However, despite the development of these systems, the term "content" has still remained rather ill defined, and this has made the evaluation of such systems problematic. This paper proposes a method for the creation of a reference image set in which the similarity of each image pair is estimated by two independent methods – by the subjective evaluation of human observers, and by the use of “visual content words” as basis vectors that allow the multidimensional content of each image to be represented with a content vector. The similarity measure computed with these content vectors is shown to correlate with the subjective judgment of human observers, and thus provides both a more objective method for evaluating and expressing image content, and a possible path to automating the process of content-based indexing in the future.

Original languageEnglish (US)
Title of host publicationImage and Video Retrieval - International Conference, CIVR 2002, Proceedings
PublisherSpringer Verlag
Pages356-366
Number of pages11
Volume2383
ISBN (Electronic)9783540438991
StatePublished - 2002
EventInternational Conference on Image and Video Retrieval, CIVR 2002 - London, United Kingdom
Duration: Jul 18 2002Jul 19 2002

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume2383
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

OtherInternational Conference on Image and Video Retrieval, CIVR 2002
CountryUnited Kingdom
CityLondon
Period7/18/027/19/02

Fingerprint

Content-based Image Retrieval
Image retrieval
Observer
Subjective Evaluation
Similarity Measure
Indexing
Correlate
Multimedia
Similarity
Path
Evaluation
Term

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Black, J. A., Fahmy, G., & Panchanathan, S. (2002). A method for evaluating the performance of content-based image retrieval systems based on subjectively determined similarity between images. In Image and Video Retrieval - International Conference, CIVR 2002, Proceedings (Vol. 2383, pp. 356-366). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 2383). Springer Verlag.

A method for evaluating the performance of content-based image retrieval systems based on subjectively determined similarity between images. / Black, John A.; Fahmy, Gamal; Panchanathan, Sethuraman.

Image and Video Retrieval - International Conference, CIVR 2002, Proceedings. Vol. 2383 Springer Verlag, 2002. p. 356-366 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 2383).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Black, JA, Fahmy, G & Panchanathan, S 2002, A method for evaluating the performance of content-based image retrieval systems based on subjectively determined similarity between images. in Image and Video Retrieval - International Conference, CIVR 2002, Proceedings. vol. 2383, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 2383, Springer Verlag, pp. 356-366, International Conference on Image and Video Retrieval, CIVR 2002, London, United Kingdom, 7/18/02.
Black JA, Fahmy G, Panchanathan S. A method for evaluating the performance of content-based image retrieval systems based on subjectively determined similarity between images. In Image and Video Retrieval - International Conference, CIVR 2002, Proceedings. Vol. 2383. Springer Verlag. 2002. p. 356-366. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Black, John A. ; Fahmy, Gamal ; Panchanathan, Sethuraman. / A method for evaluating the performance of content-based image retrieval systems based on subjectively determined similarity between images. Image and Video Retrieval - International Conference, CIVR 2002, Proceedings. Vol. 2383 Springer Verlag, 2002. pp. 356-366 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{13c4c4ea51a8476296721edd4e595327,
title = "A method for evaluating the performance of content-based image retrieval systems based on subjectively determined similarity between images",
abstract = "In recent years multimedia researchers have attempted to design content-based image retrieval systems. However, despite the development of these systems, the term {"}content{"} has still remained rather ill defined, and this has made the evaluation of such systems problematic. This paper proposes a method for the creation of a reference image set in which the similarity of each image pair is estimated by two independent methods – by the subjective evaluation of human observers, and by the use of “visual content words” as basis vectors that allow the multidimensional content of each image to be represented with a content vector. The similarity measure computed with these content vectors is shown to correlate with the subjective judgment of human observers, and thus provides both a more objective method for evaluating and expressing image content, and a possible path to automating the process of content-based indexing in the future.",
author = "Black, {John A.} and Gamal Fahmy and Sethuraman Panchanathan",
year = "2002",
language = "English (US)",
volume = "2383",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "356--366",
booktitle = "Image and Video Retrieval - International Conference, CIVR 2002, Proceedings",
address = "Germany",

}

TY - GEN

T1 - A method for evaluating the performance of content-based image retrieval systems based on subjectively determined similarity between images

AU - Black, John A.

AU - Fahmy, Gamal

AU - Panchanathan, Sethuraman

PY - 2002

Y1 - 2002

N2 - In recent years multimedia researchers have attempted to design content-based image retrieval systems. However, despite the development of these systems, the term "content" has still remained rather ill defined, and this has made the evaluation of such systems problematic. This paper proposes a method for the creation of a reference image set in which the similarity of each image pair is estimated by two independent methods – by the subjective evaluation of human observers, and by the use of “visual content words” as basis vectors that allow the multidimensional content of each image to be represented with a content vector. The similarity measure computed with these content vectors is shown to correlate with the subjective judgment of human observers, and thus provides both a more objective method for evaluating and expressing image content, and a possible path to automating the process of content-based indexing in the future.

AB - In recent years multimedia researchers have attempted to design content-based image retrieval systems. However, despite the development of these systems, the term "content" has still remained rather ill defined, and this has made the evaluation of such systems problematic. This paper proposes a method for the creation of a reference image set in which the similarity of each image pair is estimated by two independent methods – by the subjective evaluation of human observers, and by the use of “visual content words” as basis vectors that allow the multidimensional content of each image to be represented with a content vector. The similarity measure computed with these content vectors is shown to correlate with the subjective judgment of human observers, and thus provides both a more objective method for evaluating and expressing image content, and a possible path to automating the process of content-based indexing in the future.

UR - http://www.scopus.com/inward/record.url?scp=84937553087&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84937553087&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84937553087

VL - 2383

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 356

EP - 366

BT - Image and Video Retrieval - International Conference, CIVR 2002, Proceedings

PB - Springer Verlag

ER -