DataRover: An automated system for extracting product information from online catalogs

Syed Toufeeq Ahmed, Srinivas Vadrevu, Hasan Davulcu

Research output: Contribution to journalArticle

1 Scopus citations

Abstract

The increasing number of e-commerce Web sites on the Web introduces numerous challenges in organizing and searching the product information across multiple Web sites. This problem is further exacerbated by various presentation templates that different Web sites use in presenting their product information, and different ways of product information they store in their catalogs. This paper describes the DataRover system, which can automatically crawl and extract all products from online catalogs. DataRover is based on pattern mining algorithms and domain specific heuristics which utilize the navigational and presentation regularities to identify taxonomy, list-of-product and single-product segments within an online catalog. Next, it uses the inferred patterns to extract data from all such data segments and to automatically transform an online catalog into a database of categorized products. We also provide experimental results to demonstrate the efficacy of the DataRover.

Original languageEnglish (US)
Pages (from-to)1-10
Number of pages10
JournalStudies in Computational Intelligence
Volume23
DOIs
StatePublished - 2006

ASJC Scopus subject areas

  • Artificial Intelligence

Fingerprint Dive into the research topics of 'DataRover: An automated system for extracting product information from online catalogs'. Together they form a unique fingerprint.

  • Cite this