Bayesian networks for supporting query processing over incomplete autonomous databases

Rohit Raghunathan, Sushovan De, Subbarao Kambhampati

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

As the information available to naïve users through autonomous data sources continues to increase, mediators become important to ensure that the wealth of information available is tapped effectively. A key challenge that these information mediators need to handle is the varying levels of incompleteness in the underlying databases in terms of missing attribute values. Existing approaches such as QPIAD aim to mine and use Approximate Functional Dependencies (AFDs) to predict and retrieve relevant incomplete tuples. These approaches make independence assumptions about missing values-which critically hobbles their performance when there are tuples containing missing values for multiple correlated attributes. In this paper, we present a principled probabilistic alternative that views an incomplete tuple as defining a distribution over the complete tuples that it stands for. We learn this distribution in terms of Bayesian networks. Our approach involves mining/" learning" Bayesian networks from a sample of the database, and using it to do both imputation (predict a missing value) and query rewriting (retrieve relevant results with incompleteness on the query-constrained attributes, when the data sources are autonomous). We present empirical studies to demonstrate that (i) at higher levels of incompleteness, when multiple attribute values are missing, Bayesian networks do provide a significantly higher classification accuracy and (ii) the relevant possible answers retrieved by the queries reformulated using Bayesian networks provide higher precision and recall than AFDs while keeping query processing costs manageable.

Original languageEnglish (US)
Pages (from-to)595-618
Number of pages24
JournalJournal of Intelligent Information Systems
Volume42
Issue number3
DOIs
StatePublished - Jun 2014

Keywords

  • Autonomous database
  • Bayesian networks
  • Data cleaning
  • Query rewriting

ASJC Scopus subject areas

  • Software
  • Information Systems
  • Hardware and Architecture
  • Computer Networks and Communications
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Bayesian networks for supporting query processing over incomplete autonomous databases'. Together they form a unique fingerprint.

Cite this