Interactive Data Repairing

the FALCON Dive

Enzo Veltri, Donatello Santoro, Giansalvatore Mecca, Paolo Papotti, Jian He, Gouliang Li, Nan Tang

Research output: Contribution to journalConference article

Abstract

In this paper we discuss Falcon, an interactive, deterministic, and declarative data cleaning system. Unlike traditional rule-based system, Falcon does not rely on the existence of a set of pre-defined data quality rules, but it encourages users to explore the data, identify possible problems, and make updates to fix them. The main technical challenge consists in finding a set of rules, expressed as sql update queries, that are semantically correct and that fixes the largest number of errors in the data. Falcon navigates the lattice by interacting with users to gradually checking the correctness of a set of rules. We have conducted extensive experiments using both real-world and synthetic datasets to show that Falcon can effectively communicate with users in data repairing.

Original languageEnglish (US)
JournalCEUR Workshop Proceedings
Volume2037
StatePublished - Jan 1 2017

Fingerprint

Knowledge based systems
Cleaning
Experiments

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Veltri, E., Santoro, D., Mecca, G., Papotti, P., He, J., Li, G., & Tang, N. (2017). Interactive Data Repairing: the FALCON Dive. CEUR Workshop Proceedings, 2037.

Interactive Data Repairing : the FALCON Dive. / Veltri, Enzo; Santoro, Donatello; Mecca, Giansalvatore; Papotti, Paolo; He, Jian; Li, Gouliang; Tang, Nan.

In: CEUR Workshop Proceedings, Vol. 2037, 01.01.2017.

Research output: Contribution to journalConference article

Veltri, E, Santoro, D, Mecca, G, Papotti, P, He, J, Li, G & Tang, N 2017, 'Interactive Data Repairing: the FALCON Dive', CEUR Workshop Proceedings, vol. 2037.
Veltri E, Santoro D, Mecca G, Papotti P, He J, Li G et al. Interactive Data Repairing: the FALCON Dive. CEUR Workshop Proceedings. 2017 Jan 1;2037.
Veltri, Enzo ; Santoro, Donatello ; Mecca, Giansalvatore ; Papotti, Paolo ; He, Jian ; Li, Gouliang ; Tang, Nan. / Interactive Data Repairing : the FALCON Dive. In: CEUR Workshop Proceedings. 2017 ; Vol. 2037.
@article{5e1d86eec0ed4293afba93c92abf19ee,
title = "Interactive Data Repairing: the FALCON Dive",
abstract = "In this paper we discuss Falcon, an interactive, deterministic, and declarative data cleaning system. Unlike traditional rule-based system, Falcon does not rely on the existence of a set of pre-defined data quality rules, but it encourages users to explore the data, identify possible problems, and make updates to fix them. The main technical challenge consists in finding a set of rules, expressed as sql update queries, that are semantically correct and that fixes the largest number of errors in the data. Falcon navigates the lattice by interacting with users to gradually checking the correctness of a set of rules. We have conducted extensive experiments using both real-world and synthetic datasets to show that Falcon can effectively communicate with users in data repairing.",
author = "Enzo Veltri and Donatello Santoro and Giansalvatore Mecca and Paolo Papotti and Jian He and Gouliang Li and Nan Tang",
year = "2017",
month = "1",
day = "1",
language = "English (US)",
volume = "2037",
journal = "CEUR Workshop Proceedings",
issn = "1613-0073",

}

TY - JOUR

T1 - Interactive Data Repairing

T2 - the FALCON Dive

AU - Veltri, Enzo

AU - Santoro, Donatello

AU - Mecca, Giansalvatore

AU - Papotti, Paolo

AU - He, Jian

AU - Li, Gouliang

AU - Tang, Nan

PY - 2017/1/1

Y1 - 2017/1/1

N2 - In this paper we discuss Falcon, an interactive, deterministic, and declarative data cleaning system. Unlike traditional rule-based system, Falcon does not rely on the existence of a set of pre-defined data quality rules, but it encourages users to explore the data, identify possible problems, and make updates to fix them. The main technical challenge consists in finding a set of rules, expressed as sql update queries, that are semantically correct and that fixes the largest number of errors in the data. Falcon navigates the lattice by interacting with users to gradually checking the correctness of a set of rules. We have conducted extensive experiments using both real-world and synthetic datasets to show that Falcon can effectively communicate with users in data repairing.

AB - In this paper we discuss Falcon, an interactive, deterministic, and declarative data cleaning system. Unlike traditional rule-based system, Falcon does not rely on the existence of a set of pre-defined data quality rules, but it encourages users to explore the data, identify possible problems, and make updates to fix them. The main technical challenge consists in finding a set of rules, expressed as sql update queries, that are semantically correct and that fixes the largest number of errors in the data. Falcon navigates the lattice by interacting with users to gradually checking the correctness of a set of rules. We have conducted extensive experiments using both real-world and synthetic datasets to show that Falcon can effectively communicate with users in data repairing.

UR - http://www.scopus.com/inward/record.url?scp=85041447513&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85041447513&partnerID=8YFLogxK

M3 - Conference article

VL - 2037

JO - CEUR Workshop Proceedings

JF - CEUR Workshop Proceedings

SN - 1613-0073

ER -