Road to freedom in big data analytics

Divy Agrawal, Sanjay Chawla, Ahmed Elmagarmid, Zoi Kaoudi, Mourad Ouzzani, Paolo Papotti, Jorge Arnulfo Quiané-Ruiz, Nan Tang, Mohammed J. Zaki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

26 Scopus citations

Abstract

The world is fast moving towards a data-driven society where data is the most valuable asset. Organizations need to perform very diverse analytic tasks using various data processing platforms. In doing so, they face many challenges; chiefly, platform dependence, poor interoperability, and poor performance when using multiple platforms. We present Rheem, our vision for big data analytics over diverse data processing platforms. Rheem provides a threelayer data processing and storage abstraction to achieve both platform independence and interoperability across multiple platforms. In this paper, we discuss our vision as well as present multiple research challenges that we need to address to achieve it. As a case in point, we present a data cleaning application built using some of the ideas of Rheem. We show how it achieves platform independence and the performance benefits of following such an approach.

Original languageEnglish (US)
Title of host publicationAdvances in Database Technology - EDBT 2016
Subtitle of host publication19th International Conference on Extending Database Technology, Proceedings
EditorsIoana Manolescu, Evaggelia Pitoura, Amelie Marian, Sofian Maabout, Letizia Tanca, Georgia Koutrika, Kostas Stefanidis
PublisherOpenProceedings.org
Pages479-484
Number of pages6
ISBN (Electronic)9783893180707
DOIs
StatePublished - Jan 1 2016
Event19th International Conference on Extending Database Technology, EDBT 2016 - Bordeaux, France
Duration: Mar 15 2016Mar 18 2016

Publication series

NameAdvances in Database Technology - EDBT
Volume2016-March
ISSN (Electronic)2367-2005

Other

Other19th International Conference on Extending Database Technology, EDBT 2016
Country/TerritoryFrance
CityBordeaux
Period3/15/163/18/16

ASJC Scopus subject areas

  • Information Systems
  • Software
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Road to freedom in big data analytics'. Together they form a unique fingerprint.

Cite this