Distributed SPARQL over Big RDF Data

A Comparative Analysis Using Presto and MapReduce

Mulugeta Mammo, Srividya Bansal

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

The processing of large volumes of RDF data require an efficient storage and query processing engine that can scale well with the volume of data. The initial attempts to address this issue focused on optimizing native RDF stores as well as conventional relational databases management systems. But as the volume of RDF data grew to exponential proportions, the limitations of these systems became apparent and researchers began to focus on using big data analysis tools, most notably Hadoop, to process RDF data. This paper presents a comparative analysis of performance of Presto (distributed SQL query engine) in processing big RDF data against Apache Hive. To evaluate the performance Presto for big RDF data processing, a map-reduce program and a compiler, based on Flex and Bison, were implemented. The map-reduce program loads RDF data into HDFS while the compiler translates SPARQL queries into a subset of SQL that Presto (and Hive) can understand.

Original languageEnglish (US)
Title of host publicationProceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages33-40
Number of pages8
ISBN (Print)9781467372787
DOIs
StatePublished - Aug 17 2015
Event4th IEEE International Congress on Big Data, BigData Congress 2015 - New York City, United States
Duration: Jun 27 2015Jul 2 2015

Other

Other4th IEEE International Congress on Big Data, BigData Congress 2015
CountryUnited States
CityNew York City
Period6/27/157/2/15

Fingerprint

Engines
Query processing
Processing
Big data

Keywords

  • Big Data processing
  • Database Performance
  • Evaluation
  • Querying
  • Semantic Web data

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Information Systems

Cite this

Mammo, M., & Bansal, S. (2015). Distributed SPARQL over Big RDF Data: A Comparative Analysis Using Presto and MapReduce. In Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015 (pp. 33-40). [7207199] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BigDataCongress.2015.15

Distributed SPARQL over Big RDF Data : A Comparative Analysis Using Presto and MapReduce. / Mammo, Mulugeta; Bansal, Srividya.

Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015. Institute of Electrical and Electronics Engineers Inc., 2015. p. 33-40 7207199.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Mammo, M & Bansal, S 2015, Distributed SPARQL over Big RDF Data: A Comparative Analysis Using Presto and MapReduce. in Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015., 7207199, Institute of Electrical and Electronics Engineers Inc., pp. 33-40, 4th IEEE International Congress on Big Data, BigData Congress 2015, New York City, United States, 6/27/15. https://doi.org/10.1109/BigDataCongress.2015.15
Mammo M, Bansal S. Distributed SPARQL over Big RDF Data: A Comparative Analysis Using Presto and MapReduce. In Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 33-40. 7207199 https://doi.org/10.1109/BigDataCongress.2015.15
Mammo, Mulugeta ; Bansal, Srividya. / Distributed SPARQL over Big RDF Data : A Comparative Analysis Using Presto and MapReduce. Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 33-40
@inproceedings{9037d27e8f18494181d06c5051a2e1e5,
title = "Distributed SPARQL over Big RDF Data: A Comparative Analysis Using Presto and MapReduce",
abstract = "The processing of large volumes of RDF data require an efficient storage and query processing engine that can scale well with the volume of data. The initial attempts to address this issue focused on optimizing native RDF stores as well as conventional relational databases management systems. But as the volume of RDF data grew to exponential proportions, the limitations of these systems became apparent and researchers began to focus on using big data analysis tools, most notably Hadoop, to process RDF data. This paper presents a comparative analysis of performance of Presto (distributed SQL query engine) in processing big RDF data against Apache Hive. To evaluate the performance Presto for big RDF data processing, a map-reduce program and a compiler, based on Flex and Bison, were implemented. The map-reduce program loads RDF data into HDFS while the compiler translates SPARQL queries into a subset of SQL that Presto (and Hive) can understand.",
keywords = "Big Data processing, Database Performance, Evaluation, Querying, Semantic Web data",
author = "Mulugeta Mammo and Srividya Bansal",
year = "2015",
month = "8",
day = "17",
doi = "10.1109/BigDataCongress.2015.15",
language = "English (US)",
isbn = "9781467372787",
pages = "33--40",
booktitle = "Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Distributed SPARQL over Big RDF Data

T2 - A Comparative Analysis Using Presto and MapReduce

AU - Mammo, Mulugeta

AU - Bansal, Srividya

PY - 2015/8/17

Y1 - 2015/8/17

N2 - The processing of large volumes of RDF data require an efficient storage and query processing engine that can scale well with the volume of data. The initial attempts to address this issue focused on optimizing native RDF stores as well as conventional relational databases management systems. But as the volume of RDF data grew to exponential proportions, the limitations of these systems became apparent and researchers began to focus on using big data analysis tools, most notably Hadoop, to process RDF data. This paper presents a comparative analysis of performance of Presto (distributed SQL query engine) in processing big RDF data against Apache Hive. To evaluate the performance Presto for big RDF data processing, a map-reduce program and a compiler, based on Flex and Bison, were implemented. The map-reduce program loads RDF data into HDFS while the compiler translates SPARQL queries into a subset of SQL that Presto (and Hive) can understand.

AB - The processing of large volumes of RDF data require an efficient storage and query processing engine that can scale well with the volume of data. The initial attempts to address this issue focused on optimizing native RDF stores as well as conventional relational databases management systems. But as the volume of RDF data grew to exponential proportions, the limitations of these systems became apparent and researchers began to focus on using big data analysis tools, most notably Hadoop, to process RDF data. This paper presents a comparative analysis of performance of Presto (distributed SQL query engine) in processing big RDF data against Apache Hive. To evaluate the performance Presto for big RDF data processing, a map-reduce program and a compiler, based on Flex and Bison, were implemented. The map-reduce program loads RDF data into HDFS while the compiler translates SPARQL queries into a subset of SQL that Presto (and Hive) can understand.

KW - Big Data processing

KW - Database Performance

KW - Evaluation

KW - Querying

KW - Semantic Web data

UR - http://www.scopus.com/inward/record.url?scp=84959475325&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84959475325&partnerID=8YFLogxK

U2 - 10.1109/BigDataCongress.2015.15

DO - 10.1109/BigDataCongress.2015.15

M3 - Conference contribution

SN - 9781467372787

SP - 33

EP - 40

BT - Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -