Towards a Semantic Extract-Transform-Load (ETL) framework for big data integration

Research output: Chapter in Book/Report/Conference proceedingConference contribution

34 Citations (Scopus)

Abstract

Big Data has become the new ubiquitous term used to describe massive collection of datasets that are difficult to process using traditional database and software techniques. Most of this data is inaccessible to users, as we need technology and tools to find, transform, analyze, and visualize data in order to make it consumable for decision-making. One aspect of Big Data research is dealing with the Variety of data that includes various formats such as structured, numeric, unstructured text data, email, video, audio, stock ticker, etc. Managing, merging, and governing a variety of data is the focus of this paper. This paper proposes a semantic Extract-Transform-Load (ETL) framework that uses semantic technologies to integrate and publish data from multiple sources as open linked data. This includes - creation of a semantic data model to provide a basis for integration and understanding of knowledge from multiple sources, creation of a distributed Web of data using Resource Description Framework (RDF) as the graph data model, extraction of useful knowledge and information from the combined data using SPARQL as the semantic query language.

Original languageEnglish (US)
Title of host publicationProceedings - 2014 IEEE International Congress on Big Data, BigData Congress 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages522-529
Number of pages8
ISBN (Print)9781479950577
DOIs
StatePublished - Sep 22 2014
Event3rd IEEE International Congress on Big Data, BigData Congress 2014 - Anchorage, United States
Duration: Jun 27 2014Jul 2 2014

Other

Other3rd IEEE International Congress on Big Data, BigData Congress 2014
CountryUnited States
CityAnchorage
Period6/27/147/2/14

Fingerprint

Data integration
Semantics
Mathematical transformations
Data structures
Query languages
Electronic mail
Merging
Decision making
Big data

Keywords

  • Big data
  • Data integration
  • Ontology
  • Semantic technolgies

ASJC Scopus subject areas

  • Computer Science Applications

Cite this

Bansal, S. (2014). Towards a Semantic Extract-Transform-Load (ETL) framework for big data integration. In Proceedings - 2014 IEEE International Congress on Big Data, BigData Congress 2014 (pp. 522-529). [6906824] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BigData.Congress.2014.82

Towards a Semantic Extract-Transform-Load (ETL) framework for big data integration. / Bansal, Srividya.

Proceedings - 2014 IEEE International Congress on Big Data, BigData Congress 2014. Institute of Electrical and Electronics Engineers Inc., 2014. p. 522-529 6906824.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Bansal, S 2014, Towards a Semantic Extract-Transform-Load (ETL) framework for big data integration. in Proceedings - 2014 IEEE International Congress on Big Data, BigData Congress 2014., 6906824, Institute of Electrical and Electronics Engineers Inc., pp. 522-529, 3rd IEEE International Congress on Big Data, BigData Congress 2014, Anchorage, United States, 6/27/14. https://doi.org/10.1109/BigData.Congress.2014.82
Bansal S. Towards a Semantic Extract-Transform-Load (ETL) framework for big data integration. In Proceedings - 2014 IEEE International Congress on Big Data, BigData Congress 2014. Institute of Electrical and Electronics Engineers Inc. 2014. p. 522-529. 6906824 https://doi.org/10.1109/BigData.Congress.2014.82
Bansal, Srividya. / Towards a Semantic Extract-Transform-Load (ETL) framework for big data integration. Proceedings - 2014 IEEE International Congress on Big Data, BigData Congress 2014. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 522-529
@inproceedings{75c925fe9c7947d6896ccc7b69137971,
title = "Towards a Semantic Extract-Transform-Load (ETL) framework for big data integration",
abstract = "Big Data has become the new ubiquitous term used to describe massive collection of datasets that are difficult to process using traditional database and software techniques. Most of this data is inaccessible to users, as we need technology and tools to find, transform, analyze, and visualize data in order to make it consumable for decision-making. One aspect of Big Data research is dealing with the Variety of data that includes various formats such as structured, numeric, unstructured text data, email, video, audio, stock ticker, etc. Managing, merging, and governing a variety of data is the focus of this paper. This paper proposes a semantic Extract-Transform-Load (ETL) framework that uses semantic technologies to integrate and publish data from multiple sources as open linked data. This includes - creation of a semantic data model to provide a basis for integration and understanding of knowledge from multiple sources, creation of a distributed Web of data using Resource Description Framework (RDF) as the graph data model, extraction of useful knowledge and information from the combined data using SPARQL as the semantic query language.",
keywords = "Big data, Data integration, Ontology, Semantic technolgies",
author = "Srividya Bansal",
year = "2014",
month = "9",
day = "22",
doi = "10.1109/BigData.Congress.2014.82",
language = "English (US)",
isbn = "9781479950577",
pages = "522--529",
booktitle = "Proceedings - 2014 IEEE International Congress on Big Data, BigData Congress 2014",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Towards a Semantic Extract-Transform-Load (ETL) framework for big data integration

AU - Bansal, Srividya

PY - 2014/9/22

Y1 - 2014/9/22

N2 - Big Data has become the new ubiquitous term used to describe massive collection of datasets that are difficult to process using traditional database and software techniques. Most of this data is inaccessible to users, as we need technology and tools to find, transform, analyze, and visualize data in order to make it consumable for decision-making. One aspect of Big Data research is dealing with the Variety of data that includes various formats such as structured, numeric, unstructured text data, email, video, audio, stock ticker, etc. Managing, merging, and governing a variety of data is the focus of this paper. This paper proposes a semantic Extract-Transform-Load (ETL) framework that uses semantic technologies to integrate and publish data from multiple sources as open linked data. This includes - creation of a semantic data model to provide a basis for integration and understanding of knowledge from multiple sources, creation of a distributed Web of data using Resource Description Framework (RDF) as the graph data model, extraction of useful knowledge and information from the combined data using SPARQL as the semantic query language.

AB - Big Data has become the new ubiquitous term used to describe massive collection of datasets that are difficult to process using traditional database and software techniques. Most of this data is inaccessible to users, as we need technology and tools to find, transform, analyze, and visualize data in order to make it consumable for decision-making. One aspect of Big Data research is dealing with the Variety of data that includes various formats such as structured, numeric, unstructured text data, email, video, audio, stock ticker, etc. Managing, merging, and governing a variety of data is the focus of this paper. This paper proposes a semantic Extract-Transform-Load (ETL) framework that uses semantic technologies to integrate and publish data from multiple sources as open linked data. This includes - creation of a semantic data model to provide a basis for integration and understanding of knowledge from multiple sources, creation of a distributed Web of data using Resource Description Framework (RDF) as the graph data model, extraction of useful knowledge and information from the combined data using SPARQL as the semantic query language.

KW - Big data

KW - Data integration

KW - Ontology

KW - Semantic technolgies

UR - http://www.scopus.com/inward/record.url?scp=84923917788&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84923917788&partnerID=8YFLogxK

U2 - 10.1109/BigData.Congress.2014.82

DO - 10.1109/BigData.Congress.2014.82

M3 - Conference contribution

SN - 9781479950577

SP - 522

EP - 529

BT - Proceedings - 2014 IEEE International Congress on Big Data, BigData Congress 2014

PB - Institute of Electrical and Electronics Engineers Inc.

ER -