Big data and deep learning platform for terabyte-scale renewable datasets

Yang Weng, Abhishek Kumar, Muhammad B. Saleem, Baosen Zhang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Many renewable resources cover diverse geographical areas and it is increasingly important to analyze large sets of data to understand their spatial and temporal behaviors. In this paper, we propose and demonstrate a data platform to efficiently manipulate and visualize data on the scale of terabytes. As the application of interest, we focus on visualization and forecasting of wind power over large geographic areas at various different spatial and temporal resolutions. In particular, we show how to balance the amount of data used and the need for computational efficiency in real-time applications. The main data set we use is the recently released terabyte wind dataset by NREL.

Original languageEnglish (US)
Title of host publication20th Power Systems Computation Conference, PSCC 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Print)9781910963104
DOIs
StatePublished - Aug 20 2018
Event20th Power Systems Computation Conference, PSCC 2018 - Dublin, Ireland
Duration: Jun 11 2018Jun 15 2018

Other

Other20th Power Systems Computation Conference, PSCC 2018
CountryIreland
CityDublin
Period6/11/186/15/18

Fingerprint

Computational efficiency
Wind power
Visualization
Big data
Deep learning

Keywords

  • Big data analytics
  • Cloud platform
  • Feature extraction
  • Forecasting
  • Renewable generation

ASJC Scopus subject areas

  • Energy Engineering and Power Technology
  • Computer Networks and Communications
  • Safety, Risk, Reliability and Quality

Cite this

Weng, Y., Kumar, A., Saleem, M. B., & Zhang, B. (2018). Big data and deep learning platform for terabyte-scale renewable datasets. In 20th Power Systems Computation Conference, PSCC 2018 [8442536] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.23919/PSCC.2018.8442536

Big data and deep learning platform for terabyte-scale renewable datasets. / Weng, Yang; Kumar, Abhishek; Saleem, Muhammad B.; Zhang, Baosen.

20th Power Systems Computation Conference, PSCC 2018. Institute of Electrical and Electronics Engineers Inc., 2018. 8442536.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Weng, Y, Kumar, A, Saleem, MB & Zhang, B 2018, Big data and deep learning platform for terabyte-scale renewable datasets. in 20th Power Systems Computation Conference, PSCC 2018., 8442536, Institute of Electrical and Electronics Engineers Inc., 20th Power Systems Computation Conference, PSCC 2018, Dublin, Ireland, 6/11/18. https://doi.org/10.23919/PSCC.2018.8442536
Weng Y, Kumar A, Saleem MB, Zhang B. Big data and deep learning platform for terabyte-scale renewable datasets. In 20th Power Systems Computation Conference, PSCC 2018. Institute of Electrical and Electronics Engineers Inc. 2018. 8442536 https://doi.org/10.23919/PSCC.2018.8442536
Weng, Yang ; Kumar, Abhishek ; Saleem, Muhammad B. ; Zhang, Baosen. / Big data and deep learning platform for terabyte-scale renewable datasets. 20th Power Systems Computation Conference, PSCC 2018. Institute of Electrical and Electronics Engineers Inc., 2018.
@inproceedings{365d572da7014624ab4b87505e229286,
title = "Big data and deep learning platform for terabyte-scale renewable datasets",
abstract = "Many renewable resources cover diverse geographical areas and it is increasingly important to analyze large sets of data to understand their spatial and temporal behaviors. In this paper, we propose and demonstrate a data platform to efficiently manipulate and visualize data on the scale of terabytes. As the application of interest, we focus on visualization and forecasting of wind power over large geographic areas at various different spatial and temporal resolutions. In particular, we show how to balance the amount of data used and the need for computational efficiency in real-time applications. The main data set we use is the recently released terabyte wind dataset by NREL.",
keywords = "Big data analytics, Cloud platform, Feature extraction, Forecasting, Renewable generation",
author = "Yang Weng and Abhishek Kumar and Saleem, {Muhammad B.} and Baosen Zhang",
year = "2018",
month = "8",
day = "20",
doi = "10.23919/PSCC.2018.8442536",
language = "English (US)",
isbn = "9781910963104",
booktitle = "20th Power Systems Computation Conference, PSCC 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Big data and deep learning platform for terabyte-scale renewable datasets

AU - Weng, Yang

AU - Kumar, Abhishek

AU - Saleem, Muhammad B.

AU - Zhang, Baosen

PY - 2018/8/20

Y1 - 2018/8/20

N2 - Many renewable resources cover diverse geographical areas and it is increasingly important to analyze large sets of data to understand their spatial and temporal behaviors. In this paper, we propose and demonstrate a data platform to efficiently manipulate and visualize data on the scale of terabytes. As the application of interest, we focus on visualization and forecasting of wind power over large geographic areas at various different spatial and temporal resolutions. In particular, we show how to balance the amount of data used and the need for computational efficiency in real-time applications. The main data set we use is the recently released terabyte wind dataset by NREL.

AB - Many renewable resources cover diverse geographical areas and it is increasingly important to analyze large sets of data to understand their spatial and temporal behaviors. In this paper, we propose and demonstrate a data platform to efficiently manipulate and visualize data on the scale of terabytes. As the application of interest, we focus on visualization and forecasting of wind power over large geographic areas at various different spatial and temporal resolutions. In particular, we show how to balance the amount of data used and the need for computational efficiency in real-time applications. The main data set we use is the recently released terabyte wind dataset by NREL.

KW - Big data analytics

KW - Cloud platform

KW - Feature extraction

KW - Forecasting

KW - Renewable generation

UR - http://www.scopus.com/inward/record.url?scp=85054040634&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85054040634&partnerID=8YFLogxK

U2 - 10.23919/PSCC.2018.8442536

DO - 10.23919/PSCC.2018.8442536

M3 - Conference contribution

SN - 9781910963104

BT - 20th Power Systems Computation Conference, PSCC 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -