A Markov decision process approach to multi-timescale scheduling and pricing in smart grids with integrated wind generation

Miao He, Sugumar Murugesan, Junshan Zhang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

In this study, we tackle the challenge of integrating volatile wind generation into the bulk power systems, by lever-aging multi-timescale scheduling and pricing with two classes of energy users - traditional energy users and opportunistic energy users (e.g., electric vehicles or smart appliances). In day-ahead scheduling, with the distributional information of wind generation and energy demands, decisions on the optimal procurement of conventional energy supply and the day-ahead retail price are made; in real-time scheduling, with the realization of wind generation, the load of traditional energy users, the real-time prices are announced to manage the demand of opportunistic energy users so as to achieve system-wide reliability. Focusing on the case when the opportunistic energy users are persistent, i.e., they stay in the system until a real-time retail price is acceptable, we formulate the scheduling problem as a multi-timescale Markov decision process with special characteristics. We then show that it can be recast, explicitly, as a classic Markov decision process with continuous state and action spaces, the solution to which can be found via standard techniques.

Original languageEnglish (US)
Title of host publication2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2011
Pages125-128
Number of pages4
DOIs
StatePublished - 2011
Event2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2011 - San Juan, Puerto Rico
Duration: Dec 13 2011Dec 16 2011

Other

Other2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2011
CountryPuerto Rico
CitySan Juan
Period12/13/1112/16/11

Fingerprint

Scheduling
Costs
Electric vehicles
Aging of materials

ASJC Scopus subject areas

  • Computer Networks and Communications

Cite this

He, M., Murugesan, S., & Zhang, J. (2011). A Markov decision process approach to multi-timescale scheduling and pricing in smart grids with integrated wind generation. In 2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2011 (pp. 125-128). [6135903] https://doi.org/10.1109/CAMSAP.2011.6135903

A Markov decision process approach to multi-timescale scheduling and pricing in smart grids with integrated wind generation. / He, Miao; Murugesan, Sugumar; Zhang, Junshan.

2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2011. 2011. p. 125-128 6135903.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

He, M, Murugesan, S & Zhang, J 2011, A Markov decision process approach to multi-timescale scheduling and pricing in smart grids with integrated wind generation. in 2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2011., 6135903, pp. 125-128, 2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2011, San Juan, Puerto Rico, 12/13/11. https://doi.org/10.1109/CAMSAP.2011.6135903
He M, Murugesan S, Zhang J. A Markov decision process approach to multi-timescale scheduling and pricing in smart grids with integrated wind generation. In 2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2011. 2011. p. 125-128. 6135903 https://doi.org/10.1109/CAMSAP.2011.6135903
He, Miao ; Murugesan, Sugumar ; Zhang, Junshan. / A Markov decision process approach to multi-timescale scheduling and pricing in smart grids with integrated wind generation. 2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2011. 2011. pp. 125-128
@inproceedings{4f4ca1546ee74061a82900116c553b42,
title = "A Markov decision process approach to multi-timescale scheduling and pricing in smart grids with integrated wind generation",
abstract = "In this study, we tackle the challenge of integrating volatile wind generation into the bulk power systems, by lever-aging multi-timescale scheduling and pricing with two classes of energy users - traditional energy users and opportunistic energy users (e.g., electric vehicles or smart appliances). In day-ahead scheduling, with the distributional information of wind generation and energy demands, decisions on the optimal procurement of conventional energy supply and the day-ahead retail price are made; in real-time scheduling, with the realization of wind generation, the load of traditional energy users, the real-time prices are announced to manage the demand of opportunistic energy users so as to achieve system-wide reliability. Focusing on the case when the opportunistic energy users are persistent, i.e., they stay in the system until a real-time retail price is acceptable, we formulate the scheduling problem as a multi-timescale Markov decision process with special characteristics. We then show that it can be recast, explicitly, as a classic Markov decision process with continuous state and action spaces, the solution to which can be found via standard techniques.",
author = "Miao He and Sugumar Murugesan and Junshan Zhang",
year = "2011",
doi = "10.1109/CAMSAP.2011.6135903",
language = "English (US)",
isbn = "9781457721052",
pages = "125--128",
booktitle = "2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2011",

}

TY - GEN

T1 - A Markov decision process approach to multi-timescale scheduling and pricing in smart grids with integrated wind generation

AU - He, Miao

AU - Murugesan, Sugumar

AU - Zhang, Junshan

PY - 2011

Y1 - 2011

N2 - In this study, we tackle the challenge of integrating volatile wind generation into the bulk power systems, by lever-aging multi-timescale scheduling and pricing with two classes of energy users - traditional energy users and opportunistic energy users (e.g., electric vehicles or smart appliances). In day-ahead scheduling, with the distributional information of wind generation and energy demands, decisions on the optimal procurement of conventional energy supply and the day-ahead retail price are made; in real-time scheduling, with the realization of wind generation, the load of traditional energy users, the real-time prices are announced to manage the demand of opportunistic energy users so as to achieve system-wide reliability. Focusing on the case when the opportunistic energy users are persistent, i.e., they stay in the system until a real-time retail price is acceptable, we formulate the scheduling problem as a multi-timescale Markov decision process with special characteristics. We then show that it can be recast, explicitly, as a classic Markov decision process with continuous state and action spaces, the solution to which can be found via standard techniques.

AB - In this study, we tackle the challenge of integrating volatile wind generation into the bulk power systems, by lever-aging multi-timescale scheduling and pricing with two classes of energy users - traditional energy users and opportunistic energy users (e.g., electric vehicles or smart appliances). In day-ahead scheduling, with the distributional information of wind generation and energy demands, decisions on the optimal procurement of conventional energy supply and the day-ahead retail price are made; in real-time scheduling, with the realization of wind generation, the load of traditional energy users, the real-time prices are announced to manage the demand of opportunistic energy users so as to achieve system-wide reliability. Focusing on the case when the opportunistic energy users are persistent, i.e., they stay in the system until a real-time retail price is acceptable, we formulate the scheduling problem as a multi-timescale Markov decision process with special characteristics. We then show that it can be recast, explicitly, as a classic Markov decision process with continuous state and action spaces, the solution to which can be found via standard techniques.

UR - http://www.scopus.com/inward/record.url?scp=84863129631&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84863129631&partnerID=8YFLogxK

U2 - 10.1109/CAMSAP.2011.6135903

DO - 10.1109/CAMSAP.2011.6135903

M3 - Conference contribution

SN - 9781457721052

SP - 125

EP - 128

BT - 2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2011

ER -