Optimal Electric Vehicle Charging Strategy with Markov Decision Process and Reinforcement Learning Technique

Tao Ding*, Ziyu Zeng, Jiawen Bai, Boyu Qin, Yongheng Yang, Mohammad Shahidehpour

*Corresponding author

Research output: Contribution to journalJournal articleResearchpeer-review

136 Downloads (Pure)

Abstract

Electric vehicles (EVs) have rapidly developed in recent years and their penetration has also significantly increased, which, however, brings new challenges to power systems. Due to their stochastic behaviors, the improper charging strategies for EVs may violate the voltage security region. To address this problem, an optimal EV charging strategy in a distribution network is proposed to maximize the profit of the distribution system operators while satisfying all the physical constraints. When dealing with the uncertainties from EVs, a Markov decision process model is built to characterize the time series of the uncertainties, and then the deep deterministic policy gradient based reinforcement learning technique is utilized to analyze the impact of uncertainties on the charging strategy. Finally, numerical results verify the effectiveness of the proposed method.

Original languageEnglish
Article number9076876
JournalI E E E Transactions on Industry Applications
Volume56
Issue number5
Pages (from-to)5811-5823
Number of pages13
ISSN0093-9994
DOIs
Publication statusPublished - Sep 2020

Keywords

  • Electric vehicle (EV)
  • Markov decision process (MDP)
  • optimal charging strategy
  • reinforcement learning (RL).

Fingerprint Dive into the research topics of 'Optimal Electric Vehicle Charging Strategy with Markov Decision Process and Reinforcement Learning Technique'. Together they form a unique fingerprint.

Cite this