Imperial College London
Portrait Picture

Professor Yujian Ye

Faculty of Engineering, Department of Electrical and Electronic Engineering

Honorary Lecturer
 
 
 
//

Contact

 

yujian.ye11

 
 
//

Location

 

1105Electrical EngineeringSouth Kensington Campus

//

Summary

 

Publications

Citation

BibTex format

@article{Qiu:2020:10.1109/TIA.2020.2984614,
author = {Qiu, D and Ye, Y and Papadaskalopoulos, D and Strbac, G},
doi = {10.1109/TIA.2020.2984614},
journal = {IEEE Transactions on Industry Applications},
title = {A Deep Reinforcement Learning Method for Pricing Electric Vehicles with Discrete Charging Levels},
url = {http://dx.doi.org/10.1109/TIA.2020.2984614},
year = {2020}
}
Download

RIS format (EndNote, RefMan)

TY  - JOUR
AB  - The effective pricing of electric vehicles (EV) charging by aggregators constitutes a key problem towards the realization of the significant EV flexibility potential in deregulated electricity systems, and has been addressed by previous work through bi-level optimization formulations. However, the solution approach adopted in previous work cannot capture the discrete nature of the EV charging / discharging levels. Although reinforcement learning (RL) can tackle this challenge, state-of-the-art RL methods require discretization of state and / or action spaces and thus exhibit limitations in terms of solution optimality and computational requirements. This paper proposes a novel deep reinforcement learning (DRL) method to solve the examined EV pricing problem, combining deep deterministic policy gradient (DDPG) principles with a prioritized experience replay (PER) strategy, and setting up the problem in multi-dimensional continuous state and action spaces. Case studies demonstrate that the proposed method outperforms state-of-the-art RL methods in terms of both solution optimality and computational requirements, and comprehensively analyze the economic impacts of smart-charging and vehicle-to-grid (V2G) flexibility on both aggregators and EV owners.
AU  - Qiu,D
AU  - Ye,Y
AU  - Papadaskalopoulos,D
AU  - Strbac,G
DO  - 10.1109/TIA.2020.2984614
PY  - 2020///
SN  - 0093-9994
TI  - A Deep Reinforcement Learning Method for Pricing Electric Vehicles with Discrete Charging Levels
T2  - IEEE Transactions on Industry Applications
UR  - http://dx.doi.org/10.1109/TIA.2020.2984614
ER  -
Download