Imperial College London
Portrait Picture

DrMingyangSun

Faculty of Engineering, Department of Electrical and Electronic Engineering

Honorary Lecturer
 
 
 
//

Contact

 

mingyang.sun11

 
 
//

Location

 

Electrical EngineeringSouth Kensington Campus

//

Summary

 

Publications

Citation

BibTex format

@article{Huyghues-Beaufond:2020:10.1016/j.apenergy.2019.114405,
author = {Huyghues-Beaufond, N and Tindemans, S and Falugi, P and Sun, M and Strbac, G},
doi = {10.1016/j.apenergy.2019.114405},
journal = {Applied Energy},
pages = {1--17},
title = {Robust and automatic data cleansing method for short-term load forecasting of distribution feeders},
url = {http://dx.doi.org/10.1016/j.apenergy.2019.114405},
volume = {261},
year = {2020}
}
Download

RIS format (EndNote, RefMan)

TY  - JOUR
AB  - Distribution networks are undergoing fundamental changes at medium voltage level. To support growing planning and control decision-making, the need for large numbers of short-term load forecasts has emerged. Data-driven modelling of medium voltage feeders can be affected by (1) data quality issues, namely, large gross errors and missing observations (2) the presence of structural breaks in the data due to occasional network reconfiguration and load transfers. The present work investigates and reports on the effects of advanced data cleansing techniques on forecast accuracy. A hybrid framework to detect and remove outliers in large datasets is proposed; this automatic procedure combines the Tukey labelling rule and the binary segmentation algorithm to cleanse data more efficiently, it is fast and easy to implement. Various approaches for missing value imputation are investigated, including unconditional mean, Hot Deck via k-nearest neighbour and Kalman smoothing. A combination of the automatic detection/removal of outliers and the imputation methods mentioned above are implemented to cleanse time series of 342 medium-voltage feeders. A nested rolling-origin-validation technique is used to evaluate the feed-forward deep neural network models. The proposed data cleansing framework efficiently removes outliers from the data, and the accuracy of forecasts is improved. It is found that Hot Deck (k-NN) imputation performs best in balancing the bias-variance trade-off for short-term forecasting.
AU  - Huyghues-Beaufond,N
AU  - Tindemans,S
AU  - Falugi,P
AU  - Sun,M
AU  - Strbac,G
DO  - 10.1016/j.apenergy.2019.114405
EP  - 17
PY  - 2020///
SN  - 0306-2619
SP  - 1
TI  - Robust and automatic data cleansing method for short-term load forecasting of distribution feeders
T2  - Applied Energy
UR  - http://dx.doi.org/10.1016/j.apenergy.2019.114405
UR  - https://www.sciencedirect.com/science/article/pii/S0306261919320926?via%3Dihub
UR  - http://hdl.handle.net/10044/1/76253
VL  - 261
ER  -
Download