Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
SlideShare a Scribd company logo
New Clustering-based Forecasting Method for
Disaggregated End-consumer Electricity Load
Using Smart Grid Data
Peter Laurinec, and Mária Lucká
14.11.2017
Slovak University of Technology in Bratislava
Motivation
More accurate forecast of electricity consumption is needed due to:
• Optimization of electricity consumption.
• Distribution (utility) companies. Deregulation of the market.
Purchase and sale of electricity.
• Ecological factors.
However, it is very difficult task for individual end-consumers due to:
• Stochastic behaviour (processes).
• Many factors influencing the consumption:
• Seasonality
• Weather
• Holidays
• Market
1
Example of consumers electricity load
20
40
60
0 250 500 750 1000
Time (3 weeks)
Load(kW)
2
Example of consumers electricity load
3.0
3.5
4.0
4.5
0 250 500 750 1000
Time (3 weeks)
Load(kW)
3
Example of consumers electricity load
0.0
2.5
5.0
7.5
10.0
12.5
0 250 500 750 1000
Time (3 weeks)
Load(kW)
4
Example of consumers electricity load - residential
0
1
2
3
0 250 500 750 1000
Time (3 weeks)
Load(kW)
5
Classical vs. our approach
The classical way is to train a model for every consumer
separately (drawbacks).
Our approach uses data from all consumers in a smart grid to
overcome stochastic changes and noisy character of data (time
series).
Solution: clustering of all consumers.
6
Our method
We will suppose that N is a number of consumers, the length of the training set is 21
days (3 weeks) whereby in every day we will consider 24 × 2 = 48 measurements, and
we will execute one hour ahead forecasts.
1. Starting with iteration iter = 0.
2. Creating of time series for each consumer of the lengths of three weeks.
3. Normalisation of each time series by z-score (keeping a mean and a standard
deviation in memory for every time series).
4. Computation of representations of each time series.
5. K-means clustering of representations and an optimal number of clusters is
computed.
6. The extraction of K centroids and using them as training set to any forecasting
method.
7. The denormalisation of K forecasts using the stored mean and standard
deviation to produce N forecasts.
8. iter = iter + 1. If iter is divisible by 24 (iter mod 24 = 0 mod 24) then steps 4) and
5) are performed otherwise they are skipped and the stored centroids are used.
7
Representation of time series
After normalisation -> computation of representations of time
series.
We conducted from our previous works 1 that clustering
model-based representations significantly improves accuracy
of the forecast of the global (aggregate) consumption.
For a representation, regression coefficients from the multiple
linear regression is used. The linear model is composed of
daily and weekly seasonal parameters.
xt = βd1utd1 + · · · + βdsutds + βw1utw1 + · · · + βw6utw6 + εt
1
Laurinec et al., WCECS (2016) and ICDMW (2016)
8
Representation of time series
−1
0
1
2
3
0 250 500 750 1000
Length
NormalizedLoad
Original Time Series
Daily Period
Weekly
Period
−1
0
1
0 20 40
Length
RegressionCoefficients
Final Representation of Time Series
9
Clustering
17 18 19 20
13 14 15 16
9 10 11 12
5 6 7 8
1 2 3 4
0 20 40 0 20 40 0 20 40 0 20 40
−1
0
1
2
3
−2
−1
0
1
2
3
−2
0
2
−2
0
2
−2
−1
0
1
2
3
−1
0
1
2
−3
−2
−1
0
1
2
−2
0
2
−2
−1
0
1
2
0
2
4
−2
0
2
4
−1
0
1
2
−2
0
2
4
−2
0
2
−2
−1
0
1
2
3
−1
0
1
2
−1
0
1
2
3
0
2
4
−2
−1
0
1
2
−2
−1
0
1
2
Length
RegressionCoefficients
10
Final centroids
17 18 19 20
13 14 15 16
9 10 11 12
5 6 7 8
1 2 3 4
0 250 500 750 1000 0 250 500 750 1000 0 250 500 750 1000 0 250 500 750 1000
−0.5
0.0
0.5
1.0
1.5
−1.5
−1.0
−0.5
0.0
0.5
1.0
−0.50
−0.25
0.00
0.25
−1
0
1
−1.0
−0.5
0.0
0.5
−1.0
−0.5
0.0
0.5
1.0
−1.0
−0.5
0.0
0.5
−1.0
−0.5
0.0
0.5
1.0
−1.0
−0.5
0.0
0.5
1.0
−0.5
0.0
0.5
1.0
0
1
0
1
2
−0.5
0.0
0.5
−1.0
−0.5
0.0
0.5
1.0
−0.5
0.0
0.5
1.0
1.5
0
1
0
1
2
0
1
2
3
4
5
−1.0
−0.5
0.0
0.5
1.0
−1
0
1
Time
NormalizedLoad
11
Forecasting methods
Four methods were implemented
• Seasonal naive method (SNAIVE)
• Multiple Linear Regression (MLR)
• Random Forest (RF)
• Triple exponential smoothing (ES)
MAE (Mean Absolute Error):
1
n
n∑
t=1
|xt − xt|,
where xt is a real consumption, xt is the forecasted load and n
is a length of data.
12
Scaling forecasts
Denormalising K centroid-based forecasts by stored mean and
standard deviation from every consumer (N).
13
Data for experiments
We used two different datasets consisting of a large number of
variable patterns that were gathered from smart meters. This
measurement data includes Irish and Slovak electricity load
data.
For the Irish residential testing dataset (3639 consumers) the
data measurements from 1.2.2010 to 21.2.2010.
For the Slovak factories testing dataset (3607 consumers) the
data measurements from 10.2.2014 to 2.3.2014.
14
Evaluation
MAE Ireland dataset
Mean Median Max
SNAIVE_DisAgg 0.3807 ± 0.203 0.1928 ± 0.147 3.014 ± 1.3
SNAIVE_Clust 0.3373 ± 0.178 0.235 ± 0.143 2.6605 ± 1.192
MLR_Clust 0.3403 ± 0.18 0.2394 ± 0.146 2.6453 ± 1.187
RF_Clust 0.3394 ± 0.18 0.2425 ± 0.147 2.675 ± 1.192
ES_Clust 0.3359 ± 0.177 0.2387 ± 0.144 2.6629 ± 1.189
MAE Slovak dataset
Mean Median Max
SNAIVE_DisAgg 2.6903 ± 2.854 1.769 ± 2.27 16.1599 ± 14.621
SNAIVE_Clust 2.7873 ± 2.858 2.1479 ± 2.452 14.0958 ± 12.711
MLR_Clust 2.9326 ± 2.984 2.3109 ± 2.612 14.0306 ± 12.673
RF_Clust 2.7639 ± 2.836 2.0765 ± 2.388 14.4476 ± 13.081
ES_Clust 2.6752 ± 2.771 2.0283 ± 2.357 14.1695 ± 12.816
15
Ireland dataset results
0
1
2
3
4
5
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Hour
MAE
Method
ES_Clust
MLR_Clust
RF_Clust
SNAIVE_Clust
SNAIVE_DisAgg
16
Slovak dataset results
0
20
40
60
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Hour
MAE
Method
ES_Clust
MLR_Clust
RF_Clust
SNAIVE_Clust
SNAIVE_DisAgg
17
Conclusion
• Newly proposed clustering-based forecasting method for end-consumer load
using all data from a smart grid.
• We proved that our clustering-based method decreases the forecasting error in
the meaning of an average and the maximum (high rates of error).
• However, the error rates did not decrease with respect to the median because
of the nature of smart meter data.
• Our method needs to train only K models (in our case about 28) instead of N
models (thousands) that is leading to a huge decrease of the computational
load.
Future work:
• More experiments to find the number of optimal clusters.
• Other centroid-based clustering methods like K-medians, K-medoids and Fuzzy
C-means can be also used.
18

More Related Content

Similar to New Clustering-based Forecasting Method for Disaggregated End-consumer Electricity Load Using Smart Grid Data

Peter Laurinec: Clustering Electricity Consumers & Prediction, PyData Bratisl...
Peter Laurinec: Clustering Electricity Consumers & Prediction, PyData Bratisl...Peter Laurinec: Clustering Electricity Consumers & Prediction, PyData Bratisl...
Peter Laurinec: Clustering Electricity Consumers & Prediction, PyData Bratisl...
GapData Institute
 
IPPTChap010.pptx
IPPTChap010.pptxIPPTChap010.pptx
IPPTChap010.pptx
QuangLong44
 
Project 1
Project 1Project 1
Project 1
Herbert Hand
 
Statr session 25 and 26
Statr session 25 and 26Statr session 25 and 26
Statr session 25 and 26
Ruru Chowdhury
 
A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn...
 A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn... A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn...
A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn...
Pooyan Jamshidi
 
Wavelet bootstrap Multiple linear regression models
Wavelet bootstrap Multiple linear regression modelsWavelet bootstrap Multiple linear regression models
Wavelet bootstrap Multiple linear regression models
Vinit Sehgal
 
Forecasting Assignment Help
Forecasting Assignment HelpForecasting Assignment Help
Forecasting Assignment Help
HelpWithAssignment.com
 
DigitalGlobe Overview
DigitalGlobe OverviewDigitalGlobe Overview
DigitalGlobe Overview
CIMMYT
 
Writing Sample
Writing SampleWriting Sample
Writing Sample
Yiqun Li
 
Statistical Inference.pdf
Statistical Inference.pdfStatistical Inference.pdf
Statistical Inference.pdf
MuhammadFaizan389
 
Inverted Energy: Diesel Generator Set Replacement
Inverted Energy: Diesel Generator Set Replacement Inverted Energy: Diesel Generator Set Replacement
Inverted Energy: Diesel Generator Set Replacement
Inverted2019
 
Unit Commitment
Unit CommitmentUnit Commitment
Unit Commitment
rohitdasari
 
Projectproposalon10mwsolarpvpowerplant 160312085340 (2)
Projectproposalon10mwsolarpvpowerplant 160312085340 (2)Projectproposalon10mwsolarpvpowerplant 160312085340 (2)
Projectproposalon10mwsolarpvpowerplant 160312085340 (2)
Muzaffar Ahmad
 
Project Proposal on 10 MW Solar PV Power Plant
Project Proposal on 10 MW Solar PV Power PlantProject Proposal on 10 MW Solar PV Power Plant
Project Proposal on 10 MW Solar PV Power Plant
Vignesh Sekar
 
T2K status in 2017
T2K status in 2017T2K status in 2017
T2K status in 2017
Son Cao
 
Presentation
PresentationPresentation
Presentation
imran shafee
 
Statistical quality control
Statistical quality controlStatistical quality control
Statistical quality control
Sai Datri Arige
 
Push And Pull Production Systems Chap7 Ppt)
Push And Pull Production Systems   Chap7 Ppt)Push And Pull Production Systems   Chap7 Ppt)
Push And Pull Production Systems Chap7 Ppt)
3abooodi
 
Energy saving policies final
Energy saving policies finalEnergy saving policies final
Energy saving policies final
Alejandro Fernandez-Montes
 
SOLAR TRAINING.pptx.pdf
SOLAR TRAINING.pptx.pdfSOLAR TRAINING.pptx.pdf
SOLAR TRAINING.pptx.pdf
AmitKumar497267
 

Similar to New Clustering-based Forecasting Method for Disaggregated End-consumer Electricity Load Using Smart Grid Data (20)

Peter Laurinec: Clustering Electricity Consumers & Prediction, PyData Bratisl...
Peter Laurinec: Clustering Electricity Consumers & Prediction, PyData Bratisl...Peter Laurinec: Clustering Electricity Consumers & Prediction, PyData Bratisl...
Peter Laurinec: Clustering Electricity Consumers & Prediction, PyData Bratisl...
 
IPPTChap010.pptx
IPPTChap010.pptxIPPTChap010.pptx
IPPTChap010.pptx
 
Project 1
Project 1Project 1
Project 1
 
Statr session 25 and 26
Statr session 25 and 26Statr session 25 and 26
Statr session 25 and 26
 
A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn...
 A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn... A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn...
A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn...
 
Wavelet bootstrap Multiple linear regression models
Wavelet bootstrap Multiple linear regression modelsWavelet bootstrap Multiple linear regression models
Wavelet bootstrap Multiple linear regression models
 
Forecasting Assignment Help
Forecasting Assignment HelpForecasting Assignment Help
Forecasting Assignment Help
 
DigitalGlobe Overview
DigitalGlobe OverviewDigitalGlobe Overview
DigitalGlobe Overview
 
Writing Sample
Writing SampleWriting Sample
Writing Sample
 
Statistical Inference.pdf
Statistical Inference.pdfStatistical Inference.pdf
Statistical Inference.pdf
 
Inverted Energy: Diesel Generator Set Replacement
Inverted Energy: Diesel Generator Set Replacement Inverted Energy: Diesel Generator Set Replacement
Inverted Energy: Diesel Generator Set Replacement
 
Unit Commitment
Unit CommitmentUnit Commitment
Unit Commitment
 
Projectproposalon10mwsolarpvpowerplant 160312085340 (2)
Projectproposalon10mwsolarpvpowerplant 160312085340 (2)Projectproposalon10mwsolarpvpowerplant 160312085340 (2)
Projectproposalon10mwsolarpvpowerplant 160312085340 (2)
 
Project Proposal on 10 MW Solar PV Power Plant
Project Proposal on 10 MW Solar PV Power PlantProject Proposal on 10 MW Solar PV Power Plant
Project Proposal on 10 MW Solar PV Power Plant
 
T2K status in 2017
T2K status in 2017T2K status in 2017
T2K status in 2017
 
Presentation
PresentationPresentation
Presentation
 
Statistical quality control
Statistical quality controlStatistical quality control
Statistical quality control
 
Push And Pull Production Systems Chap7 Ppt)
Push And Pull Production Systems   Chap7 Ppt)Push And Pull Production Systems   Chap7 Ppt)
Push And Pull Production Systems Chap7 Ppt)
 
Energy saving policies final
Energy saving policies finalEnergy saving policies final
Energy saving policies final
 
SOLAR TRAINING.pptx.pdf
SOLAR TRAINING.pptx.pdfSOLAR TRAINING.pptx.pdf
SOLAR TRAINING.pptx.pdf
 

Recently uploaded

Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...
Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...
Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...
mparmparousiskostas
 
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
PsychoTech Services
 
Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
Call Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call GirlCall Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call Girl
Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
sapna sharmap11
 
CAP Excel Formulas & Functions July - Copy (4).pdf
CAP Excel Formulas & Functions July - Copy (4).pdfCAP Excel Formulas & Functions July - Copy (4).pdf
CAP Excel Formulas & Functions July - Copy (4).pdf
frp60658
 
Bangalore ℂall Girl 000000 Bangalore Escorts Service
Bangalore ℂall Girl 000000 Bangalore Escorts ServiceBangalore ℂall Girl 000000 Bangalore Escorts Service
Bangalore ℂall Girl 000000 Bangalore Escorts Service
nhero3888
 
Hyderabad Call Girls Service 🔥 9352988975 🔥 High Profile Call Girls Hyderabad
Hyderabad Call Girls Service 🔥 9352988975 🔥 High Profile Call Girls HyderabadHyderabad Call Girls Service 🔥 9352988975 🔥 High Profile Call Girls Hyderabad
Hyderabad Call Girls Service 🔥 9352988975 🔥 High Profile Call Girls Hyderabad
2004kavitajoshi
 
202406 - Cape Town Snowflake User Group - LLM & RAG.pdf
202406 - Cape Town Snowflake User Group - LLM & RAG.pdf202406 - Cape Town Snowflake User Group - LLM & RAG.pdf
202406 - Cape Town Snowflake User Group - LLM & RAG.pdf
Douglas Day
 
_Lufthansa Airlines MIA Terminal (1).pdf
_Lufthansa Airlines MIA Terminal (1).pdf_Lufthansa Airlines MIA Terminal (1).pdf
_Lufthansa Airlines MIA Terminal (1).pdf
rc76967005
 
machine learning notes by Andrew Ng and Tengyu Ma
machine learning notes by Andrew Ng and Tengyu Mamachine learning notes by Andrew Ng and Tengyu Ma
machine learning notes by Andrew Ng and Tengyu Ma
Vijayabaskar Uthirapathy
 
High Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENT
High Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENTHigh Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENT
High Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENT
ranjeet3341
 
Direct Lake Deep Dive slides from Fabric Engineering Roadshow
Direct Lake Deep Dive slides from Fabric Engineering RoadshowDirect Lake Deep Dive slides from Fabric Engineering Roadshow
Direct Lake Deep Dive slides from Fabric Engineering Roadshow
Gabi Münster
 
Salesforce AI + Data Community Tour Slides - Canarias
Salesforce AI + Data Community Tour Slides - CanariasSalesforce AI + Data Community Tour Slides - Canarias
Salesforce AI + Data Community Tour Slides - Canarias
davidpietrzykowski1
 
PCI-DSS-Data Security Standard v4.0.1.pdf
PCI-DSS-Data Security Standard v4.0.1.pdfPCI-DSS-Data Security Standard v4.0.1.pdf
PCI-DSS-Data Security Standard v4.0.1.pdf
incitbe
 
一比一原版(sfu学位证书)西蒙弗雷泽大学毕业证如何办理
一比一原版(sfu学位证书)西蒙弗雷泽大学毕业证如何办理一比一原版(sfu学位证书)西蒙弗雷泽大学毕业证如何办理
一比一原版(sfu学位证书)西蒙弗雷泽大学毕业证如何办理
gebegu
 
Hyderabad Call Girls 7339748667 With Free Home Delivery At Your Door
Hyderabad Call Girls 7339748667 With Free Home Delivery At Your DoorHyderabad Call Girls 7339748667 With Free Home Delivery At Your Door
Hyderabad Call Girls 7339748667 With Free Home Delivery At Your Door
Russian Escorts in Delhi 9711199171 with low rate Book online
 
06-20-2024-AI Camp Meetup-Unstructured Data and Vector Databases
06-20-2024-AI Camp Meetup-Unstructured Data and Vector Databases06-20-2024-AI Camp Meetup-Unstructured Data and Vector Databases
06-20-2024-AI Camp Meetup-Unstructured Data and Vector Databases
Timothy Spann
 
🔥Mature Women / Aunty Call Girl Chennai 💯Call Us 🔝 8094342248 🔝💃Top Class Cal...
🔥Mature Women / Aunty Call Girl Chennai 💯Call Us 🔝 8094342248 🔝💃Top Class Cal...🔥Mature Women / Aunty Call Girl Chennai 💯Call Us 🔝 8094342248 🔝💃Top Class Cal...
🔥Mature Women / Aunty Call Girl Chennai 💯Call Us 🔝 8094342248 🔝💃Top Class Cal...
shivangimorya083
 
saps4hanaandsapanalyticswheretodowhat1565272000538.pdf
saps4hanaandsapanalyticswheretodowhat1565272000538.pdfsaps4hanaandsapanalyticswheretodowhat1565272000538.pdf
saps4hanaandsapanalyticswheretodowhat1565272000538.pdf
newdirectionconsulta
 
Health care analysis using sentimental analysis
Health care analysis using sentimental analysisHealth care analysis using sentimental analysis
Health care analysis using sentimental analysis
krishnasrigannavarap
 
Call Girls Lucknow 8923113531 Independent Call Girl Service in Lucknow
Call Girls Lucknow 8923113531 Independent Call Girl Service in LucknowCall Girls Lucknow 8923113531 Independent Call Girl Service in Lucknow
Call Girls Lucknow 8923113531 Independent Call Girl Service in Lucknow
hiju9823
 

Recently uploaded (20)

Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...
Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...
Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...
 
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
 
Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
Call Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call GirlCall Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call Girl
Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
 
CAP Excel Formulas & Functions July - Copy (4).pdf
CAP Excel Formulas & Functions July - Copy (4).pdfCAP Excel Formulas & Functions July - Copy (4).pdf
CAP Excel Formulas & Functions July - Copy (4).pdf
 
Bangalore ℂall Girl 000000 Bangalore Escorts Service
Bangalore ℂall Girl 000000 Bangalore Escorts ServiceBangalore ℂall Girl 000000 Bangalore Escorts Service
Bangalore ℂall Girl 000000 Bangalore Escorts Service
 
Hyderabad Call Girls Service 🔥 9352988975 🔥 High Profile Call Girls Hyderabad
Hyderabad Call Girls Service 🔥 9352988975 🔥 High Profile Call Girls HyderabadHyderabad Call Girls Service 🔥 9352988975 🔥 High Profile Call Girls Hyderabad
Hyderabad Call Girls Service 🔥 9352988975 🔥 High Profile Call Girls Hyderabad
 
202406 - Cape Town Snowflake User Group - LLM & RAG.pdf
202406 - Cape Town Snowflake User Group - LLM & RAG.pdf202406 - Cape Town Snowflake User Group - LLM & RAG.pdf
202406 - Cape Town Snowflake User Group - LLM & RAG.pdf
 
_Lufthansa Airlines MIA Terminal (1).pdf
_Lufthansa Airlines MIA Terminal (1).pdf_Lufthansa Airlines MIA Terminal (1).pdf
_Lufthansa Airlines MIA Terminal (1).pdf
 
machine learning notes by Andrew Ng and Tengyu Ma
machine learning notes by Andrew Ng and Tengyu Mamachine learning notes by Andrew Ng and Tengyu Ma
machine learning notes by Andrew Ng and Tengyu Ma
 
High Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENT
High Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENTHigh Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENT
High Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENT
 
Direct Lake Deep Dive slides from Fabric Engineering Roadshow
Direct Lake Deep Dive slides from Fabric Engineering RoadshowDirect Lake Deep Dive slides from Fabric Engineering Roadshow
Direct Lake Deep Dive slides from Fabric Engineering Roadshow
 
Salesforce AI + Data Community Tour Slides - Canarias
Salesforce AI + Data Community Tour Slides - CanariasSalesforce AI + Data Community Tour Slides - Canarias
Salesforce AI + Data Community Tour Slides - Canarias
 
PCI-DSS-Data Security Standard v4.0.1.pdf
PCI-DSS-Data Security Standard v4.0.1.pdfPCI-DSS-Data Security Standard v4.0.1.pdf
PCI-DSS-Data Security Standard v4.0.1.pdf
 
一比一原版(sfu学位证书)西蒙弗雷泽大学毕业证如何办理
一比一原版(sfu学位证书)西蒙弗雷泽大学毕业证如何办理一比一原版(sfu学位证书)西蒙弗雷泽大学毕业证如何办理
一比一原版(sfu学位证书)西蒙弗雷泽大学毕业证如何办理
 
Hyderabad Call Girls 7339748667 With Free Home Delivery At Your Door
Hyderabad Call Girls 7339748667 With Free Home Delivery At Your DoorHyderabad Call Girls 7339748667 With Free Home Delivery At Your Door
Hyderabad Call Girls 7339748667 With Free Home Delivery At Your Door
 
06-20-2024-AI Camp Meetup-Unstructured Data and Vector Databases
06-20-2024-AI Camp Meetup-Unstructured Data and Vector Databases06-20-2024-AI Camp Meetup-Unstructured Data and Vector Databases
06-20-2024-AI Camp Meetup-Unstructured Data and Vector Databases
 
🔥Mature Women / Aunty Call Girl Chennai 💯Call Us 🔝 8094342248 🔝💃Top Class Cal...
🔥Mature Women / Aunty Call Girl Chennai 💯Call Us 🔝 8094342248 🔝💃Top Class Cal...🔥Mature Women / Aunty Call Girl Chennai 💯Call Us 🔝 8094342248 🔝💃Top Class Cal...
🔥Mature Women / Aunty Call Girl Chennai 💯Call Us 🔝 8094342248 🔝💃Top Class Cal...
 
saps4hanaandsapanalyticswheretodowhat1565272000538.pdf
saps4hanaandsapanalyticswheretodowhat1565272000538.pdfsaps4hanaandsapanalyticswheretodowhat1565272000538.pdf
saps4hanaandsapanalyticswheretodowhat1565272000538.pdf
 
Health care analysis using sentimental analysis
Health care analysis using sentimental analysisHealth care analysis using sentimental analysis
Health care analysis using sentimental analysis
 
Call Girls Lucknow 8923113531 Independent Call Girl Service in Lucknow
Call Girls Lucknow 8923113531 Independent Call Girl Service in LucknowCall Girls Lucknow 8923113531 Independent Call Girl Service in Lucknow
Call Girls Lucknow 8923113531 Independent Call Girl Service in Lucknow
 

New Clustering-based Forecasting Method for Disaggregated End-consumer Electricity Load Using Smart Grid Data

  • 1. New Clustering-based Forecasting Method for Disaggregated End-consumer Electricity Load Using Smart Grid Data Peter Laurinec, and Mária Lucká 14.11.2017 Slovak University of Technology in Bratislava
  • 2. Motivation More accurate forecast of electricity consumption is needed due to: • Optimization of electricity consumption. • Distribution (utility) companies. Deregulation of the market. Purchase and sale of electricity. • Ecological factors. However, it is very difficult task for individual end-consumers due to: • Stochastic behaviour (processes). • Many factors influencing the consumption: • Seasonality • Weather • Holidays • Market 1
  • 3. Example of consumers electricity load 20 40 60 0 250 500 750 1000 Time (3 weeks) Load(kW) 2
  • 4. Example of consumers electricity load 3.0 3.5 4.0 4.5 0 250 500 750 1000 Time (3 weeks) Load(kW) 3
  • 5. Example of consumers electricity load 0.0 2.5 5.0 7.5 10.0 12.5 0 250 500 750 1000 Time (3 weeks) Load(kW) 4
  • 6. Example of consumers electricity load - residential 0 1 2 3 0 250 500 750 1000 Time (3 weeks) Load(kW) 5
  • 7. Classical vs. our approach The classical way is to train a model for every consumer separately (drawbacks). Our approach uses data from all consumers in a smart grid to overcome stochastic changes and noisy character of data (time series). Solution: clustering of all consumers. 6
  • 8. Our method We will suppose that N is a number of consumers, the length of the training set is 21 days (3 weeks) whereby in every day we will consider 24 × 2 = 48 measurements, and we will execute one hour ahead forecasts. 1. Starting with iteration iter = 0. 2. Creating of time series for each consumer of the lengths of three weeks. 3. Normalisation of each time series by z-score (keeping a mean and a standard deviation in memory for every time series). 4. Computation of representations of each time series. 5. K-means clustering of representations and an optimal number of clusters is computed. 6. The extraction of K centroids and using them as training set to any forecasting method. 7. The denormalisation of K forecasts using the stored mean and standard deviation to produce N forecasts. 8. iter = iter + 1. If iter is divisible by 24 (iter mod 24 = 0 mod 24) then steps 4) and 5) are performed otherwise they are skipped and the stored centroids are used. 7
  • 9. Representation of time series After normalisation -> computation of representations of time series. We conducted from our previous works 1 that clustering model-based representations significantly improves accuracy of the forecast of the global (aggregate) consumption. For a representation, regression coefficients from the multiple linear regression is used. The linear model is composed of daily and weekly seasonal parameters. xt = βd1utd1 + · · · + βdsutds + βw1utw1 + · · · + βw6utw6 + εt 1 Laurinec et al., WCECS (2016) and ICDMW (2016) 8
  • 10. Representation of time series −1 0 1 2 3 0 250 500 750 1000 Length NormalizedLoad Original Time Series Daily Period Weekly Period −1 0 1 0 20 40 Length RegressionCoefficients Final Representation of Time Series 9
  • 11. Clustering 17 18 19 20 13 14 15 16 9 10 11 12 5 6 7 8 1 2 3 4 0 20 40 0 20 40 0 20 40 0 20 40 −1 0 1 2 3 −2 −1 0 1 2 3 −2 0 2 −2 0 2 −2 −1 0 1 2 3 −1 0 1 2 −3 −2 −1 0 1 2 −2 0 2 −2 −1 0 1 2 0 2 4 −2 0 2 4 −1 0 1 2 −2 0 2 4 −2 0 2 −2 −1 0 1 2 3 −1 0 1 2 −1 0 1 2 3 0 2 4 −2 −1 0 1 2 −2 −1 0 1 2 Length RegressionCoefficients 10
  • 12. Final centroids 17 18 19 20 13 14 15 16 9 10 11 12 5 6 7 8 1 2 3 4 0 250 500 750 1000 0 250 500 750 1000 0 250 500 750 1000 0 250 500 750 1000 −0.5 0.0 0.5 1.0 1.5 −1.5 −1.0 −0.5 0.0 0.5 1.0 −0.50 −0.25 0.00 0.25 −1 0 1 −1.0 −0.5 0.0 0.5 −1.0 −0.5 0.0 0.5 1.0 −1.0 −0.5 0.0 0.5 −1.0 −0.5 0.0 0.5 1.0 −1.0 −0.5 0.0 0.5 1.0 −0.5 0.0 0.5 1.0 0 1 0 1 2 −0.5 0.0 0.5 −1.0 −0.5 0.0 0.5 1.0 −0.5 0.0 0.5 1.0 1.5 0 1 0 1 2 0 1 2 3 4 5 −1.0 −0.5 0.0 0.5 1.0 −1 0 1 Time NormalizedLoad 11
  • 13. Forecasting methods Four methods were implemented • Seasonal naive method (SNAIVE) • Multiple Linear Regression (MLR) • Random Forest (RF) • Triple exponential smoothing (ES) MAE (Mean Absolute Error): 1 n n∑ t=1 |xt − xt|, where xt is a real consumption, xt is the forecasted load and n is a length of data. 12
  • 14. Scaling forecasts Denormalising K centroid-based forecasts by stored mean and standard deviation from every consumer (N). 13
  • 15. Data for experiments We used two different datasets consisting of a large number of variable patterns that were gathered from smart meters. This measurement data includes Irish and Slovak electricity load data. For the Irish residential testing dataset (3639 consumers) the data measurements from 1.2.2010 to 21.2.2010. For the Slovak factories testing dataset (3607 consumers) the data measurements from 10.2.2014 to 2.3.2014. 14
  • 16. Evaluation MAE Ireland dataset Mean Median Max SNAIVE_DisAgg 0.3807 ± 0.203 0.1928 ± 0.147 3.014 ± 1.3 SNAIVE_Clust 0.3373 ± 0.178 0.235 ± 0.143 2.6605 ± 1.192 MLR_Clust 0.3403 ± 0.18 0.2394 ± 0.146 2.6453 ± 1.187 RF_Clust 0.3394 ± 0.18 0.2425 ± 0.147 2.675 ± 1.192 ES_Clust 0.3359 ± 0.177 0.2387 ± 0.144 2.6629 ± 1.189 MAE Slovak dataset Mean Median Max SNAIVE_DisAgg 2.6903 ± 2.854 1.769 ± 2.27 16.1599 ± 14.621 SNAIVE_Clust 2.7873 ± 2.858 2.1479 ± 2.452 14.0958 ± 12.711 MLR_Clust 2.9326 ± 2.984 2.3109 ± 2.612 14.0306 ± 12.673 RF_Clust 2.7639 ± 2.836 2.0765 ± 2.388 14.4476 ± 13.081 ES_Clust 2.6752 ± 2.771 2.0283 ± 2.357 14.1695 ± 12.816 15
  • 17. Ireland dataset results 0 1 2 3 4 5 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Hour MAE Method ES_Clust MLR_Clust RF_Clust SNAIVE_Clust SNAIVE_DisAgg 16
  • 18. Slovak dataset results 0 20 40 60 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Hour MAE Method ES_Clust MLR_Clust RF_Clust SNAIVE_Clust SNAIVE_DisAgg 17
  • 19. Conclusion • Newly proposed clustering-based forecasting method for end-consumer load using all data from a smart grid. • We proved that our clustering-based method decreases the forecasting error in the meaning of an average and the maximum (high rates of error). • However, the error rates did not decrease with respect to the median because of the nature of smart meter data. • Our method needs to train only K models (in our case about 28) instead of N models (thousands) that is leading to a huge decrease of the computational load. Future work: • More experiments to find the number of optimal clusters. • Other centroid-based clustering methods like K-medians, K-medoids and Fuzzy C-means can be also used. 18