Open access

Electricity Load Forecasting Using Data Mining Technique

Written By

Intan Azmira binti Wan Abdul Razak, Shah bin Majid, Mohd Shahrieel bin Mohd. Aras and Arfah binti Ahmad

Submitted: 09 April 2012 Published: 12 September 2012

DOI: 10.5772/48657

From the Edited Volume

Advances in Data Mining Knowledge Discovery and Applications

Edited by Adem Karahoca

Chapter metrics overview

4,632 Chapter Downloads

View Full Metrics

1. Introduction

Accurate load forecasting is become crucial in power system operation and planning [1-3]; both for deregulated and regulated electricity market. Electric load forecasting can be divided into three categories that are short term load forecasting, medium term load forecasting and long term load forecasting. The short term load forecasting predicts the load demand from one day to several weeks. It helps to estimate load flows that can prevent overloading and hence lead to more economic and secure power system . The medium term load forecasting predicts the load demand from a month to several years that provides information for power system planning and operations. The long term load forecasting predicts the load demand from a year up to twenty years and it is mainly for power system planning [1].

A variety of methods including neural networks [2], time series [1], hybrid method [3,4] and fuzzy logic [5] have been developed for load forecasting. The time series techniques have been widely used because load behaviour can be analyzed ina time series signal with hourly, daily, weekly, and seasonal periodicities. Besides, it is able to deal with non stationary data to reflect the variation of variables [4].

However, for a huge power system covering large geographical area such as Peninsular Malaysia, a single forecasting model for the entire Malaysia would not satisfy the forecasting accuracy; due to the load and weather diversity[6]. Thus, this research will cater these conditions whereby five models of SARIMA (Seasonal ARIMA) Time Series [7,8] were developed for five day types.

Advertisement

2. Problem statement

Electric load forecasting is very important in power system operation such as during start-up and shut-down schedules of generating units as well as for overhaul planning [2] and spot market energy pricing [4]. In normal working condition, system generating capacity should meet load requirement to avoid adding generating units and importing power from the neighbouring network [9].

This research applied ARIMA time series approach to forecast future load in Peninsular Malaysia. Time series method that was introduced by Box and Jenkins is a sequence of data points that measured typically at successive times and time intervals [10].

Advertisement

3. Data mining with SARIMA time series

Before proceeding the forecasting process, load data need to be analyzed. Table 1 shows the average maximum and minimum demand, average energy and peak hour per day within a week. From the analysis, it can be concluded that the load characteristic among the days in a week is different. The average energy for Monday is slightly lower compared to Tuesday, Wednesday and Thursday. On the other hand, the average energy for those three days is fairly around 255MWh so that they can be clustered in a category. The average energy for Friday shows the lowest value within weekdays while the energy used for weekend is much lower than the consumption on weekdays. Comparing energy consumed on weekend, there is more consumption on Saturday rather than Sunday. Hence, the forecast will be conducted based on five day types that are:

Type 1: Monday

Type 2: Tuesday, Wednesday, Thursday

Type 3: Friday

Type 4: Saturday

Type 5: Sunday

DayAverage Maximum Demand (MW)Average Minimum Demand (MW)Average Energy (MWh)Peak Hour
Monday12 4427 842249.063.00 – 4.30 pm
Tuesday12 4848 526254.89
Wednesday12 5088 565255.95
Thursday12 4368 543255.03
Friday11 8848 463246.23
Saturday10 7188 122227.2611.30am – 12.00pm
Sunday10 1167 605211.018.00 – 9.00 pm

Table 1.

Load data analysis within a week

Figure 1.

Load Plot for Monday

Figure 2.

Load Plot for Tuesday, Wednesday and Thursday

Figure 3.

Load Plot for Friday

Figure 4.

Load Plot for Saturday

Figure 5.

Load Plot for Sunday

Apart from that, load plot for each day types can be observed as in Figure 1-5. Their characteristic for certain time interval can be simplified as in Table 2 (a) and (b). Referring Table 2(a) for weekday, load consumption is decreasing from time 20.00 till 00.00 and 00.30 till 04.00 where people are having some rest or sleeping at night. However, starting 04.00 till 17.00 the load consumption is increasing because people start using home appliances and go to work. The load consumption for 17.00 till 19.00 shows slight decrease as people come back to home. The next an hour show the load consumption increasing where people spend some time watching television or having a dinner. However, there are bit differences of people activities during weekend that affect load consumption.

TimeMondayTuesday – ThursdayFriday
00.30 – 04.009 100 – 8 0009 800 – 8 8009 300 – 8 500
04.00 – 17.008 000 – 12 5008 800 – 12 6008 500 – 12 300
17.00 – 19.0012 500 – 11 10012 600 – 11 10012 300 – 10 800
19.00 – 20.0011 000 – 11 70011 100 – 11 70010 800 – 11 600
20.00 – 00.0011 700 – 10 10011 700 – 10 20011 600 – 10 000
(a) Weekday
TimeSaturdaySunday
00.30 - 08.009 800 – 8 4009 000 – 7 900
08.00 – 12.008 400 – 11 30008.00 – 16.00: 7 900 – 9 400
16.00 – 18.00: 9 400 – 8 900
12.00 – 18.0011 300 – 9 800
18.00 – 21.009 800 – 10 6008 900 – 10 400
21.00 – 00.0010 600 – 9 50010 400 – 9 400
(b) Weekend

Table 2.

Load consumption per day (MW)

Five models of SARIMA were developed in Minitab which represents the five day types. ARIMA; Autoregressive Integrated Moving Average involves the filtering steps in constructing the ARIMA model until only random noise remains. ARIMA model can be classified as seasonal or non-seasonal model. The series with seasonal repeating pattern is categorized as seasonal model or seasonal ARIMA (SARIMA) while the series with random series or no seasonal repeating trend is called as non-seasonal pattern. At least four or five seasons of the data are needed to fit the SARIMA model. Instead, ARIMA modeling identifies an acceptable model by some steps which are differencing, autocorrelation and partial autocorrelation functions. A non-seasonal ARIMA model is known as an ARIMA (p, d, q) model while a seasonal ARIMA model is named as ARIMA (P, D, Q) model where P or P is the number of autoregressive term (AR), d or D is the number of non-seasonal differences and q or Q is the number of lagged forecast errors in the prediction equation (MA). Appropriate ARIMA model is determined by identifying the p, d, q and P, D, Q parameters [10].

During modelling an ARIMA, the first step is determining whether the series has a trend or not. Trend analysis determines the seasonality and stationary. The second step is determining period for the seasonal model; by plotting spectral plot in MATLAB or ACF from Minitab. Usually the period is already known and it can be seen from ACF but spectral plot will prove that assumption. The third step involved is data transformation (if any) by Box-Cox plot; depending on the value of λ as shown in Table 3.

Value of λTransformation
-1.01xt
-0.51xt
0ln Xt
0.5xt
1.0Xt

Table 3.

Box-Cox Transformation

The last step is identifying the p, d, q and P, D, Q parameters. It started by determining the order of differencing needed to stationarize the series [10]. Normally the lowest order of differencing leads time series to fluctuates around a well-defined mean value and the spikes of ACF and PACF decays fairly rapidly to zero. After chosen appropriate order of differencing, AR and MA terms are then identified to determine whether the AR and MA terms are needed to correct any autocorrelation that remains in the differenced series.

Apart from that, the best fit of the model must meet these specifications:

  1. -1.96 ≥ t-value ≥ 1.96

  2. The lowest standard deviation

  3. Chi-Square at Lag-12 is acceptable

  4. -1 ≤ Parameter’s coefficient ≤ 1

Some equations related to ARIMA model are shows in (1) to (4).

The order of d can be expressed in terms of the backshift operator B as:

d=(1B)dE1

The seasonal backshift operator;

BSzt=ztSE2

Where

S = seasonal period,

Zt = transformed data at time t

The seasonal difference operator;

SD=(1BS)DE3

Combining (1) and (3) yields:

Yt=(1B)d(1BS)DztE4

Where Yt = differenced data at time t

Advertisement

4. SARIMA modelling

4.1. ARIMA model for monday

The load data on Monday for six weeks had been plotted by trend analysis. Figure 6 shows that the data is seasonal and non-stationary so the period of the data must be identified. It can be done by plotting spectral plot in MATLAB as shown in Figure 7.

Figure 6.

Trend analysis for Monday

Figure 7.

Spectral plot

Figure 7 shows that the graph had no aliasing or crossing on x-axis; meaning that the data is suitable for an analysis. The period is determined by;

T = 1/fE5

Where T = period, and f = frequency

From Figure 8, the frequency was 0.0208 thus the period was approximately 48. This value was determined based on the half hourly load and is valid for all day types. Since the data was not stationary, the actual data must be transformed; depending on the value of λ.

Figure 8.

Enlarged view of spectral plot

Figure 9 shows the Box-Cox Plot for Monday where the value of λ = 0.562 so the rounded value is 0.5. Hence the actual data was transformed to √Xt.

Figure 9.

Box-Cox plot for Monday

Figure 10 show bad ACF (sine-cosines' phenomenon) and PACF when all parameters are zero. It is important to ensure that all the spikes are within the boundary to be a stationary model. Then the ARIMA parameters were identified and the selected model was ARIMA (2,1,1)(0,1,1)48.

Figure 10.

ACF and PACF for Monday

Figure 11-12 shows good ACF and PACF where the spikes decay fairly rapidly to zero. There was strong autocorrelation at lag-48 that shows the period of the data. All these steps were repeated for other day types.

Figure 11.

ACF Plot for ARIMA (2,1,1)(0,1,1)48 on Monday

Figure 12.

PACF Plot for ARIMA (2,1,1)(0,1,1)48 on Monday

4.2. ARIMA model for Tuesday, Wednesday and Thursday

The steps taken for modelling ARIMA for this second model were repeated as for Monday. The trend analysis for Tuesday, Wednesday and Thursday was plotted followed by Box-Cox plot. The value of λ is 0.45 thus the rounded value is 0.5. After the data had been transformed to √Xt, the fitted ARIMA model was ARIMA (1,1,1)(0,1,1)48.

Figure 13 and 14 show good ACF and PACF for selected ARIMA model where less spikes were found outside the boundary.

Figure 13.

ACF Plot for Tuesday, Wednesday and Thursday

Figure 14.

PACF Plot for Tuesday, Wednesday and Thursday

4.3. ARIMA model for Friday

The steps taken for modelling ARIMA for this third model were repeated as for two previous models. The trend analysis for Friday was plotted followed by Box-Cox plot. The trend analysis showed that the data is seasonal and non-stationary thus it must be transformed. Box-Cox plot showed that the value of λ is -0.112 and the rounded value is 0. The data was transformed to lnXt and the selected model is ARIMA (0,1,1)(0,1,1)48.

Figure 15 and 16 show good ACF and PACF for Friday model with no spikes outside the boundary.

Figure 15.

ACF Plot for Friday

Figure 16.

PACF Plot for Friday

4.4. ARIMA model for Saturday

The steps taken for modelling ARIMA for this fourth model were repeated as for three previous models. The trend analysis for Saturday was plotted followed by Box-Cox plot. The trend analysis showed that the data is seasonal and non-stationary thus it must be transformed. Box-Cox plot showed that the value of λ is 0.113 and the rounded value is 0. After the actual data had been transformed to lnXt, the selected model was ARIMA (2,1,1)(0,1,1)48.

Figure 17-18 show good ACF and PACF for Saturday with ARIMA model selected.

Figure 17.

ACF Plot for Saturday

Figure 18.

PACF Plot for Saturday

4.5. ARIMA model for Sunday

The steps taken for modelling ARIMA for this fifth model were repeated as for four previous models. The trend analysis for Sunday was plotted followed by Box-Cox plot. The trend analysis showed that the data is seasonal and non-stationary thus it must be transformed. Box-Cox plot showed that the value of λ is 0.225 and the rounded value is 0. After the actual data had been transformed to ln Xt, the selected model was ARIMA (0,1,1)(0,1,1)48.

Figure 19-20 show good ACF and PACF for the fitted model. The plots show less spikes outside the boundary after a differencing and good selection of p, P, q and Q.

Figure 19.

ACF Plot for Sunday

Figure 20.

PACF Plot for Sunday

Advertisement

5. Result and analysis

The forecasting was held for 48 points that represent a day ahead for each day types. Table 4-8 show model specifications for all day types. Referring to t-values for all models, they satisfied the condition -1.96 ≥ t-value ≥ 1.96. Besides, good standard deviations shown for all models as well as Chi-Square at Lag-12 are also acceptable. The parameters' coefficients also fulfil the condition within the range of -1 and 1.

Parameters' Coefficientt-valueStandard DeviationChi-Square at Lag-12DF
AR 1 -0.3879
AR 2 -0.2675
MA 1 0.3717
SMA 48 08382
-2.98
-2.86
2.86
13.87
82.944810.98

Table 4.

Model Specification for Monday

Parameters' Coefficientt-valueStandard DeviationChi-Square at Lag-12DF
AR 1 0.1962
MA 1 0.6848
SMA 48 0.9120
3.23
15.20
41.80
226.3199.89

Table 5.

Model Specification for Tuesday, Wednesday and Thursday

Parameters' Coefficientt-valueStandard DeviationChi-Square at Lag-12DF
MA 1 0.4878
SMA 48 0.6243
8.73
11.01
0.035591414.410

Table 6.

Model Specification for Friday

Parameters' Coefficientt-valueStandard DeviationChi-Square at Lag-12DF
AR 1 0.4083
AR 2 0.3241
MA 1 0.6491
SMA 48 0.7511
2.33
5.16
3.59
13.48
0.063271110.18

Table 7.

Model Specification for Saturday

Parameters' Coefficientt-valueStandard DeviationChi-Square at Lag-12DF
MA 1 0.5746
SMA 48 0.6823
10.81
11.77
0.059665111.910

Table 8.

Model Specification for Sunday

Figure 21.

Actual load vs. forecasted load on Monday

Figure 22.

Actual load vs. forecasted load on Tuesday, Wednesday and Thursday

Figure 23.

Actual load vs. forecasted load on Friday

Figure 24.

Actual load vs. forecasted load on Saturday

Figure 25.

Actual load vs. forecasted load on Sunday

Figure 21-25 show the plots of forecasted load vs. actual load. The forecasted load plot are seems to be close as actual load plot. Mean Absolute Percentage Error (MAPE) for all day types were calculated as in (7):

MAPE (%) =1N[|Z'txt|xt]×100%E6

Where Z’t = Forecasted Load,

Xt = Actual Load

N = Forecasting number

Table 9 shows the ARIMA models and their MAPEs for all day types. It can be seen that the difference order (d and D) for all models is 1which is the lowest order and the best selection. The result is considered as accurate when the MAPE is lower than 1.5% as shown for Tuesday –Thursday, Friday and Sunday models. The higher MAPE for Monday and Saturday models may caused by load or weather fluctuation.

DayARIMA ModelMAPE
Monday(2,1,1)(0,1,1)483.26064%
Tuesday -Thursday(1,1,1)(0,1,1)481.62094%
Friday(0,1,1)(0,1,1)481.11833 %
Saturday(2,1,1)(0,1,1)482.41944 %
Sunday(0,1,1)(0,1,1)481.07158 %

Table 9.

Forecasting result for all day types

Advertisement

6. Conclusion

From the data analysis, load data was clustered to five day types and hence five models of SARIMA are designed. Each forecasting model is developed for each day except for Tuesday, Wednesday and Thursday which clustered as a model. Forecasting method is held by Time Series - SARIMA where it is one of data mining methods which require enough experience on determining its parameter (p,d,q,P,D,Q). Sometimes it is needs for trial and error during identifying the parameters. However, the MAPEs obtained for each day types were ranging from 1% to 3%. This new approach had improved the accuracy of forecasting compared to traditional approach of ARIMA that use only a model for all days in a week.

Advertisement

7. Further research

Additional input variables can be included in the forecasting process such as weather data, customers’ classes and event day; instead of only the load data. Besides, other methods may be implemented such as Neural Network, Fuzzy Logic as well as hybrid method [11].

Advertisement

Acknowledgement

I wish to express my gratitude to honorable University (Universiti Teknikal Malaysia Melaka- UTeM) especially to Faculty of Electrical Engineering for give the financial as well as moral support. My special thanks also fall to Mr. Fuad Jamaluddin from Utility of Malaysia for his valuable advice and help during completion of this research.Also to all my research members that give full commitments and cooperation.

References

  1. 1. AzmiraI.RazakA.MajidS.RahmanH. A.Short“.TermLoad.ForecastingUsing.DataMining.Technique,”Energy.ConversionManagement2008139142
  2. 2. “Application of Pattern Recognition and Artificial Neural Network to Load Forecasting in Electric Power System,” Pattern Recognition, 2007.
  3. 3. QingleP.MinZ.Very“.Short-TermLoad.ForecastingBased.onNeural.NetworkRoughSet,”.Network201011321135
  4. 4. J.C. Hwang and C.S. Chen, “Customer Short Term Load Forecasting by Using Arima Transfer Function Model,” Electrical Engineering, pp. 317-322.
  5. 5. YeB.YanN. N.GuoC. X.CaoY. J.Identification“.ofFuzzy.Modelfor.Short-Term,”Evolution.200618
  6. 6. FanS.Y.-kangWu.W.-jenLee.C.-yinLee. “.DifferentGeographical.DistributedLoads,”.SystemsResearch.201118
  7. 7. Y.H. Kareem and A.R. Majeed, “Sulaimany Governorate Using SARIMA.,” Building,200615
  8. 8. “Robust Estimation of Sarima Models : Application to Short-Term Load Forecasting Yacine Chakhchoukh, Patrick Panciatici Versailles, France,” Signal Processing,20097780
  9. 9. BasuJ. K.BhattacharyyaD.T.-hoonKim. “.Useof.ArtificialNeural.Networkin.PatternRecognition,”.Engineeringvol.20102334
  10. 10. H.L. Willis, Power Distribution Planning Reference Book, North Carolina,USA: Marcel Dekker, Inc., 2004.
  11. 11. XuemeiL.LixingD.YuyuanD.Hybrid“.SupportVector.MachineModelA. R. I. M. A.inBuilding.CoolingPrediction,”.BuiltEnvironment.2010

Written By

Intan Azmira binti Wan Abdul Razak, Shah bin Majid, Mohd Shahrieel bin Mohd. Aras and Arfah binti Ahmad

Submitted: 09 April 2012 Published: 12 September 2012