Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Version History

« Previous Version 40 Next »

Model updated 8th May 2024

Summary

The retraining process resulted in two new models, one for PD and one for 7day price forecast. After experimentation we retrained the price forecasting models using existing features and hyper parameter settings. The increase in accuracy (using Absolute Mean Error, AME) was approximately 4%. (see validation results table below comparing the previous models with the new models).

Training period

Both PD and 7day price forecast models were trained on data between 01-04-2021 and 08-04-2024.

The market suspension period and a period after the Callide explosion were removed from the training data.

Validation set

The model was validated by predicting the price between 09-04-2024 and 30-04-2024.

New features (input data) exceptions

  • The feature set is the same as the previous model. The main benefit of the new model is that more recent market data are consumed in the training process. The training does not weight the most recent market data.

    • A number of experiments were conducted by changing the feature list and some hyper parameters however this didn’t not achieve a significant benefit to the model tests. Hence for consistency we have not made changes to the model other than extending the training period to the most recent market data.

Predispatch model

p7day model

Model_id

20240503_090016_CB_2

20240503_085256_CB_7D_2

Previous model release date

5th February 2024

5th February 2024

Latest release date (after retraining)

6th May 2024

6th May 2024

Machine Learning Algorithm

Ensemble predictor: gradient boosting

Ensemble predictor: gradient boosting

Training Period

1st A2021 to 8th April 2024

1st April 2021 to 8th April 2024

Hyper-parameter type

A

A

Hyper-parameter notes

No weighting across time periods

No weighting across time periods

Target

Dispatchprice (30min resolution)

Dispatchprice (30min resolution)

Input (and training) variables

PREDISPATCHPRICE

rrp

DISPATCHPRICE

last 3 day average actual RRP for same time

PREDISPATCHREGIONSUM (intervention = 0)

hours_out

time_of_day

day_type (weekday_or_weekend)

dispatchableload

netinterchage

(availablegeneration - uigf)

(dispatchablegeneration - scheduled_clearedmw)

ss_solar_clearedmw

ss_solar_uigf

ss_wind_clearedmw

ss_wind_uigf

totaldemand

totalintermittentgeneration

STPASA_REGIONSOLUTION

hours_out

time_of_day

day_type (weekday_or_weekend)

aggregatepasaavailability

aggregatescheduledload

netinterchangeunderscarcity

aggregatecapacityavailable

ss_solar_cleared

ss_wind_uigf

ss_wind_cleared

ss_solar_uigf

demand10

demand50

totalintermittentgeneration

demand_and_nonschedgen

Validation Results

These are the results of the best model generated through our experimentation process and compares the results with the previous model across our validation set (our test period).

Note that errors are considerably higher because the validation set was unusually volatile.

Average error is equal to Predication minus real prices.

All error metrics are in $/MWhr.

PD Results

Metric/

Region

Actual Mean Price

Mean Prediction New Model

Mean Prediction Previous Model

Absolute Mean Error New Model

Absolute Mean Error Previous Model

Average Error New Model

Average Error Previous Model

NSW1

98.65

105.38

106.44

27.53

28.56

6.73

7.79

QLD1

88.52

99.05

100.32

26.59

27.49

10.54

11.81

SA1

89.87

86.48

83.97

31.39

31.13

-3.39

-5.90

TAS1

81.32

82.95

86.90

29.14

32.99

1.63

5.58

VIC1

92.66

84.51

82.98

28.64

29.14

-8.14

-9.68

7 Day Results

Metric/

Region

Actual Mean Price

Mean Prediction New Model

Mean Prediction Previous Model

Absolute Mean Error New Model

Absolute Mean Error Previous Model

Average Error New Model

Average Error Previous Model

NSW1

94.66

88.83

82.20

29.92

31.71

-5.82

-12.45

QLD1

83.54

80.40

73.41

29.42

30.35

-3.14

-10.13

SA1

86.50

110.71

91.75

58.95

51.48

24.20

5.25

TAS1

80.56

71.65

70.37

31.70

35.30

-8.91

-10.19

VIC1

89.89

78.89

68.39

37.20

39.75

-11.00

-21.50

Variables that imply binding interconnectors (such as limits and marginal values) are currently not included as features.


  • No labels