Electrical half hourly raw and cleaned datasets for Great Britain from 2009-11-05

2021-05-05: Version 5.0.0 was created. Datetimes now in ISO 8601 format (with capital letter 'T' between the date and time) rather than previously with a space (to RFC 3339 format) and with an offset to identify both UTC and localtime. MW values now all saved as integers rather than floats. Elexon data as always from www.elexonportal.co.uk/fuelhh, National Grid data from https://data.nationalgrideso.com/demand/historic-demand-data Raw data now added again for comparison of pre and post cleaning - to allow for training of additional cleaning methods. If using Microsoft Excel, the T between the date and time can be removed using the =SUBSTITUTE() command - and substitute "T" for a space " " _____________________________________________________________________________________________________ 2021-03-02: Version 4.0.0 was created. Due to a new interconnecter (IFA2 - https://en.wikipedia.org/wiki/IFA-2) being commissioned in Q1 2021, there is an additional column with data from National Grid - this is called 'POWER_NGEM_IFA2_FLOW_MW' in the espeni dataset. In addition, National Grid has dropped the column name 'FRENCH_FLOW' that used to provide the value for the column 'POWER_NGEM_FRENCH_FLOW_MW' in previous espeni versions. However, this has been changed to 'IFA_FLOW' in National Grid's original data, which is now called 'POWER_NGEM_IFA_FLOW_MW' in the espeni dataset. Lastly, the IO14 columns have all been dropped by National Grid - and potentially unlikely to appear again in future. 2020-12-02: Version 3.0.0 was created. There was a problem with earlier versions local time format - where the +01:00 value was not carried through into the data properly. Now addressed - therefore - local time now has the format e.g. 2020-03-31 20:00:00+01:00 when in British Summer Time. 2020-10-03: Version 2.0.0 was created as it looks like National Grid has had a significant change to the methodology underpinning the embedded wind calculations. The wind profile seems similar to previous values, but with an increasing value in comparison to the value published in earlier the greater the embedded value is. The 'new' values are from https://data.nationalgrideso.com/demand/daily-demand-update from 2013. Previously: raw and cleaned datasets for Great Britain's publicly available electrical data from Elexon (www.elexonportal.co.uk) and National Grid (https://demandforecast.nationalgrid.com/efs_demand_forecast/faces/DataExplorer). Updated versions with more recent data will be uploaded with a differing version number and doi Pre-print of methodology can be downloaded from: http://arxiv.org/abs/2006.15717 All data is released in accordance with Elexon's disclaimer and reservation of rights. https://www.elexon.co.uk/using-this-website/disclaimer-and-reservation-of-rights/ This disclaimer is also felt to cover the data from National Grid, and the parsed data from the Energy Data Analytics Group at the University of Birmingham too.2021-05-05：发布5.0.0版本。本次更新将日期时间格式调整为ISO 8601标准（日期与时间之间使用大写字母'T'分隔），替代此前使用空格分隔的格式（符合RFC 3339标准），同时新增时区偏移量以同时标识协调世界时（UTC）和本地时间。所有兆瓦（MW）值现已统一以整数形式存储，而非浮点数。数据来源方面，Elexon数据一如既往取自www.elexonportal.co.uk/fuelhh，国家电网（National Grid）数据取自https://data.nationalgrideso.com/demand/historic-demand-data。本次重新加入原始数据，用于对比清洗前后的数据，以便训练更多数据清洗方法。若使用微软Excel（Microsoft Excel），可通过=SUBSTITUTE()函数将日期时间中的'T'替换为空格" "。 _____________________________________________________________________________________________________ 2021-03-02：发布4.0.0版本。由于2021年第一季度投入运行的新互联线路IFA2（可参考https://en.wikipedia.org/wiki/IFA-2），espeni数据集新增一列来自国家电网的数据，命名为`POWER_NGEM_IFA2_FLOW_MW`。此外，国家电网已弃用此前用于`POWER_NGEM_FRENCH_FLOW_MW`列的`FRENCH_FLOW`列名，该字段在国家电网原始数据中现已更改为`IFA_FLOW`，因此在espeni数据集中对应字段更名为`POWER_NGEM_IFA_FLOW_MW`。最后，国家电网已移除所有IO14相关列，未来大概率不会再恢复。 2020-12-02：发布3.0.0版本。此前版本存在本地时间格式缺陷，即+01:00时区偏移未能正确携带至数据中，现已修复。英国夏令时期间，本地时间格式现已调整为例如`2020-03-31 20:00:00+01:00`。 2020-10-03：发布2.0.0版本，此次更新源于国家电网对嵌入式风电计算的底层方法进行了重大调整。新的风电曲线与此前的数值趋势相似，但嵌入式风电值越高，与早期发布的数值相比增幅越大。本次更新的"新"数据取自2013年起的https://data.nationalgrideso.com/demand/daily-demand-update。 此前说明：本数据集为英国公开电力数据的原始与清洗后数据集，数据来源包括Elexon（www.elexonportal.co.uk）及国家电网（https://demandforecast.nationalgrid.com/efs_demand_forecast/faces/DataExplorer）。包含更多最新数据的更新版本将以不同版本号和数字对象标识符（DOI）发布。 方法学预印本可从http://arxiv.org/abs/2006.15717下载。 所有数据的发布均符合Elexon的免责声明与权利保留条款，详见https://www.elexon.co.uk/using-this-website/disclaimer-and-reservation-of-rights/。该免责声明同样适用于国家电网提供的数据，以及伯明翰大学能源数据分析组解析后的数据。