Public Utility Data Liberation Project (PUDL) Data Release

PUDL v2024.10.0 Data Release This is a special early release to publish the new VCE Resource Adequacy Renewable Energy (RARE) dataset. It also includes final releases of EIA 860 and 923 data for 2023 and the FERC Form 714 data for 2021-2023, which had previously been integrated from the XBRL data published by FERC. See the release notes for more narrative detail. New Data Vibrant Clean Energy Resource Adequacy Renewable Energy (RARE) Power Dataset Integrate the VCE hourly capacity factor data for solar PV, onshore wind, and offshore wind from 2019 through 2023. The data in this table were produced by Vibrant Clean Energy, and are licensed to the public under the Creative Commons Attribution 4.0 International license (CC-BY-4.0). This data complements the WECC-wide GridPath RA Toolkit data currently incorporated into PUDL, providing capacity factor data nation-wide with a different set of modeling assumptions and a different granularity for the aggregation of outputs. See GridPath Resource Adequacy Toolkit Data and Vibrant Clean Energy Resource Adequacy Renewable Energy (RARE) Power Dataset for more information. See #3872. New Data Coverage EIA 860 Added EIA 860 final release data from 2023. See #3684 and PR #3871. EIA 923 Added EIA 923 final release data from 2023 and revised data from 2022. See #3902 and PR #3903. FERC Form 714 Integrated 2021-2023 years of the FERC Form 714 data. FERC updated its reporting format for 2021 from a CSV files to XBRL files. This update integrates the two raw data sources and extends the data coverage through 2023. See #3809 and #3842. Schema Changes Added out_eia__yearly_assn_plant_parts_plant_gen table. This table associates records from the out_eia__yearly_plant_parts with plant_gen records from that same plant parts table. See issue #3773 and PR #3774. Bug Fixes Included more retiring generators in the net generation and fuel consumption allocation. Thanks to @grgmiller for this contirbution #3690. Fixed a bug found in the rolling averages used to impute missing values in fuel_cost_per_mmbtu and to calculate capex_annual_addition_rolling. Thanks to RMI for identifying this bug! See issue #3889 and PR #3892. Major Dependency Updates Updated to use Numpy v2.0 and Splink v4.0. See issues #3736, #3735 and PRs #3547, #3834. Quality of Life Improvements We now use an asset factory to generate Dagster assets for near-identical FERC1 output tables. See #3147 and #3883. Thanks to @hfireborn and @denimalpaca for their work on this one! Other PUDL v2024.10.0 Resources PUDL v2024.10.0 Data Dictionary PUDL v2024.10.0 Documentation PUDL in the AWS Open Data Registry PUDL v2024.10.0 in a free, public AWS S3 bucket: s3://pudl.catalyst.coop/v2024.10.0/ PUDL v2024.10.0 in a requester-pays GCS bucket: gs://pudl.catalyst.coop/v2024.10.0/ Zenodo archive of the PUDL GitHub repo for this release PUDL v2024.10.0 release on GitHub PUDL v2024.10.0 package in the Python Package Index (PyPI) Contact Us If you're using PUDL, we would love to hear from you! Even if it's just a note to let us know that you exist, and how you're using the software or data. Here's a bunch of different ways to get in touch: Follow us on GitHub Use the PUDL Github issue tracker to let us know about any bugs or data issues you encounter GitHub Discussions is where we provide user support. Watch our GitHub Project to see what we're working on. Email us at [e-mail] for private communications. On Mastodon: @[e-mail] On BlueSky: @catalyst.coop On Twitter: @CatalystCoop Connect with us on LinkedIn Play with our data and notebooks on Kaggle Combine our data with ML models on HuggingFace Learn more about us on our website: https://catalyst.coop Subscribe to our announcements list for email updates.