Public Utility Data Liberation Project (PUDL) Data Release
收藏资源简介:
v2025.11.0 (2025-11-13) This is a quarterly PUDL data release, and includes final 2024 data for a number of annually reported EIA forms, as well as quarterly updates to data sources that are released more continuously, like EIA-930, bulk EIA electricity API data, EPA CEMS hourly emissions and EIA-860M. We’re also beginning to integrate natural gas data, and have made some performance improvements that will hopefully make it easier for contributors run the full ETL locally. See below for all the details. New Data EIA-176 Thanks to open source contributions from SwitchBox and funding from the NSF POSE program that helps us support outside contributors, we’re beginning to integrate natural gas data into PUDL, starting with the EIA Form 176. Follow the sub-issues listed in issue #4693 to track our progress. Added core_eia176__yearly_gas_disposition_by_consumer, which contains cleaned natural gas disposition data from Part 6 of EIA-176. Thanks to @MeadBarrel for all your work on this. See issues #4694, #4709 and PRs #4737, #4721, #4728. Discontinued Data NREL ATB for Electricity Sadly, no update to NREL’s Annual Technology Baseline for Electricity has been published for 2025. Historically this dataset has been updated in the summer, and would be integrated into PUDL’s Q3 release. It seems as if it may have been quietly discontinued or at least deprioritized. We will continue to check for updates and integrate them if they become available. If you know of alternative public sources for this kind of forward-looking electricity sector cost projections, please let us know! Expanded Data Coverage Census PEP Expanded geocodes to include vintages for each year from 2011-2024. See issue #4637 and PR #4665. EIA AEO Added economic projections from the 2025 AEO. See issue #4591 and PR #4631. EIA-860M Updated EIA-860M with monthly data through September 2025. See #4698 and #4706. EIA-861 Added EIA-861 final release data from 2024. See #4648 and PR #4672. EIA-923 Updated EIA-923 with final release data from 2024 and 2025 data through August. See PR #4641, #4699 and #4706. EIA-930 Updated EIA-930 with data published through the end of October 2025. See #4719 and PR #4743. EIA Bulk Electricity API Updated the EIA Bulk Electricity API data to include data published through the beginning of November 2025. See #4724 and PR #4725. EPA/CAMD-EIA Crosswalk Updated EPA/CAMD-EIA crosswalk through 2024. See PR #4749. EPA CEMS Updated EPA CEMS hourly emissions data through September 2025. See #4723 and #4733. FERC Form 1 Updated FERC Form 1 2024 data to include late respondents. See #4747. Documentation Added data source pages for: EIA Annual Energy Outlook (AEO); see issue #4371 and PR #4660. EIA Form 176 – Annual Report of Natural and Supplemental Gas Supply and Disposition; see issue #4696 and PR #4746. Bug Fixes Fixed a bug where the EIA 930 subregion data from 2018-07-01 to 2019-01-01 was being dropped. See PR #4731. Dev Tooling As part of a performance push, we added some tools for quick memory profiling of asset materialization. See issue #4619 and PR #4655. We are no longer relying on Dask dataframes for processing data larger than memory. We’ve started using Polars and DuckDB instead. For now this primarily affects the very large EPA Hourly Continuous Emission Monitoring System (CEMS) dataset, but we anticipate using these tools in other contexts to address performance bottlenecks. See issue #4663 and PR #4676 for the conversion of EPA CEMS from Dask to Polars. We also added devtools/check_against_nightly.py to quickly compare local Parquet outputs with those from the nightly builds. Other PUDL v2025.11.0 Resources PUDL v2025.11.0 Data Dictionary PUDL v2025.11.0 Documentation PUDL in the AWS Open Data Registry PUDL v2025.11.0 in a free, public AWS S3 bucket: s3://pudl.catalyst.coop/v2025.11.0/ PUDL v2025.11.0 in a requester-pays GCS bucket: gs://pudl.catalyst.coop/v2025.11.0/ Zenodo archive of the PUDL GitHub repo for this release PUDL v2025.11.0 release on GitHub PUDL v2025.11.0 package in the Python Package Index (PyPI) Contact Us If you're using PUDL, we would love to hear from you! Even if it's just a note to let us know that you exist, and how you're using the software or data. Here's a bunch of different ways to get in touch: Follow us on GitHub Use the PUDL Github issue tracker to let us know about any bugs or data issues you encounter GitHub Discussions is where we provide user support. Watch our GitHub Project to see what we're working on. Email us at hello@catalyst.coop for private communications. On Mastodon: @CatalystCoop@mastodon.energy On BlueSky: @catalyst.coop On Twitter: @CatalystCoop Connect with us on LinkedIn Play with our data and notebooks on Kaggle Combine our data with ML models on HuggingFace Learn more about us on our website: https://catalyst.coop Subscribe to our announcements list for email updates.



