Public Utility Data Liberation Project (PUDL) Data Release
收藏资源简介:
v2025.7.0 (2025-07-03) This release integrates early release annual 2024 data for the EIA Forms 860 and 923, as well as fresh EIA 860M monthly data. It also includes a few small bug-fixes, some of which result in minor changes to the database schema. It also removes the deprecated PudlTabl output management class. We are experimenting a new monthly release schedule for PUDL, to keep the EIA 860M data as fresh as possible. This is the first of those monthly releases. New Data EIA AEO Extracted table 2 from the EIA Annual Energy Outlook 2023, which includes future projections for energy use through the year 2050 across a variety of scenarios. Integrated a subset of available table 2 series as a new core table: core_eiaaeo__yearly_projected_energy_use_by_sector_and_type contains projected energy use for the commercial, electric power, industrial, residential, and transportation sectors across different fuels and electricity modes. See #4228 and #4273. Expanded Data Coverage EIA 860 Added EIA 860 early release data from 2024. See #4323 and PR #4332. EIA 860M Added EIA 860M data from April 2025. See #4324 and PR #4332. EIA 923 Added EIA 923 early release data from 2024 and monthly data from March 2025. See #4325 and PR #4332. Bug Fixes Fixed a number of typos in our documentation and codebase, which resulted in renaming synchronized_transmission_grid in core_eia860__scd_generators, out_eia__monthly_generators, and out_eia__yearly_generators. See issue #3783 and #4355. VCE RARE Standardized place_name using data from the latest Census PEP vintage, found in _core_censuspep__yearly_geocodes. See issue #3914 and PR #4319. Deprecations After more than a year of deprecation warnings, we’ve removed the PudlTabl output management class, and have stopped distributing a handful of tables that were only around to allow the behavior of that class to be maintained. See issues #3215, #2911 and PR #4316. Undeploy superset, given that we are going with Marimo for our usage metrics dashboards, and the Eel Hole for publicly facing data access. See PR #4353. Quality of Life Improvements We’ve added a new sub-command to dbt_helper - dbt_helper validate. This lets you run validation tests for a selection of DBT models and also see what the failing outputs are, instead of doing a bunch of digging after the fact. We’ve added a new devtool in devtools/materialize_to_parquet.py - this lets you export and share assets that were previously not persisted to Parquet, such as raw assets that have been extracted but not cleaned. Run ./materialize_to_parquet --help from within the devtools directory for details. See #4320. New Tests Added a validation pipeline for our EIA 930 hourly demand imputation. This pipeline will perform imputation on a set of values which did not require imputation, so there is ground truth data to compare against. It will then compute the percent error for all of these imputed values against the reported data. This metric is checked during nightly builds and will result in an error if it ever drifts too high. Other PUDL v2025.7.0 Resources PUDL v2025.7.0 Data Dictionary PUDL v2025.7.0 Documentation PUDL in the AWS Open Data Registry PUDL v2025.7.0 in a free, public AWS S3 bucket: s3://pudl.catalyst.coop/v2025.7.0/ PUDL v2025.7.0 in a requester-pays GCS bucket: gs://pudl.catalyst.coop/v2025.7.0/ Zenodo archive of the PUDL GitHub repo for this release PUDL v2025.7.0 release on GitHub PUDL v2025.7.0 package in the Python Package Index (PyPI) Contact Us If you're using PUDL, we would love to hear from you! Even if it's just a note to let us know that you exist, and how you're using the software or data. Here's a bunch of different ways to get in touch: Follow us on GitHub Use the PUDL Github issue tracker to let us know about any bugs or data issues you encounter GitHub Discussions is where we provide user support. Watch our GitHub Project to see what we're working on. Email us at hello@catalyst.coop for private communications. On Mastodon: @CatalystCoop@mastodon.energy On BlueSky: @catalyst.coop On Twitter: @CatalystCoop Connect with us on LinkedIn Play with our data and notebooks on Kaggle Combine our data with ML models on HuggingFace Learn more about us on our website: https://catalyst.coop Subscribe to our announcements list for email updates.



