遇见数据集

Public Utility Data Liberation Project (PUDL) Data Release

收藏
Zenodo2025-10-15 更新2026-05-26 收录
官方服务:

资源简介:

v2025.10.0 (2025-10-14) This is a regular monthly data release, primarily intended to ensure that PUDL has the most up-to-date EIA-860M data. It also happens to include final EIA-860 data for 2024, and some newly integrated EIA-923 financial data and PHMSA natural gas data. See below for details. Expanded Data Coverage EIA-860 Updated EIA-860 with final release data from 2024. See issue #4616 and PR #4617. EIA-860M Updated EIA-860M monthly generator report with newly published data for August of 2025. See issue #4639 and PR #4638. New Data PHMSA Added eight transformed table containing annual data from PHMSA natural gas distributors from 1970 to the present. Note that these containing mostly numeric values are named as _core - indicating that these tables have not been fully cleaned and validated. We’ve published these tables to make the 50+ years of PHMSA data we’ve extracted and mapped available for others to use and for contributors to more easily improve incrementally. See #3770 and #4005. The first cleaned table, core_phmsagas__distribution_operators has been added to our PUDL database. Thanks to @seeess1 for all of your work on this! EIA 923 Thanks to contributions from @alexclippinger, we’ve added cleaned EIA923 Schedule 8B Financial Information to the PUDL database as _core_eia923__yearly_byproduct_expenses_and_revenues. Once harvested, this table will be replaced with a well-normalized version of the same data, but it is being published in this form until then. See #4099 and #2448, and #4636. Documentation Added data source pages for: Population Estimates Program's (PEP) Federal Information Processing Series (FIPS) Codes; see issue #4375 and PR #4622. U.S. Securities and Exchange Commission (SEC) Form 10-K; see issue #4329, #4347 and PR #4562. New Data Tests & Data Validations After investigating some modest discrepancies between our imputed hourly electricity demand and prior work by @truggles & @awongel, we’re removing the “EXPERIMENTAL” warning label that we had on those tables. See our discussion about the imputation results in the PUDL Examples repo. The associated notebook is available on Kaggle This relates to the PUDL imputed demand values in following tables: out_eia930__hourly_operations out_eia930__hourly_subregion_demand out_eia930__hourly_aggregated_demand Deprecations We have finally shut down our long-suffering Datasette deployment, but are still working on achieiving feature parity in the new PUDL Data Viewer. We have an epic tracking our progress. See issue #4481 and PR #4605 for the removal of Datasette references within the main PUDL repo. Other PUDL v2025.10.0 Resources PUDL v2025.10.0 Data Dictionary PUDL v2025.10.0 Documentation PUDL in the AWS Open Data Registry PUDL v2025.9.1 in a free, public AWS S3 bucket: s3://pudl.catalyst.coop/v2025.10.0/ PUDL v2025.9.1 in a requester-pays GCS bucket: gs://pudl.catalyst.coop/v2025.10.0/ Zenodo archive of the PUDL GitHub repo for this release PUDL v2025.10.0 release on GitHub PUDL v2025.10.0 package in the Python Package Index (PyPI) Contact Us If you're using PUDL, we would love to hear from you! Even if it's just a note to let us know that you exist, and how you're using the software or data. Here's a bunch of different ways to get in touch: Follow us on GitHub Use the PUDL Github issue tracker to let us know about any bugs or data issues you encounter GitHub Discussions is where we provide user support. Watch our GitHub Project to see what we're working on. Email us at hello@catalyst.coop for private communications. On Mastodon: @CatalystCoop@mastodon.energy On BlueSky: @catalyst.coop On Twitter: @CatalystCoop Connect with us on LinkedIn Play with our data and notebooks on Kaggle Combine our data with ML models on HuggingFace Learn more about us on our website: https://catalyst.coop Subscribe to our announcements list for email updates.

v2025.10.0(2025年10月14日) 本版本为常规月度数据发布,核心目标是确保PUDL数据集拥有最新的美国能源信息署(Energy Information Administration, EIA)-860M月度数据。本次发布同时包含2024年最终版EIA-860数据,以及新整合的EIA-923财务数据与美国管道和危险材料安全管理局(Pipeline and Hazardous Materials Safety Administration, PHMSA)天然气相关数据。详情如下。 ### 数据覆盖范围拓展 #### EIA-860 更新了2024年最终发布版的EIA-860数据。相关信息参见议题#4616与拉取请求#4617。 #### EIA-860M 更新了EIA-860M月度发电机组报告,纳入2025年8月最新发布的数据。相关信息参见议题#4639与拉取请求#4638。 ### 新增数据 #### PHMSA 新增8张经过转换的数据表,包含1970年至今的PHMSA天然气分销商年度数据。请注意,这些以`_core`为后缀(表明这些数据表尚未完成全面清洗与验证)的表大多为数值型数据。我们发布这些数据表,旨在将我们提取并映射的50余年PHMSA历史数据开放给其他使用者,同时便于贡献者逐步完善该数据集。相关信息参见#3770与#4005。 首张已清洗的数据表`core_phmsagas__distribution_operators`已加入PUDL数据库。感谢@seeess1为此付出的全部工作! #### EIA-923 得益于@alexclippinger的贡献,我们已将清洗后的EIA-923表格8B财务信息以`_core_eia923__yearly_byproduct_expenses_and_revenues`的形式加入PUDL数据库。该数据表在完成标准化重构后将被替换,但在此之前将以当前形式发布。相关信息参见#4099、#2448与#4636。 ### 文档更新 新增了以下数据源页面: - 人口估计项目(Population Estimates Program, PEP)联邦信息处理标准(Federal Information Processing Standards, FIPS)代码;相关信息参见议题#4375与拉取请求#4622。 - 美国证券交易委员会(U.S. Securities and Exchange Commission, SEC)10-K表格;相关信息参见议题#4329、#4347与拉取请求#4562。 ### 新增数据测试与数据验证 在调查了我们估算的小时电力需求与@truggles及@awongel此前研究中的适度差异后,我们移除了此前附加在这些数据表上的“实验性”警告标签。相关讨论可参见PUDL示例仓库,配套笔记本可在Kaggle平台获取。 本变更涉及以下数据表中的PUDL估算需求值: - `out_eia930__hourly_operations` - `out_eia930__hourly_subregion_demand` - `out_eia930__hourly_aggregated_demand` ### 废弃内容 我们已正式关停长期运行的Datasette部署服务,但仍在推进新PUDL数据查看器的功能对等性完善。我们有一个史诗级议题追踪相关进度,参见议题#4481与拉取请求#4605,以了解主PUDL仓库中Datasette相关引用的移除情况。 ### PUDL v2025.10.0其他资源 - PUDL v2025.10.0数据字典 - PUDL v2025.10.0文档 - AWS开放数据注册表中的PUDL - 存储于免费公共AWS S3存储桶的PUDL v2025.9.1:s3://pudl.catalyst.coop/v2025.10.0/ - 存储于请求者付费GCS存储桶的PUDL v2025.9.1:gs://pudl.catalyst.coop/v2025.10.0/ - 本版本PUDL GitHub仓库的Zenodo存档 - GitHub上的PUDL v2025.10.0发布页面 - Python包索引(PyPI)中的PUDL v2025.10.0软件包 ### 联系我们 如果您正在使用PUDL,我们期待您的反馈!哪怕只是告知我们您的使用情况以及您如何使用本软件或数据,也将对我们大有帮助。您可以通过以下多种方式与我们取得联系: - 在GitHub上关注我们 - 使用PUDL GitHub问题追踪器报告您遇到的任何漏洞或数据问题 - GitHub讨论区是我们提供用户支持的渠道 - 关注我们的GitHub项目以了解最新工作进展 - 发送邮件至hello@catalyst.coop进行私人沟通 - Mastodon:@CatalystCoop@mastodon.energy - Bluesky:@catalyst.coop - Twitter:@CatalystCoop - 在LinkedIn上与我们建立联系 - 在Kaggle上使用我们的数据与配套笔记本 - 在HuggingFace上将我们的数据与机器学习模型结合使用 - 访问我们的官网了解更多信息:https://catalyst.coop - 订阅我们的公告列表以获取邮件更新。

提供机构:
Zenodo
创建时间:
2025-10-15
二维码
社区交流群
二维码
科研交流群
商业服务