DAN One Layer Retrievals - Sols 751-4050

DAN One-Layer Retrieval Data Release (Sols 751–4050) This repository contains processed Dynamic Albedo of Neutrons (DAN) one-layer retrieval products and supporting summary products for Curiosity observations spanning sols 751–4050. The release is organized into region-level summary products and per-location retrieval products. File names use a consistent `site / drive / start_sol / stop_sol` convention so that products from different subdirectories can be matched directly. Retrievals are performed on coadds of all observations at a given site/drive, producing one retrieval per location. Repository structure 1_layer_DAN_sols_751_4050/├── regional_summaries/└── retrieval_products/ regional_summaries/ This directory contains region-scale summary tables and regional overlay figures. Each region contained in the data volume contains three files. One file stores per-observation summary statistics, the second stores bulk region summary statistics and the third is a plot of the regions retrieval results. Example: - region_<region>_per_observation_stats_snr5_sub50_hdi68.csv- region_<region>_region_summary_stats_snr5_sub50_hdi68.csv- region_<region>_overlay_COMBINED_snr5_sub50.png The same naming pattern is used across regions. retrieval_products/ This directory contains the observation-level retrieval products and diagnostics. retrieval_products/├── background_subtracted_coadd/├── coadd_observations/├── coadd_product/├── corner_plots/├── GMMs/│ ├── unmix_2/│ │ └── gmm_mix/│ └── unmix_variable/│ ├── gmm_mix/│ └── gmm_selection/├── MCMC_backend/├── SNR/├── times/└── walker_plots/ Naming convention Most files share a common stem: site_<SITE>_drive_<DRIVE>_start_sol_<START>_stop_sol_<STOP> For example: site_026_drive_1274_start_sol_542_stop_sol_542This stem is followed by a product-specific suffix, for example: - _bg_dat.npy- _label_matched.txt- _coadded.npy- _corner_plot.png- _gmm_mix.png- _gmm_selection.png- _MCMC.h5.zip- _CETN_SNR.npy- _CTN_SNR.npy- _times.npy- _walker_plot.png This convention allows all products associated with a given coadded retrieval to be aligned by filename. Retrieval content The products in this release correspond to a one-layer retrieval framework. The primary retrieved physical parameters are: - WEH: water-equivalent hydrogen, in wt%- Σ_abs: bulk macroscopic neutron absorption cross section (BNACS), in cm^2/g Posterior diagnostics may also include an additional logf[counts] fit parameter in the MCMC products. Observation-level products Each retrieval generally includes one file in each of the subdirectories below. background_subtracted_coadd/ Files ending in _bg_dat.npy contain the background-subtracted count data used in retrieval processing. coadd_observations/ Files ending in _label_matched.txt list the DAN observation label or labels contributing to the coadded retrieval product. These files provide the traceability link between the retrieval and the original contributing observation set. coadd_product/ Files ending in _coadded.npy contain the coadded observation-space product used as the retrieval input. corner_plots/ Files ending in _corner_plot.png`are posterior diagnostic figures showing parameter distributions and pairwise covariances. For one-layer retrievals, these figures are expected to show the posterior structure for WEH and Σ_abs, and logf[counts]. GMMs/ This directory contains Gaussian mixture model post-processing products. - unmix_2/ contains fixed two-component mixture summaries.- unmix_variable/ contains variable-component mixture exploration products. Within these directories: - gmm_mix/ contains posterior unmixing summary plots.- gmm_selection/ contains model-selection plots used to compare mixture counts. These products support interpretation of multimodal posterior structure. MCMC_backend/ Files ending in _MCMC.h5.zip are compressed HDF5 backends containing the archived MCMC chains. These are the primary reproducibility products for users who want to regenerate posterior summaries, diagnostics, or alternate post-processing results. SNR/ This directory contains per-observation signal-to-noise products: - *_CETN_SNR.npy- *_CTN_SNR.npy These arrays store time-bin-level SNR values associated with the retrieval input data. times/ Files ending in _times.npy contain the time-bin definitions associated with the DAN die-away measurement. walker_plots/ Files ending in _walker_plot.png show the evolution of the MCMC walkers as a function of iteration number and are intended for quality control and convergence assessment. Regional summary products Per-observation regional statistics Files named region_<region>_per_observation_stats_snr5_sub50_hdi68.csv contain one row per parameter per observation for all observations assigned to a region. These tables provide per-observation posterior summary statistics and identifying metadata such as sol, site, drive, start/stop sol, and source retrieval filename. Coadded observations are only included in regional summaries if their SNR is greater than or equal to 5. Summary statistics include quantities such as: - number of posterior samples- mean- standard deviation- median- KDE mode- percentile-based intervals- mode-centered interval terms- 68% highest-density interval bounds and width These files are intended for downstream analysis, filtering, and custom regional comparisons. Region-level summary statistics Files named region_<region>_region_summary_stats_snr5_sub50_hdi68.csv contain region-level aggregate summaries for each retrieval parameter. These include statistics derived from the distribution of per-observation medians, modes, interval widths, and mixture-distribution summaries. These products are designed for compact regional characterization without requiring users to reprocess all observation-level posterior samples. Regional overlay figures Files named region_<region>_overlay_COMBINED_snr5_sub50.png show the combined regional posterior-density overlays for the one-layer retrieval parameters. These figures provide a visual summary of how posterior structure varies across all observations within a region. Processing tags in filenames Several filenames include processing tags that encode how the products were generated: - snr5: products generated using an SNR threshold of 5- sub50: products generated using a 50% posterior subsampling step- hdi68: summary statistics reported using 68% highest-density intervals These tags are part of the product identity and should be preserved when referencing or redistributing derivative products. Recommended use A typical use pattern is: 1. Start with regional_summaries/ to review region-scale behavior and identify observations of interest.2. Use coadd_observations/ to trace a retrieval back to the contributing DAN observation labels.3. Use coadd_product/, background_subtracted_coadd/, SNR/, and times/ for observation-space analysis.4. Use corner_plots/, walker_plots/, and GMMs/ for posterior interpretation and quality control.5. Use MCMC_backend/ when full reproducibility or custom post-processing is required. Acknowledgment If you use these products in published work, please cite the associated data release and the relevant scientific publications describing the DAN retrieval methodology.# DAN单层反演数据集发布（Sol 751–4050） 本仓库包含经过处理的**中子动态反照率（Dynamic Albedo of Neutrons, DAN）**单层反演产品，以及覆盖Sol 751至4050（火星日）期间好奇号火星车观测数据的配套汇总产品。本数据集按区域级汇总产品与单点位反演产品两类组织。文件名采用统一的`站点/移动行程/起始Sol/终止Sol`命名规范，可直接匹配不同子目录下的对应产品。反演基于给定站点/移动行程下的所有共叠加观测数据开展，每个点位生成一份反演结果。 ## 仓库目录结构 1_layer_DAN_sols_751_4050/ ├── regional_summaries/ └── retrieval_products/ ### regional_summaries/（区域汇总目录） 该目录包含区域尺度汇总表格与区域叠加可视化图。数据集中的每个区域均包含三类文件：第一类存储单观测汇总统计量，第二类存储区域整体汇总统计量，第三类为区域反演结果可视化图。 示例文件名： - region_<region>_per_observation_stats_snr5_sub50_hdi68.csv - region_<region>_region_summary_stats_snr5_sub50_hdi68.csv - region_<region>_overlay_COMBINED_snr5_sub50.png 所有区域均采用统一命名模式。 ### retrieval_products/（反演产品目录） 该目录包含观测级反演产品与诊断数据。 retrieval_products/ ├── background_subtracted_coadd/ ├── coadd_observations/ ├── coadd_product/ ├── corner_plots/ ├── GMMs/ │ ├── unmix_2/ │ │ └── gmm_mix/ │ └── unmix_variable/ │ ├── gmm_mix/ │ └── gmm_selection/ ├── MCMC_backend/ ├── SNR/ ├── times/ └── walker_plots/ ## 命名规范 多数文件共享通用前缀： `site_<SITE>_drive_<DRIVE>_start_sol_<START>_stop_sol_<STOP>` 示例：`site_026_drive_1274_start_sol_542_stop_sol_542` 该前缀后接产品专属后缀，例如： - _bg_dat.npy - _label_matched.txt - _coadded.npy - _corner_plot.png - _gmm_mix.png - _gmm_selection.png - _MCMC.h5.zip - _CETN_SNR.npy - _CTN_SNR.npy - _times.npy - _walker_plot.png 该命名规范可确保给定共叠加反演的所有关联产品均可通过文件名直接匹配对齐。 ## 反演内容 本数据集产品基于单层反演框架生成，核心反演物理参数包括： - 等效水氢（Water Equivalent Hydrogen, WEH）：质量百分比（wt%） - Σ_abs：整体宏观中子吸收截面（BNACS），单位为cm²/g 后验诊断结果中还可能包含马尔可夫链蒙特卡洛（Markov Chain Monte Carlo, MCMC）产品内的额外logf[计数]拟合参数。 ## 观测级产品 每个反演通常在以下各子目录中对应一份文件： 1. **background_subtracted_coadd/（背景扣除共叠加目录）** 后缀为`_bg_dat.npy`的文件存储反演处理中使用的背景扣除计数数据。 2. **coadd_observations/（叠加观测目录）** 后缀为`_label_matched.txt`的文件列出参与该共叠加反演的DAN观测标签，可实现反演产品与原始贡献观测集之间的溯源关联。 3. **coadd_product/（叠加产品目录）** 后缀为`_coadded.npy`的文件存储用作反演输入的观测空间共叠加数据产品。 4. **corner_plots/（三角后验图目录）** 后缀为`_corner_plot.png`的文件为后验诊断图，展示参数分布与两两协方差。对于单层反演，此类图将呈现WEH、Σ_abs及logf[计数]的后验结构。 5. **GMMs/（高斯混合模型目录）** 该目录包含高斯混合模型后处理产品： - `unmix_2/`：固定双组分混合模型汇总结果 - `unmix_variable/`：可变组分混合模型探索结果 两类子目录下均包含： - `gmm_mix/`：后验反混汇总绘图结果 - `gmm_selection/`：用于对比混合组分数量的模型选择绘图结果 此类产品可辅助解释多峰后验结构。 6. **MCMC_backend/（MCMC后端目录）** 后缀为`_MCMC.h5.zip`的文件为压缩HDF5格式后端，存储归档的MCMC链，是希望复现后验汇总、诊断结果或开展自定义后处理的用户的核心可复现产品。 7. **SNR/（信噪比目录）** 该目录包含单观测信噪比产品： - `*_CETN_SNR.npy` - `*_CTN_SNR.npy` 此类数组存储与反演输入数据关联的时间bin级信噪比数值。 8. **times/（时间信息目录）** 后缀为`_times.npy`的文件存储与DAN衰减测量相关的时间bin定义信息。 9. **walker_plots/（行走者演化图目录）** 后缀为`_walker_plot.png`的文件展示MCMC行走者随迭代次数的演化过程，用于质量控制与收敛性评估。 ## 区域汇总产品 ### 单观测区域统计量 文件名为`region_<region>_per_observation_stats_snr5_sub50_hdi68.csv`的表格，为分配至某区域的所有观测按参数与观测逐条生成一行数据。此类表格提供单观测后验汇总统计量与标识元数据，包括Sol、站点、移动行程、起始/终止Sol以及源反演文件名。仅当共叠加观测的信噪比不低于5时，才会被纳入区域汇总。 汇总统计量包含以下指标： - 后验样本数量 - 均值 - 标准差 - 中位数 - 核密度估计众数 - 分位数区间 - 众数中心区间项 - 68%最高密度区间边界与宽度 此类文件可用于下游分析、筛选与自定义区域对比。 ### 区域级汇总统计量 文件名为`region_<region>_region_summary_stats_snr5_sub50_hdi68.csv`的表格，包含每个反演参数的区域级聚合汇总结果，统计量源自单观测中位数、众数、区间宽度以及混合分布汇总结果。 此类产品旨在实现紧凑的区域特征描述，无需用户重新处理所有观测级后验样本。 ### 区域叠加可视化图 文件名为`region_<region>_overlay_COMBINED_snr5_sub50.png`的图像，展示单层反演参数的组合区域后验密度叠加图，可直观呈现区域内所有观测的后验结构差异。 ## 文件名中的处理标签 部分文件名包含处理标签，用于标识产品生成方式： - `snr5`：采用信噪比阈值5生成的产品 - `sub50`：采用50%后验子采样步骤生成的产品 - `hdi68`：采用68%最高密度区间报告的汇总统计量 此类标签属于产品标识的一部分，在引用或分发衍生产品时应予以保留。 ## 推荐使用流程 典型使用模式如下： 1. 从`regional_summaries/`入手，查看区域尺度行为并筛选目标观测 2. 通过`coadd_observations/`将反演结果溯源至对应的贡献DAN观测标签 3. 使用`coadd_product/`、`background_subtracted_coadd/`、`SNR/`与`times/`开展观测空间分析 4. 使用`corner_plots/`、`walker_plots/`与`GMMs/`开展后验解释与质量控制 5. 当需要完全复现或开展自定义后处理时，使用`MCMC_backend/` ## 致谢说明 若您在已发表工作中使用本数据集产品，请引用相关数据集发布文章以及描述DAN反演方法的相关科学文献。