HPC infrastructure measures dataset
收藏资源简介:
HPC infrastructure measures dataset The HPC infrastructure measures dataset provides fine-grained telemetry collected from the ORFEO production research datacenter in support of infrastructure-level energy and performance analysis. The dataset covers 28 days of 1 Hz observations (2026-03-02 to 2026-03-29) and is released in Parquet format. It includes measurements for compute, storage, network, and accelerator resources, together with infrastructure-level power observations. Collected variables include CPU, memory, disk I/O, network traffic, InfiniBand counters, GPU metrics, IPMI power, physical sensors, PDU readings, and external energy meter data. Two supplementary tables are also provided: a Slurm job table and an LLM API usage table which can be used to correlate workload activity with infrastructure telemetry. This dataset is intended for research on energy modeling, workload characterization, infrastructure observability, and system-level efficiency analysis in modern computing facilities. Dataset records Given the overall size of the dataset, the release is organized into multiple tables, each corresponding to a specific measurement type. With the exception of slurm_job_table and llm_api_usage, each table is partitioned by day and consists of 28 Parquet files, one for each day of observation. Since some table releases exceeded Zenodo size limits, they were split across multiple Zenodo records. The corresponding records are listed below: cpu table: cpu_part1 DOI: 10.5281/zenodo.19450477 cpu_part2 DOI: 10.5281/zenodo.19450778 diskio tables: diskio_part1 DOI: 10.5281/zenodo.19452891 diskio_part2 DOI: 10.5281/zenodo.19453299 energy_meter table: DOI: 10.5281/zenodo.19453592 infiniband table: DOI: 10.5281/zenodo.19453732 ipmi_power table: DOI: 10.5281/zenodo.19453924 ipmi_sensor table: DOI: 10.5281/zenodo.19454147 mem table: DOI: 10.5281/zenodo.19454457 net table: DOI: 10.5281/zenodo.19455362 nvidia_smi table: DOI: 10.5281/zenodo.19455902 pdu_power table: DOI: 10.5281/zenodo.19456383 turbostat tables: turbostat_part1 DOI: 10.5281/zenodo.19458325 turbostat_part2 DOI: 10.5281/zenodo.19459624 turbostat_part3 DOI: 10.5281/zenodo.19461152 turbostat_part4 DOI: 10.5281/zenodo.19461727 turbostat_part5 DOI: 10.5281/zenodo.19461892 turbostat_part6 DOI: 10.5281/zenodo.19462035 lm_api_usage table: DOI: 10.5281/zenodo.19462222 slurm_job_table table: DOI: 10.5281/zenodo.19462268



