遇见数据集

Dataset for IOMax: Maximizing Out-of-Core I/O Analysis Performance on HPC Systems

收藏
Zenodo2023-09-30 更新2026-05-26 收录
数据链接:
官方服务:

资源简介:

I/O analysis is an essential task for improving the performance of scientific applications on high-performance computing (HPC) systems. However, current analysis tools, which often use data drilling techniques (iterative exploration for deeper insights), treat every query independently and do not optimize column data for data-slicing (extracting specific data subsets), resulting in subpar querying performance. In this paper, we designed IOMax, a tool for efficient data drilling analysis on large-scale I/O traces. IOMax utilizes a novel query optimization technique to improve the query performance by 8.6x while reducing the memory footprint required for analysis by 11x. Additionally, it employs data transformation techniques to improve data-slicing performance by up to 11.4x. In conclusion, IOMax optimizes I/O analysis for scientific workflows on the Lassen supercomputer, resulting in up to 7x improvement. This dataset contains optimized data that was used in the associated publication.

提供机构:
Zenodo
创建时间:
2023-09-30
二维码
社区交流群
二维码
科研交流群
商业服务