five

Run WRFHydro model on HPC resources using CyberGIS-Compute V2 (updated 2022-10)

收藏
DataONE2022-10-27 更新2024-06-08 收录
下载链接:
https://search.dataone.org/view/sha256:2220216df15ce5d30b22ed6f0ca44e7d0263ded4cf7e12dfd322e69bd57651c6
下载链接
链接失效反馈
官方服务:
资源简介:
This notebook demonstrates how to prepare a WRFHydro model on CyberGIS-Jupyter for Water (CJW) for execution on a supported High-Performance Computing (HPC) resource via the CyberGIS-Compute service. First-time users are highly encouraged to go through the [NCAR WRFHydro Hands-on Training on CJW](https://www.hydroshare.org/resource/d2c6618090f34ee898e005969b99cf90/) to get familiar WRFHydro model basics including compilation of source code, preparation of forcing data and typical model configurations. This notebook will not cover those topics and assume users already have hands-on experience with local model runs. CyberGIS-Compute is a CyberGIS-enabled web service sits between CJW and HPC resources. It acts as a middleman that takes user requests (eg. submission of a model) originated from CJW, carries out the actual job submission of model on the target HPC resource, monitors job status, and retrieves outputs when the model execution has completed. The functionality of CyberGIS-Compute is exposed as a series of REST APIs. A Python client, [CyberGIS-Compute SDK](https://github.com/cybergis/cybergis-compute-python-sdk), has been developed for use in the CJW environment that provides a simple GUI to guide users through the job submission process. Prior to job submission, model configuration and input data should be prepared and arranged in a certain way that meets specific requirements, which vary by models and their implementation in CyberGIS-Compute. We will walk through the requirements for WRFHydro below. The general workflow for WRFHydro in CyberGIS-Compute works as follows: 1. User picks a Model_Version of WRFHydro to use; 2. User prepares configuration files and data for the model on CJW; 3. User submits configuration files and data to CyberGIS-Compute; 4. CyberGIS-Compute transfers configuration files and data to target HPC; 5. CyberGIS-Compute downloads the chosen Model_Version of WRFhydro codebase on HPC; 6. CyberGIS-Compute applies compile-time configuration files to the codebase, and compiles the source code on the fly; 7. CyberGIS-Compute applies run-time configuration files and data to the model; 8. CyberGIS-Compute submits the model job to HPC scheduler for model execution; 9. CyberGIS-Compute monitors job status; 10. CyberGIS-Compute transfers model outputs from HPC to CJW upon user request; 11. User performs post-processing work on CJW; Some steps in this notebook require user interaction. \"Run cell by cell\" is recommended. \"Run All\" may not work as expected. How to run the notebook: 1) Click on the OpenWith button in the upper-right corner; 2) Select \"CyberGIS-Jupyter for Water\"; 3) Open the notebook and follow instructions;
创建时间:
2023-12-30
5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作