CyberGIS-Jupyter for Water (CJW) 2021-Q4 Release Notes

Dear CUAHSI community members,

We are pleased to announce a new quarterly release of the CyberGIS-Jupyter for Water (CJW) platform at https://go.illinois.edu/cybergis-jupyter-water. This release includes several new capabilities and features summarized as follows.

Transition to CyberGIS-Compute V2:
CyberGIS-Compute V2 is a new development phase of the CyberGIS-Compute framework that was initially released (denoted as V1) one year ago through CJW 2020-Q4. Compared with V1, V2 includes several major enhancements: 1) a new workflow for model contribution to facilitate adding new hydrologic models by community developers; 2) a GUI in the notebook environment to simplify and guide users through the job submission process; 3) transparent and bi-directional data transfers between CJW and high-performance computing (HPC) resources using Globus by default, and 4) detailed tracking of usage and metrics. It is worth noting that due to the upgraded architecture in V2, existing models implemented in V1 would need to be migrated. For a smooth transition and backward compatibility, services in V1 will remain available in parallel to those in V2, and all the old notebooks that use V1 remain functional.

SUMMA Model Migrated to CyberGIS-Compute V2:
We have migrated the SUMMA model to CyberGIS-Compute V2, and end users can now benefit from the new features mentioned above in SUMMA modeling work. Please refer to the example notebook below for details. In addition, the implementation of SUMMA in CyberGIS-Compute V2 is accessible on a Github repo (https://github.com/cybergis/cybergis-compute-v2-summa), which can serve as a real-world example to model developers who may want to contribute their models for sharing with the community. A “HelloWorld” implementation is also available serving as a model-agnostic example (https://github.com/cybergis/cybergis-compute-mpi-helloworld).

New Modules and Kernel Customization:
Upon user requests, two new easybuild-based modules have been added to the CJW toolbox and are now ready to use: NCL (https://www.ncl.ucar.edu/) for scientific data analysis and visualization (e.g., NetCDF, GRID, HDF); and CDO (https://code.mpimet.mpg.de/projects/cdo) for manipulation of climate and Numerical Weather Prediction (NWP) data. Furthermore, for advanced users who may want to customize the provided software environment and kernels, an example notebook (see below) is available for users to walk through the basics on how to install new libraries on top of existing environments or set up a Conda environment from scratch.

New UI Elements on CJW:
CJW has further customized the Jupyter Notebook user interface to include a virtual Announcement Board (in the header area) for timely communicating with users on upcoming events including downtimes and new releases, and a Bug Report button (at the upper-right corner) that opens an issue tracker page in a publicly accessible Github repo for quick bug reporting.

Please refer to the following resources for details and examples:
Run ensemble SUMMA 3.0 model with CyberGIS-Compute V2
https://www.hydroshare.org/resource/deac1b0b5b46415aaedb886b9dc16f45/

Customize Software Environment on CJW
https://www.hydroshare.org/resource/461a8a853d8e42a8ae170c68c4cfa8f1/

Implementation of SUMMA model using CyberGIS-Compute V2
https://github.com/cybergis/cybergis-compute-v2-summa

Implementation of HelloWorld model using CyberGIS-Compute V2
https://github.com/cybergis/cybergis-compute-mpi-helloworld

See Release Notes on HydroShare
https://www.hydroshare.org/resource/2086b241b16b453d827db847e8640475/

Please let us know if you have any questions or run into any problems ([e-mail]). Any feedback would be greatly appreciated.

Best regards,
CyberGIS-Hydro team

尊敬的CUAHSI社区成员：

我们荣幸地宣布，面向水文领域的CyberGIS-Jupyter for Water (CJW)平台迎来新一轮季度更新，更新访问地址为https://go.illinois.edu/cybergis-jupyter-water。本次更新新增多项功能与特性，概述如下：

### 迁移至CyberGIS-Compute V2版本
CyberGIS-Compute V2是CyberGIS-Compute框架的全新迭代版本，其初代版本（V1）于一年前通过CJW 2020年第四季度发布。相较于V1，V2具备四大核心升级：1）全新的模型贡献工作流，便于社区开发者快速接入新的水文模型；2）Jupyter Notebook环境中内置图形用户界面（GUI），简化并引导用户完成作业提交流程；3）默认采用Globus实现CJW与高性能计算（HPC）资源间的透明双向数据传输；4）新增详细的使用情况与指标追踪功能。需注意的是，由于V2采用了升级后的架构，所有基于V1开发的现有模型均需完成迁移。为保障平滑过渡并兼顾向后兼容性，V1与V2服务将并行运行，所有使用V1的旧版Jupyter Notebook均可正常使用。

### SUMMA模型迁移至CyberGIS-Compute V2
我们已将SUMMA模型迁移至CyberGIS-Compute V2版本，目前最终用户可在SUMMA建模工作中体验上述新增功能。详细操作请参阅下方示例Jupyter Notebook。此外，基于CyberGIS-Compute V2的SUMMA模型实现代码已开源至GitHub仓库（https://github.com/cybergis/cybergis-compute-v2-summa），可作为有意向贡献模型以服务社区的开发者的实际参考案例。另有一个与模型无关的"HelloWorld"实现示例（https://github.com/cybergis/cybergis-compute-mpi-helloworld）可供参考。

### 新增模块与内核定制功能
应社区用户需求，CJW工具集新增两个基于easybuild的模块，现已正式上线：一是用于科学数据分析与可视化的NCL（支持NetCDF、GRID、HDF等格式，官网：https://www.ncl.ucar.edu/）；二是用于处理气候与数值天气预报（NWP）数据的CDO（官网：https://code.mpimet.mpg.de/projects/cdo）。此外，针对希望定制现有软件环境与内核的高级用户，我们提供了一份示例Jupyter Notebook（见下方链接），可引导用户快速掌握在现有环境中安装新库，或从零搭建Conda环境的基础操作方法。

### CJW新增UI界面元素
CJW进一步优化了Jupyter Notebook用户界面：在头部区域新增虚拟公告板，用于及时向用户通报即将举办的活动、停机维护及版本更新等通知；在右上角新增Bug报告按钮，点击后将跳转至公开GitHub仓库的问题追踪页面，便于用户快速提交故障反馈。

详细信息与示例请参阅以下资源：
1. 基于CyberGIS-Compute V2运行SUMMA 3.0集合模型：https://www.hydroshare.org/resource/deac1b0b5b46415aaedb886b9dc16f45/
2. 在CJW上定制软件环境：https://www.hydroshare.org/resource/461a8a853d8e42a8ae170c68c4cfa8f1/
3. 基于CyberGIS-Compute V2的SUMMA模型实现：https://github.com/cybergis/cybergis-compute-v2-summa
4. 基于CyberGIS-Compute V2的HelloWorld模型实现：https://github.com/cybergis/cybergis-compute-mpi-helloworld
5. 查看HydroShare上的版本更新日志：https://www.hydroshare.org/resource/2086b241b16b453d827db847e8640475/

如有任何疑问或遇到技术问题，请联系[e-mail]。我们诚挚欢迎您提出宝贵反馈。

此致
CyberGIS-Hydro团队