CyberGIS-Jupyter for Water (CJW) 2021 Q2 Release Notes

We are pleased to announce a new quarterly release of the CyberGIS-Jupyter for Water (CJW) platform at https://go.illinois.edu/cybergis-jupyter-water. This release includes several new capabilities and features summarized as below.

1) Support for NCAR/UCAR WRFHydro Training Notebooks: Users are now able to set up the necessary environment to run WRFHydro hands-on training notebooks (https://ral.ucar.edu/projects/wrf_hydro/training-materials) through simple clicks on CJW. For details on how to run these training notebooks please review the following HydroShare resources: (a) WRFHydro Hands-on Training v5.2.x on CJW; and (b) WRF&WRFHydro Coupled Training v5.1.2 on CJW. This provides an alternative solution to the traditional Docker-based local setup (https://hub.docker.com/r/wrfhydro/training/) that makes it easy for users to complete this training as it does not require installation or downloading of any software or data onto the user’s local computer. Additionally, it enables users to access more powerful computing resources in a cloud-based Jupyter environment. All necessary materials required to complete the training are retrieved from official data sources managed by the NCAR/UCAR WRFHydro Development Team and accessible on CJW via a browser.

2) Transition from XSEDE Comet to Expanse: Comet HPC will be decommissioned on July 31, 2021 (https://portal.xsede.org/sdsc-comet), and all Comet allocations and resources awarded to HydroShare/CJW will be transferred to the Expanse HPC (https://portal.xsede.org/sdsc-expanse). As a result, the CyberGIS-Compute service will also drop the support on Comet and replace it with Expanse. Despite this change, we do not expect any action is required for the majority of users. The CyberGIS-Compute service and its SDK will redirect all jobs submitted to Comet to Expanse with a warning message showing up. All previously developed notebooks that use Comet will continue to run after this transition. Please contact us for solutions if you have models or notebooks that access Comet without going through the CyberGIS-Compute service.

3) Extended user testing of Kubernetes-based CJW instance: In the previous release, we announced a Kubernetes-based (Aka K8s: https://kubernetes.io/) CJW instance deployed at https://go.illinois.edu/cjw-k8s for user testing with a preliminary migration plan on deprecation of the current DockerSwarm-based CJW. Due to the growing complexity of K8s and more features being developed and added for a smooth user experience, we have decided to continue conducting extensive testing in this release. We encourage all users to join this testing process and would greatly appreciate your feedback. The current production CJW (http://go.illinois.edu/cybergis-jupyter-water) will continue to be available in parallel until a final migration plan is implemented.

Please refer to the following HydroShare resources for details and examples:
Run WRFHydro Hands-on Training v5.2.x on CJW
https://www.hydroshare.org/resource/d2c6618090f34ee898e005969b99cf90/
Run WRF&WRFHydro Coupled Training v5.1.2 on CJW
https://www.hydroshare.org/resource/c2389a2f05564da08ab218e59bdf1e81/
User testing on Kubernetes-based CJW:
https://go.illinois.edu/cjw-k8s
Set up OpenWith for Kubernetes-based CJW:
https://www.hydroshare.org/resource/e9686eadd4474b6587d83d9330d25854/
See Release Notes on HydroShare
https://www.hydroshare.org/resource/6a1ddb17155a4b27b885f442ad14e344/

Please let us know if you have any questions or run into any problems ([e-mail]). Any feedback would be greatly appreciated.

Best regards,
CyberGIS-Hydro team

欣然宣布，CyberGIS-Jupyter for Water (CJW) 平台（https://go.illinois.edu/cybergis-jupyter-water）的最新季度版本现已发布。本版本新增多项功能，概述如下。

1) 支持 NCAR/UCAR WRFHydro 培训笔记本：用户现在可以通过CJW平台简单点击来设置运行WRFHydro动手实践笔记本（https://ral.ucar.edu/projects/wrf_hydro/training-materials）所需的环境。关于如何运行这些培训笔记本的详细信息，请参阅以下HydroShare资源：（a）在CJW上运行 WRFHydro 动手实践 v5.2.x；（b）在CJW上运行 WRF&WRFHydro 联合培训 v5.1.2。这为传统的基于Docker的本地设置（https://hub.docker.com/r/wrfhydro/training/）提供了一种替代方案，使得用户能够轻松完成培训，因为它不需要在用户本地计算机上安装或下载任何软件或数据。此外，它还使用户能够访问基于云的Jupyter环境中更强大的计算资源。完成培训所需的所有材料均从由NCAR/UCAR WRFHydro 开发团队管理的官方数据源检索，并通过浏览器在CJW上获取。

2) 从 XSEDE Comet 迁移至 Expanse：Comet 高性能计算平台将于2021年7月31日（https://portal.xsede.org/sdsc-comet）退役，所有分配给HydroShare/CJW的Comet资源和配额将转移到Expanse HPC（https://portal.xsede.org/sdsc-expanse）。因此，CyberGIS-Compute 服务也将停止对Comet的支持，并替换为Expanse。尽管发生此变化，我们预计大多数用户无需采取任何行动。CyberGIS-Compute 服务及其SDK将自动将提交给Comet的所有作业重定向到Expanse，并显示警告信息。所有之前开发的、使用Comet的笔记本在迁移后将继续运行。如果您有访问Comet但不通过CyberGIS-Compute服务的模型或笔记本，请与我们联系寻求解决方案。

3) 对基于Kubernetes的CJW实例进行扩展用户测试：在前一个版本中，我们宣布部署了基于Kubernetes（即K8s：https://kubernetes.io/）的CJW实例，并位于https://go.illinois.edu/cjw-k8s，供用户测试，并初步制定了当前基于DockerSwarm的CJW的弃用迁移计划。由于Kubernetes的复杂性日益增加，以及更多功能被开发和添加以实现流畅的用户体验，我们决定在本版本中继续进行广泛的测试。我们鼓励所有用户加入这一测试过程，并非常期待您的反馈。当前的CJW生产环境（http://go.illinois.edu/cybergis-jupyter-water）将继续并行提供，直到最终迁移计划实施。

请参考以下HydroShare资源以获取详细信息及示例：
- 在CJW上运行 WRFHydro 动手实践 v5.2.x
https://www.hydroshare.org/resource/d2c6618090f34ee898e005969b99cf90/
- 在CJW上运行 WRF&WRFHydro 联合培训 v5.1.2
https://www.hydroshare.org/resource/c2389a2f05564da08ab218e59bdf1e81/
- 基于Kubernetes的CJW用户测试
https://go.illinois.edu/cjw-k8s
- 为基于Kubernetes的CJW设置OpenWith
https://www.hydroshare.org/resource/e9686eadd4474b6587d83d9330d25854/
- 查看 HydroShare 上的发布说明
https://www.hydroshare.org/resource/6a1ddb17155a4b27b885f442ad14e344/

如果您有任何疑问或遇到任何问题，请告知我们（[e-mail]）。任何反馈都将受到高度重视。

此致，
CyberGIS-Hydro 团队