Alexander C Michels

University of Illinois at Urbana-Champaign

Subject Areas: CyberInfrastructure, Data Science

 Recent Activity

ABSTRACT:

Most of this notebook is going over advanced options and technical details behind our new design. There are however a few key things all users should know:

1 What do the different kernel names/versions mean?
2 Paths to some executables might have changed.
3 We have a new cjw command to manage kernel versions.

How to run the notebook:
1) Click on the OpenWith button in the upper-right corner;
2) Select "CyberGIS-Jupyter for Water";
3) Open the notebook and follow instructions;

Show More

ABSTRACT:

Dear CUAHSI community members,

We are pleased to announce a new quarterly release of the CyberGIS-Jupyter for Water (CJW) platform at https://go.illinois.edu/cybergis-jupyter-water. This release includes several new capabilities and features summarized as follows.

1)Community Commons for Easy Access to HydroShare Notebooks:
Reproducible computational notebooks have become increasingly important in hydrologic research and education. CJW now provides a friendly user interface for accessing HydroShare-related notebooks at https://cybergisxhub.cigi.illinois.edu/hydroshare/. Interested in learning how CJW enables computational reproducibility of such notebooks? Read on!

2)Enhanced Reproducibility of CJW:
Starting from this release, CJW has implemented a new solution in kernel and software management such that each notebook is now associated with a specific versioned kernel. This approach significantly enhances reproducibility in the CJW environment as each notebook is always opened with the original kernel it is tied to. We encourage users to test their notebooks and reach out to us if you experience any problems.

3)Transferring Large Model Output Datasets:
CJW has introduced a new Globus-based (https://www.globus.org/) data-transfer capability to enhance the performance and stability of transferring a large number of model outputs from high-performance computing (HPC) resources back to CJW, which is a common scenario in running hydrologic models.

4)Seamless Transition from XSEDE Comet to Expanse:
Comet was decommissioned on July 15, 2021 (https://portal.xsede.org/sdsc-comet), and all Comet allocations and resources awarded to HydroShare/CJW have been transferred to the Expanse (https://portal.xsede.org/sdsc-expanse). The CyberGIS-Compute service and its SDK now automatically redirect all jobs submitted to Comet to Expanse while prompting users with a simple warning message.

Please refer to the following HydroShare resources for details and examples:
Community Commons for Easy Access to HydroShare Notebooks
https://cybergisxhub.cigi.illinois.edu/hydroshare/
Enhanced Reproducibility of CJW
https://www.hydroshare.org/resource/df8244042e5445edb106d93e5a491d29/
Transferring Large Model Output Datasets
https://www.hydroshare.org/resource/5aa3d27ec5ef4b1b8dfa621ea284af14/
See Release Notes on HydroShare
https://www.hydroshare.org/resource/f3315ec8c1df4f4ab5d2274220de0351/

Please let us know if you have any questions or run into any problems (help@cybergis.org). Any feedback would be greatly appreciated.

Best regards,
CyberGIS-Hydro team

Show More

ABSTRACT:

A newly deployed CyberGIS-Jupyter for Water (CJW) instance powered by Kubernetes (k8s: https://kubernetes.io/) is now available for user testing at https://go.illinois.edu/cjw-k8s. The adoption of this most sought-after and cutting-edge cloud application deployment technology would significantly enhance the availability and scalability of CJW as we have observed increasing user demand and a surge in new user sign-up. We welcome all users to join the public testing and give us feedback. We anticipate the public testing on the new CJW would take 1-3 months, during which the current production CJW (http://go.illinois.edu/cybergis-jupyter-water) will continue to be available in parallel until a final “migration plan” is announced (TBD).

Please send comments and bug reports to help@cybergis.org

URL for direct access: https://go.illinois.edu/cjw-k8s

How to setup OpenWith for "Kubernetes-based CJW (user testing)"
1) Login HydroShare
2) Visit this resource landing page: https://www.hydroshare.org/resource/e9686eadd4474b6587d83d9330d25854/
3) In the upper-right corner, click on the 3rd icon from the left (the one with 3x3 small squares), which should prompt "Add WebApp to Open With List"
4) Refresh the landing page of the resource that has notebooks you are interested in, and "Kubernetes-based CJW (user testing)" should show up in the OpenWith list now

Show More

ABSTRACT:

The CyberGIS-Jupyter for Water (CJW) platform aims to advance community hydrologic modelling, and support data-intensive, reproducible, and computationally scalable water science research by simplifying access to advanced cyberGIS and cyberinfrastructure capabilities through a friendly Jupyter Notebook environment. The current release has specific support for the Structure For Unifying Multiple Modeling Alternatives (SUMMA) model and the WRFHydro model.

You may open and view any notebook (*.ipynb file) with this app.

Please send comments and bug reports to help@cybergis.org.

Show More

 Contact

Resources
All 0
Collection 0
Composite Resource 0
Generic 0
Geographic Feature 0
Geographic Raster 0
HIS Referenced Time Series 0
Model Instance 0
Model Program 0
MODFLOW Model Instance Resource 0
Multidimensional (NetCDF) 0
Script Resource 0
SWAT Model Instance 0
Time Series 0
Web App 0
Web App Resource Web App Resource

ABSTRACT:

The CyberGIS-Jupyter for Water (CJW) platform aims to advance community hydrologic modelling, and support data-intensive, reproducible, and computationally scalable water science research by simplifying access to advanced cyberGIS and cyberinfrastructure capabilities through a friendly Jupyter Notebook environment. The current release has specific support for the Structure For Unifying Multiple Modeling Alternatives (SUMMA) model and the WRFHydro model.

You may open and view any notebook (*.ipynb file) with this app.

Please send comments and bug reports to help@cybergis.org.

Show More
Web App Resource Web App Resource

ABSTRACT:

A newly deployed CyberGIS-Jupyter for Water (CJW) instance powered by Kubernetes (k8s: https://kubernetes.io/) is now available for user testing at https://go.illinois.edu/cjw-k8s. The adoption of this most sought-after and cutting-edge cloud application deployment technology would significantly enhance the availability and scalability of CJW as we have observed increasing user demand and a surge in new user sign-up. We welcome all users to join the public testing and give us feedback. We anticipate the public testing on the new CJW would take 1-3 months, during which the current production CJW (http://go.illinois.edu/cybergis-jupyter-water) will continue to be available in parallel until a final “migration plan” is announced (TBD).

Please send comments and bug reports to help@cybergis.org

URL for direct access: https://go.illinois.edu/cjw-k8s

How to setup OpenWith for "Kubernetes-based CJW (user testing)"
1) Login HydroShare
2) Visit this resource landing page: https://www.hydroshare.org/resource/e9686eadd4474b6587d83d9330d25854/
3) In the upper-right corner, click on the 3rd icon from the left (the one with 3x3 small squares), which should prompt "Add WebApp to Open With List"
4) Refresh the landing page of the resource that has notebooks you are interested in, and "Kubernetes-based CJW (user testing)" should show up in the OpenWith list now

Show More
Collection Resource Collection Resource

ABSTRACT:

Dear CUAHSI community members,

We are pleased to announce a new quarterly release of the CyberGIS-Jupyter for Water (CJW) platform at https://go.illinois.edu/cybergis-jupyter-water. This release includes several new capabilities and features summarized as follows.

1)Community Commons for Easy Access to HydroShare Notebooks:
Reproducible computational notebooks have become increasingly important in hydrologic research and education. CJW now provides a friendly user interface for accessing HydroShare-related notebooks at https://cybergisxhub.cigi.illinois.edu/hydroshare/. Interested in learning how CJW enables computational reproducibility of such notebooks? Read on!

2)Enhanced Reproducibility of CJW:
Starting from this release, CJW has implemented a new solution in kernel and software management such that each notebook is now associated with a specific versioned kernel. This approach significantly enhances reproducibility in the CJW environment as each notebook is always opened with the original kernel it is tied to. We encourage users to test their notebooks and reach out to us if you experience any problems.

3)Transferring Large Model Output Datasets:
CJW has introduced a new Globus-based (https://www.globus.org/) data-transfer capability to enhance the performance and stability of transferring a large number of model outputs from high-performance computing (HPC) resources back to CJW, which is a common scenario in running hydrologic models.

4)Seamless Transition from XSEDE Comet to Expanse:
Comet was decommissioned on July 15, 2021 (https://portal.xsede.org/sdsc-comet), and all Comet allocations and resources awarded to HydroShare/CJW have been transferred to the Expanse (https://portal.xsede.org/sdsc-expanse). The CyberGIS-Compute service and its SDK now automatically redirect all jobs submitted to Comet to Expanse while prompting users with a simple warning message.

Please refer to the following HydroShare resources for details and examples:
Community Commons for Easy Access to HydroShare Notebooks
https://cybergisxhub.cigi.illinois.edu/hydroshare/
Enhanced Reproducibility of CJW
https://www.hydroshare.org/resource/df8244042e5445edb106d93e5a491d29/
Transferring Large Model Output Datasets
https://www.hydroshare.org/resource/5aa3d27ec5ef4b1b8dfa621ea284af14/
See Release Notes on HydroShare
https://www.hydroshare.org/resource/f3315ec8c1df4f4ab5d2274220de0351/

Please let us know if you have any questions or run into any problems (help@cybergis.org). Any feedback would be greatly appreciated.

Best regards,
CyberGIS-Hydro team

Show More
Composite Resource Composite Resource

ABSTRACT:

Most of this notebook is going over advanced options and technical details behind our new design. There are however a few key things all users should know:

1 What do the different kernel names/versions mean?
2 Paths to some executables might have changed.
3 We have a new cjw command to manage kernel versions.

How to run the notebook:
1) Click on the OpenWith button in the upper-right corner;
2) Select "CyberGIS-Jupyter for Water";
3) Open the notebook and follow instructions;

Show More