Hi, I'm an error. x

Zhiyu (Drew) Li

University of Illinois at Urbana-Champaign

 Recent Activity

ABSTRACT:

The goal of this notebook is to show the steps to run an example National Water Model (WRFhydro) model on HPC resources through the CyberGIS Computing Service. This notebook uses wrfhydropy, a Python wrapper for WRFHydro, in model preprocessing and postprocessing, and the resulting ready-to-run model is handed over to CyberGIS Computing Service for execution on a supported HPC resource (Virtual Roger/Keeling at UIUC or XSEDE COMET at SDSC). This example is adapted from the "ex_01_end_to_end.ipynb" notebook from wrfhydropy official github repo https://github.com/NCAR/wrf_hydro_py, and users are encouraged to refer to the tutorials there to get familair with wrfhydropy usages.

How to run:
1. Request to join the CyberGIS-Jupyter for Water group at https://www.hydroshare.org/group/157
2. Click the "Open with ..." button in the upper-right
3. Select "CyberGIS-Jupyter for Water"
4. Run through the notebook

Show More

ABSTRACT:

[You can run this model with the notebook at https://www.hydroshare.org/resource/8fe974c108ca4c6eaaf9b060779329b0/ in CyberGIS-Jupyter for Water platform]

WRFHydro Test Case -- Croton River, NY

#Overview This test case includes prepared geospatial data and input files for a
sample domain (region of interest) and prepared forcing data. This domain is a small region (15km x 16km) encompassing the West Branch
of the Croton River, NY, USA (USGS stream gage 0137462010) during hurricane
Irene, 2011-08-26 to 2011-09-02. The simulation begins with a restart from a
spinup period from 2010-10-01 to 2011-08-26. The forcing data
prepared for this test case is North American Land Data Assimilation System
(NLDAS) hourly data. There are 3 basic routing
configurations included in the test case, National Water Model (NWM), Gridded,
and NCAR Reach. See the WRF-Hydro V5 Technical Description located at
https://ral.ucar.edu/projects/wrf_hydro for a more detailed description of model
physics options, configurations, and input files.

Show More

ABSTRACT:

This example is to show the steps to run an ensemble SUMMA3.0 on HPC through the CyberGIS Computing Service.

Show More

ABSTRACT:

This a reproducible demonstration of the landslide modeling results from eSurf paper: Strauch et al. (2018)

Show More

ABSTRACT:

sciunit container

Show More

 Contact

Resources
All 0
Collection 0
Composite Resource 0
Generic 0
Geographic Feature 0
Geographic Raster 0
HIS Referenced Time Series 0
Model Instance 0
Model Program 0
MODFLOW Model Instance Resource 0
Multidimensional (NetCDF) 0
Script Resource 0
SWAT Model Instance 0
Time Series 0
Web App 0
Composite Resource Composite Resource
US States
Created: Nov. 3, 2015, 5:43 p.m.
Authors: Drew Li

ABSTRACT:

US States polygon shapefiles

Show More
Composite Resource Composite Resource
NHD Flowlines Colorado Region
Created: Dec. 11, 2015, 8:07 p.m.
Authors: Drew Li

ABSTRACT:

This shapefile contains flowlines of the NFIE Colorado Region.

Show More
Composite Resource Composite Resource
NHD Flowlines Colorado Region
Created: Aug. 11, 2016, 4:50 p.m.
Authors: Drew Li

ABSTRACT:

This shapefile contains flowlines of the NFIE Colorado Region.

Show More
Composite Resource Composite Resource
gdal-2.1.2-binary
Created: Nov. 17, 2016, 7:22 a.m.
Authors: Zhiyu (Drew) Li

ABSTRACT:

This gdal 2.1.2 binary was compiled on ubuntu 16.04 x64. This file link is referenced by a Dockerfile for dockerized Tethys on github, which does not allow to store file larger than 100mb.

Show More
Composite Resource Composite Resource

ABSTRACT:

This resource contains a sqlite/spatialite geodatabase for assisting the workflow of subsetting NWM Ver1.1 netcdf.
1) grid cell polygon for land and forcing files
2) stream polyline (huc 8, 10, 12)
3) reservoir polygon

Download all the 5 split zip files into one folder and unzip the first one (nwm.zip.001) using 7z

Show More
Composite Resource Composite Resource

ABSTRACT:

Subset National Water Model (NWM) Ver1.1 20170327 results for Bear River-Frontal Great Salt Lake HUC12 watershed (comid: 160102040504).
Python library used to prepare this data: https://pypi.python.org/pypi/subset_nwm_netcdf/

Show More
Composite Resource Composite Resource

ABSTRACT:

This resource contains supporting files for subset_nwm_netcdf 1.1.3 (https://pypi.python.org/pypi/subset_nwm_netcdf/)
The split zip file nwm.zip.001 - 004 is the sqlite/spatialite geodatabase for stream, reservoir and watershed query.
xy_land_NAD1983.tif is for querying gird cell indices of NWM forcing and land files
xy_terrain_NAD1983.tif is for querying gird cell indices of NWM terrain files

Show More
Composite Resource Composite Resource

ABSTRACT:

A subset of National Water Model (NWM) Ver1.1 20170404 results forTwoMileCreek watershed at Tuscaloosa, Alabama.
The watershed polygon is at https://www.hydroshare.org/resource/9d0e4cab63d74c0b8e6b6d83254c30de/

Show More
Composite Resource Composite Resource
TwoMileCreek watershed at Tuscaloosa, Alabama
Created: April 12, 2017, 6:03 p.m.
Authors: Zhiyu (Drew) Li

ABSTRACT:

TwoMileCreek watershed at Tuscaloosa, Alabama

Show More
Composite Resource Composite Resource

ABSTRACT:

This resource contains supporting files for subset_nwm_netcdf 1.1.4-1.1.9 (https://pypi.python.org/pypi/subset_nwm_netcdf/)
The split zip file nwm.zip.001 - 004 is the sqlite/spatialite geodatabase for stream, reservoir and watershed query.

Download and unzip on Ubuntu
sudo apt-get install wget unzip
wget https://www.hydroshare.org/django_irods/download/23c05d3177654a9ab9dc9023d00d16ed/data/contents/nwm.zip.001
wget https://www.hydroshare.org/django_irods/download/23c05d3177654a9ab9dc9023d00d16ed/data/contents/nwm.zip.002
wget https://www.hydroshare.org/django_irods/download/23c05d3177654a9ab9dc9023d00d16ed/data/contents/nwm.zip.003
wget https://www.hydroshare.org/django_irods/download/23c05d3177654a9ab9dc9023d00d16ed/data/contents/nwm.zip.004
cat nwm.zip.* > nwm.zip
rm nwm.zip.*
unzip nwm.zip
rm nwm.zip

Show More
Composite Resource Composite Resource

ABSTRACT:

A Subset of National Water Model (NWM) Ver1.1 20170419 results forTwoMileCreek watershed at Tuscaloosa, Alabama.
The watershed polygon is at https://www.hydroshare.org/resource/9d0e4cab63d74c0b8e6b6d83254c30de/

Show More
Composite Resource Composite Resource
bash script to download NWM v1.1 outputs
Created: April 29, 2017, 3:59 p.m.
Authors: Zhiyu (Drew) Li

ABSTRACT:

bash script to download NWM v1.1 outputs

Show More
Composite Resource Composite Resource

ABSTRACT:

Hand drawn Utah state border in geojson featurecollection format Projection: WGS84 (EPSG: 4326). This resource was created to test NWM viewer app.

Show More
Composite Resource Composite Resource

ABSTRACT:

Hand drawn Alabama state border in geojson polygon format. This resource was created to test NWM viewer app.

Show More
Composite Resource Composite Resource

ABSTRACT:

NWM v1.1 forcing_analysis_assimilation files of TwoMileCreek watershed region for 20170419

Show More
Collection Resource Collection Resource
HydroShare App Demos
Created: June 7, 2017, 12:56 a.m.
Authors: Christina Bandaragoda

ABSTRACT:

This is a collection of step by step demonstrations on how to use HydroShare Apps.

Show More
Composite Resource Composite Resource
Demo: View multimedia from maps
Created: June 7, 2017, 12:59 a.m.
Authors: Jimmy Phuong · Christina Bandaragoda

ABSTRACT:

This is a step-by-step demonstration of how to Add Images, PDFs, and Videos to digital maps using the HydroShare GIS App using an example from this related HydroShare resource: Ames, D. (2016). Algae Growth in Utah Lake Time-lapse, HydroShare, http://www.hydroshare.org/resource/4c8ecb05a72647339df0df6e9a87718f

Show More
Composite Resource Composite Resource

ABSTRACT:

This is a step-by-step demonstration of how to view and download forecasts from any stream in the National Hydrography Dataset with the National Water Model App.

Show More
Composite Resource Composite Resource
stream_sld
Created: June 20, 2017, 11:48 p.m.
Authors: Zhiyu (Drew) Li

ABSTRACT:

stream_sld

Show More
Composite Resource Composite Resource
Thunder Creek Watershed Boundary
Created: July 25, 2017, 9:07 p.m.
Authors: Christina Bandaragoda

ABSTRACT:

Thunder Creek, Skagit River Basin, State of Washington, USA.

Show More
Web App Resource Web App Resource
National Water Model Forecast Viewer App
Created: Dec. 7, 2017, 3:33 p.m.
Authors: · michael souffront · Zhiyu (Drew) Li · Jim Nelson · Dan Ames

ABSTRACT:

The NWM Viewer app has 2 main features provided in Home Mode and Subset Mode respectively:
Home Mode: Retrieve and View NWM Time Series for a single stream reach, reservoir or grid cell.
Subset Mode: Subset NWM outputs (NetCDF files) with a watershed polygon to get 'shrunken' NetCDFs that only contain data for a specific area.

Show More
Web App Resource Web App Resource
Data Rods Explorer App
Created: Dec. 7, 2017, 3:38 p.m.
Authors: Gonzalo E. Espinoza · David Arctur ·

ABSTRACT:

The Data Rods Explorer (DRE) is a web client app that enables users to browse several NASA-hosted data sets. The interface enables visualization and download of NASA observation retrievals and land surface model (LSM) outputs by variable, space and time. The key variables are precipitation, wind, temperature, surface downward radiation flux, heat flux, humidity, soil moisture, groundwater, runoff, and evapotranspiration. These variables describe the main components of the water cycle over land masses.

Show More
Composite Resource Composite Resource
Rocky River HUC10 0303000305 at Raleigh NC
Created: Dec. 19, 2017, 5:05 p.m.
Authors: Zhiyu (Drew) Li

ABSTRACT:

Rocky River HUC10 0303000305 at Raleigh NC

Show More
Composite Resource Composite Resource
GDAL2.2.3-ubuntu14-x64-binary
Created: Dec. 29, 2017, 5:57 p.m.
Authors: Zhiyu (Drew) Li

ABSTRACT:

This gdal 2.2.3 binary was compiled on ubuntu 16.04 x64. This file link is referenced by a Dockerfile for dockerized Tethys on github, which does not allow to store file larger than 100mb.

./configure --with-python

GDAL is now configured for x86_64-pc-linux-gnu

Installation directory: /root/gdal223build
C compiler: gcc -DHAVE_AVX_AT_COMPILE_TIME -DHAVE_SSSE3_AT_COMPILE_TIME -DHAVE_SSE_AT_COMPILE_TIME -g -O2
C++ compiler: g++ -std=gnu++11 -DHAVE_AVX_AT_COMPILE_TIME -DHAVE_SSSE3_AT_COMPILE_TIME -DHAVE_SSE_AT_COMPILE_TIME -g -O2
C++11 support: yes

LIBTOOL support: yes

LIBZ support: external
LIBLZMA support: no
cryptopp support: no
GRASS support: no
CFITSIO support: no
PCRaster support: internal
LIBPNG support: internal
DDS support: no
GTA support: no
LIBTIFF support: internal (BigTIFF=yes)
LIBGEOTIFF support: internal
LIBJPEG support: external
12 bit JPEG: no
12 bit JPEG-in-TIFF: no
LIBGIF support: internal
OGDI support: no
HDF4 support: no
HDF5 support: yes
Kea support: no
NetCDF support: yes
Kakadu support: no
JasPer support: no
OpenJPEG support: no
ECW support: no
MrSID support: no
MrSID/MG4 Lidar support: no
JP2Lura support: no
MSG support: no
GRIB support: yes
EPSILON support: no
WebP support: no
cURL support (wms/wcs/...):yes
PostgreSQL support: yes
MRF support: yes
MySQL support: no
Ingres support: no
Xerces-C support: no
NAS support: no
Expat support: yes
libxml2 support: yes
Google libkml support: no
ODBC support: no
PGeo support: no
FGDB support: no
MDB support: no
PCIDSK support: internal
OCI support: no
GEORASTER support: no
SDE support: no
Rasdaman support: no
DODS support: no
SQLite support: yes
PCRE support: no
SpatiaLite support: no
RasterLite2 support: no
Teigha (DWG and DGNv8): no
INFORMIX DataBlade support:no
GEOS support: yes
SFCGAL support: no
QHull support: internal
Poppler support: no
Podofo support: no
PDFium support: no
OpenCL support: no
Armadillo support: no
FreeXL support: no
SOSI support: no
MongoDB support: no

SWIG Bindings: python

Statically link PROJ.4: no
enable GNM building: yes
enable pthread support: yes
enable POSIX iconv support:yes
hide internal symbols: no

Show More
Composite Resource Composite Resource
GDAL2.3-dev-bb4c395-ubuntu16-x64-binary
Created: Dec. 30, 2017, 12:50 a.m.
Authors: Zhiyu (Drew) Li

ABSTRACT:

This GDAL2.3-dev-bb4c395 binary was compiled on ubuntu 16.04 x64. This file link is referenced by a Dockerfile for dockerized Tethys on github, which does not allow to store file larger than 100mb.

./configure --with-python
GDAL is now configured for x86_64-pc-linux-gnu

Installation directory: /root/gdal_23_dev_bb4c395_binary
C compiler: gcc -DHAVE_AVX_AT_COMPILE_TIME -DHAVE_SSSE3_AT_COMPILE_TIME -DHAVE_SSE_AT_COMPILE_TIME -g -O2
C++ compiler: g++ -std=c++11 -DHAVE_AVX_AT_COMPILE_TIME -DHAVE_SSSE3_AT_COMPILE_TIME -DHAVE_SSE_AT_COMPILE_TIME -g -O2
C++14 support: no

LIBTOOL support: yes

LIBZ support: external
LIBLZMA support: no
cryptopp support: no
crypto/openssl support: yes
GRASS support: no
CFITSIO support: no
PCRaster support: internal
LIBPNG support: internal
DDS support: no
GTA support: no
LIBTIFF support: internal (BigTIFF=yes)
LIBGEOTIFF support: internal
LIBJPEG support: external
12 bit JPEG: no
12 bit JPEG-in-TIFF: no
LIBGIF support: internal
JPEG-Lossless/CharLS: no
OGDI support: no
HDF4 support: no
HDF5 support: yes
Kea support: no
NetCDF support: yes
Kakadu support: no
JasPer support: no
OpenJPEG support: no
ECW support: no
MrSID support: no
MrSID/MG4 Lidar support: no
JP2Lura support: no
MSG support: no
GRIB support: yes
EPSILON support: no
WebP support: no
cURL support (wms/wcs/...):yes
PostgreSQL support: yes
MRF support: yes
MySQL support: no
Ingres support: no
Xerces-C support: no
NAS support: no
Expat support: yes
libxml2 support: yes
Google libkml support: no
ODBC support: no
PGeo support: no
FGDB support: no
MDB support: no
PCIDSK support: internal
OCI support: no
GEORASTER support: no
SDE support: no
Rasdaman support: no
DODS support: no
SQLite support: yes
PCRE support: no
SpatiaLite support: no
RasterLite2 support: no
Teigha (DWG and DGNv8): no
INFORMIX DataBlade support:no
GEOS support: yes
SFCGAL support: no
QHull support: internal
Poppler support: no
Podofo support: no
PDFium support: no
OpenCL support: no
Armadillo support: no
FreeXL support: no
SOSI support: no
MongoDB support: no

SWIG Bindings: python

Statically link PROJ.4: no
enable GNM building: yes
enable pthread support: yes
enable POSIX iconv support:yes
hide internal symbols: no

Show More
Composite Resource Composite Resource
NWM Viewer App GIS data
Created: Jan. 9, 2018, 6:28 p.m.
Authors: Zhiyu (Drew) Li

ABSTRACT:

This resource contains GIS data for National Water Model Viewer App in ArcGIS geodatabase format:
channels : line--2.7 million NHD+ stream reaches
reservoirs: point--1260 reservoirs locations
usgs_gauge: point--NHD+ USGS gauges locations
grid_land: polygon--grid cell polygons for land and forcing outputs

nwm_app_data.mxd : ArcMap 10 project file

Show More
Composite Resource Composite Resource
LittleWashita HUC10 1113030208 Polygon in OH
Created: Jan. 18, 2018, 12:06 a.m.
Authors: Zhiyu (Drew) Li

ABSTRACT:

LittleWashita HUC10 1113030208 Polygon in OH

Show More
Composite Resource Composite Resource

ABSTRACT:

Milburnie Lake - Neuse River HUC10 Watershed 0302020107 at Durham-Raleigh, NC

Show More
Composite Resource Composite Resource
croton_NY_domain_polygon
Created: May 16, 2018, 10:47 p.m.
Authors: Zhiyu (Drew) Li

ABSTRACT:

croton_NY_domain_polygon

Show More
Web App Resource Web App Resource
CyberGIS (beta) JupyterHub
Created: Sept. 26, 2018, 5:53 p.m.
Authors: Dandong Yin

ABSTRACT:

Jupyter environment set in CyberGIS Center for interaction with HPC

Show More
Composite Resource Composite Resource

ABSTRACT:

The US National Water Model (NWM) is a mesoscale hydrologic model that provides streamflow forecasts and other valuable hydrologic information for the continental United States. Since its release at the National Water Center (NWC) in 2016, the NWM has garnered broad attention and great interest across the hydrology science community. Several projects are underway with the goal of delivering this advanced modeling technique and its data to researchers and end users in the community.
As one of the flagship projects, the CUAHSI HydroShare project is working toward providing a complete solution for storing, managing and sharing NWM data. So far, it has set up the largest open-access data archive for the NWM outputs and has developed several different open-source tools and web applications assisting users with data access.
However, there is a growing demand in the hydrologic sciences community for the capability to run a local instance of NWM at regional watersheds to support research applications such as cross-model comparison, historical data analysis and etc.
In this paper, we present ongoing work to develop web applications on top of HydroShare for collecting NWM input data to support model execution at smaller scale watersheds.

Show More
Composite Resource Composite Resource
Composite Resource Composite Resource
czo community sql files
Created: April 9, 2019, 4:23 p.m.
Authors: Zhiyu (Drew) Li

ABSTRACT:

czo community sql files

Show More
Composite Resource Composite Resource
watershed test
Created: May 6, 2019, 7:59 p.m.
Authors: Zhiyu (Drew) Li

ABSTRACT:

watershed test

Show More
Web App Resource Web App Resource
CyberGIS-Jupyter for Water (dev at hs07)
Created: Sept. 4, 2019, 3:30 p.m.
Authors: Li, Zhiyu (Drew)

ABSTRACT:

Dev deploy for CyberGIS-Jupyter for Water

Show More
Web App Resource Web App Resource
CyberGIS-Jupyter for Water
Created: Oct. 21, 2019, 1:19 p.m.
Authors: Li, Zhiyu (Drew) · Lu, Fangzheng · Padmanabhan, Anand · Wang, Shaowen

ABSTRACT:

The CyberGIS-Jupyter for Water (CJW) platform aims to advance community hydrologic modelling, and support data-intensive, reproducible, and computationally scalable water science research by simplifying access to advanced cyberGIS and cyberinfrastructure capabilities through a friendly Jupyter Notebook environment. The current release has specific support for the Structure For Unifying Multiple Modeling Alternatives (SUMMA) model and the WRFHydro model.

You may open and view any notebook (*.ipynb file) with this app.

Please send comments and bug reports to help@cybergis.org.

Show More
Composite Resource Composite Resource

ABSTRACT:

This resources contains 3 notebooks that walk you through running a SUMMA model on CyberGIS-Jupyter for Water platform.

summa_local.ipynb --- run a summa model on Jupyter notebook server (container) directly
summa_hpc.ipynb --- submit summa model as a job to XSEDE COMET High Performance Computing (HPC) cluster
summa_ensemble_hpc.ipynb --- submit an ensemble summa mode as a job to XSEDE COMET High Performance Computing (HPC) cluster

Show More
Composite Resource Composite Resource

ABSTRACT:

User may want to set up a custom Python environment (kernel) and run notebooks with it on the CyberGIS-Jupyter for Water platform. This resource has 2 notebooks to demonstrate walk you through the steps.

install_custom_python_environment.ipynb --- install a custom Python env with user-defined libraries using conda, and set it as a Jupyter Kernel.
recover_custom_python_environment.ipynb --- after a container rebuild, user needs to reactivate a previously installed custom Python env.

Show More
Composite Resource Composite Resource
HAND notebook -- CyberGIS-Jupyter for Water
Created: Dec. 6, 2019, 1:33 a.m.
Authors: Li, Zhiyu (Drew)

ABSTRACT:

HAND notebook

Show More
Composite Resource Composite Resource
csvtest
Created: March 29, 2020, 4:01 p.m.
Authors: Li, Zhiyu (Drew)

ABSTRACT:

asd

Show More
Composite Resource Composite Resource

ABSTRACT:

This example demonstrates how to use PostGIS capabilities in CyberGIS-Jupyter notebook environment. Modified from notebook by Weiye Chen (weiyec2@illinois.edu)

PostGIS is an extension to the PostgreSQL object-relational database system which allows GIS (Geographic Information Systems) objects to be stored in the database. PostGIS includes support for GiST-based R-Tree spatial indices, and functions for analysis and processing of GIS objects.

Resources for PostGIS:

Manual https://postgis.net/docs/
In this demo, we use PostGIS 3.0. Note that significant changes in APIs have been made to PostGIS compared to version 2.x. This demo assumes that you have basic knowledge of SQL.

Show More
Composite Resource Composite Resource

ABSTRACT:

These are examples to test Data Processing Kernel in CyberGIS-Jupyter for water.
The 1_watershed_delineation folder is an example of a watershed delineation which is the basic step to analyze an interesting watershed. We used GRASS GIS 7.8 version and shell script to apply GRASS GIS library.
The 2_map_visualization folder is an example of an interactive map visualization which is the high-level visualization using PyViz tools as post-processing of environmental modeling. For this example, we used the following PyViz tools:
- geopandas (https://geopandas.org/), cartopy (https://scitools.org.uk/cartopy/), geoviews (https://geoviews.org/), and holoviews (https://holoviews.org/)

Show More
Composite Resource Composite Resource

ABSTRACT:

!!! This is a fork from https://www.hydroshare.org/resource/5b964154ebf945848087bdc772cc921e/ with some minor modifications for CyberGIS-Jupyer for Water (CJW) platform !!!
----------------------------------------------------------------------------------------------------
The ability to test hypotheses about hydrology, geomorphology, and atmospheric processes is invaluable to research in the Earth and planetary sciences. To swiftly develop experiments using community resources is an extraordinary emerging opportunity to accelerate the rate of scientific advancement. Knowledge infrastructure is an intellectual framework to understand how people are creating, sharing, and distributing knowledge -- which has dramatically changed and is continually transformed by Internet technologies. We are actively designing a knowledge infrastructure system for earth surface investigations. In this paper, we illustrate how this infrastructure can be utilized to lower common barriers to reproducing modeling experiments. These barriers include: developing education and training materials for classroom use, publishing research that can be replicated by reviewers and readers, and advancing collaborative research by re-using earth surface models in new locations or in new applications. We outline six critical elements to this infrastructure, 1) design of workflows for ease of use by new users; 2) a community-supported collaborative web platform that supports publishing and privacy; 3) data storage that may be distributed to different locations; 4) a software environment; 5) a personalized cloud-based high performance computing (HPC) platform; and 6) a standardized modeling framework that is growing with open source contributions. Our methodology uses the following tools to meet the above functional requirements. Landlab is an open-source modeling toolkit for building, coupling, and exploring two-dimensional numerical models. The Consortium of Universities Allied for Hydrologic Science (CUAHSI) supports the development and maintenance of a JupyterHub server that provides the software environment for the system. Data storage and web access are provided by HydroShare, an online collaborative environment for sharing data and models. The knowledge infrastructure system accelerates knowledge development by providing a suite of modular and interoperable process components that can be combined to create an integrated model. Online collaboration functions provide multiple levels of sharing and privacy settings, open source license options, and DOI publishing, and cloud access to high-speed processing. This allows students, domain experts, collaborators, researcher, and sponsors to interactively execute and explore shared data and modeling resources. Our system is designed to support the user experiences on the continuum from fully developed modeling applications to prototyping new science tools. We have provided three computational narratives for readers to interact with hands-on, problem-based research demonstrations - these are publicly available Jupyter Notebooks available on HydroShare.

To interactively compute with these Notebooks, please see the ReadMe below.
To develop these Notebooks, go to Github: https://github.com/ChristinaB/pub_bandaragoda_etal_ems or https://zenodo.org/badge/latestdoi/187289993

Show More
Collection Resource Collection Resource

ABSTRACT:

CyberGIS-Jupyter for Water Quarterly Release Announcement (2020 Q2)

Dear HydroShare Users,

We are pleased to announce a new quarterly release of CyberGIS-Jupyter for Water (CJW) platform at https://go.illinois.edu/cybergis-jupyter-water. This release includes new capabilities to support the geoanalytics suite of GRASS for model pre/post-processing, PostGIS database, and Landlab Earth surface modelling toolkit along with several enhancements to job submission middleware, system security as well as service infrastructure. Please refer to the following list for details and examples.

Please let us know if you have any questions or run into any problems (help@cybergis.org). Any feedback would be greatly appreciated.

Best regards,
CyberGIS-Hydro team

GRASS GIS for model pre/post-processing:
Learn how to consolidate the features of the GRASS geoanalytics suite to support pre/post-processing for SUMMA and RHESSYs models in CJW.
Example notebooks: https://www.hydroshare.org/resource/4cbcfdd6e7f943e2969dd52e780bc52d/

Manage geospatial data with PostGIS:
PostGIS is an extension to the PostgreSQL object-relational database system which allows geospatial data to be efficiently stored while providing various advanced functions for in-situ data analysis and processing.
Example notebooks: https://www.hydroshare.org/resource/bb779d4cce564dd6afcf463c8910786f/

Security and service infrastructure enhancements
Trusted group: Starting from this release, all users are required to join the “CyberGIS-Jupyter for Water” trusted group at https://www.hydroshare.org/group/157 in order to access the CJW platform, which is a preventive measure to protect the shared computing resources from being abused by malicious users. A complete user profile page is highly recommended to expedite the approval process.
User metric submission to XSEDE: CJW, as a science gateway, is now sending unique user usage metrics to XSEDE to comply with its requirements.

Landlab for enabling collaborative numerical modeling in Earth sciences using knowledge infrastructure
Example notebooks: https://www.hydroshare.org/resource/370c288b61b84794b847ef85c4dd4ffb/
https://www.hydroshare.org/resource/6add6bee06bb4050bfe23e1081627614/

Job submission enhancements
Refactored the structure of the cyberGIS job submission system
Data-driven implementation for avoiding excessive data transmission between HydroShare and CJW
Add the specification of input parameters into a JSON file to improve the flexibility and generality of model management
Enable HPC-SUMMA object that can directly call SUMMA
Example notebooks: https://www.hydroshare.org/resource/4a4a22a69f92497ead81cc48700ba8f8/

Show More
Composite Resource Composite Resource

ABSTRACT:

This is an example of watershed delineation which is the basic step to analyze an interesting watershed. We used GRASS GIS 7.8 version and shell script to apply GRASS GIS library.

Show More
Composite Resource Composite Resource

ABSTRACT:

These is an examples to test Data Processing Kernel in CyberGIS-Jupyter for water.
The 2_map_visualization folder is an example of an interactive map visualization which is the high-level visualization using PyViz tools as post-processing of environmental modeling. For this example, we used the following PyViz tools:
- geopandas (https://geopandas.org/), cartopy (https://scitools.org.uk/cartopy/), geoviews (https://geoviews.org/), and holoviews (https://holoviews.org/)

Show More
Composite Resource Composite Resource
sciunit
Created: May 14, 2020, 4:51 p.m.
Authors: Li, Zhiyu (Drew)

ABSTRACT:

sciunit container

Show More
Composite Resource Composite Resource

ABSTRACT:

This a reproducible demonstration of the landslide modeling results from eSurf paper: Strauch et al. (2018)

Show More
Composite Resource Composite Resource

ABSTRACT:

This example is to show the steps to run an ensemble SUMMA3.0 on HPC through the CyberGIS Computing Service.

Show More
Composite Resource Composite Resource
WRFHydro Test Case -- Croton River, NY
Created: Nov. 5, 2020, 4:58 a.m.
Authors:

ABSTRACT:

[You can run this model with the notebook at https://www.hydroshare.org/resource/8fe974c108ca4c6eaaf9b060779329b0/ in CyberGIS-Jupyter for Water platform]

WRFHydro Test Case -- Croton River, NY

#Overview This test case includes prepared geospatial data and input files for a
sample domain (region of interest) and prepared forcing data. This domain is a small region (15km x 16km) encompassing the West Branch
of the Croton River, NY, USA (USGS stream gage 0137462010) during hurricane
Irene, 2011-08-26 to 2011-09-02. The simulation begins with a restart from a
spinup period from 2010-10-01 to 2011-08-26. The forcing data
prepared for this test case is North American Land Data Assimilation System
(NLDAS) hourly data. There are 3 basic routing
configurations included in the test case, National Water Model (NWM), Gridded,
and NCAR Reach. See the WRF-Hydro V5 Technical Description located at
https://ral.ucar.edu/projects/wrf_hydro for a more detailed description of model
physics options, configurations, and input files.

Show More
Composite Resource Composite Resource

ABSTRACT:

The goal of this notebook is to show the steps to run an example National Water Model (WRFhydro) model on HPC resources through the CyberGIS Computing Service. This notebook uses wrfhydropy, a Python wrapper for WRFHydro, in model preprocessing and postprocessing, and the resulting ready-to-run model is handed over to CyberGIS Computing Service for execution on a supported HPC resource (Virtual Roger/Keeling at UIUC or XSEDE COMET at SDSC). This example is adapted from the "ex_01_end_to_end.ipynb" notebook from wrfhydropy official github repo https://github.com/NCAR/wrf_hydro_py, and users are encouraged to refer to the tutorials there to get familair with wrfhydropy usages.

How to run:
1. Request to join the CyberGIS-Jupyter for Water group at https://www.hydroshare.org/group/157
2. Click the "Open with ..." button in the upper-right
3. Select "CyberGIS-Jupyter for Water"
4. Run through the notebook

Show More