Checking for non-preferred file/folder path names (may take a long time depending on the number of files/folders) ...

SUMMA Simulations using CAMELS Datasets for HPC use with CyberGIS-Jupyter for Water
Authors:
Owners: This resource does not have an owner who is an active HydroShare user. Contact CUAHSI (help@cuahsi.org) for information on this resource.
Type: Resource
Storage: The size of this resource is 284.3 KB
Created: Jan 10, 2021 at 12:33 a.m.
Last updated: Feb 23, 2022 at 5:15 a.m.
Citation: See how to cite this resource
Sharing Status: Public
Views: 1009
Downloads: 85
+1 Votes: Be the first one to 
 this.
Comments: No comments (yet)

Abstract

This resource, configured for execution in connected JupyterHub compute platforms using the CyberGIS-Jupyter for Water (CJW) environment's supported High-Performance Computing (HPC) resource (XSEDE Comet) through CyberGIS-Compute Service, helps the modelers to reproduce and build on the results from the paper (Van Beusekom et al., 2021).

For this purpose, three different Jupyter notebooks are developed and included in this resource which explore the paper goal for one example CAMELS site and a pre-selected period of 18-month simulation to demonstrate the capabilities of the notebooks. The first notebook processes the raw input data from CAMELS dataset to be used as input for SUMMA model. The second notebook utilizes the CJW environment's supported HPC resource (XSEDE Comet) through CyberGIS-Compute Service to executes SUMMA model. This notebook uses the input data from first notebook using original and altered forcing, as per further described in the notebook. Finally, the third notebook utilizes the outputs from notebook 2 and visualizes the sensitivity of SUMMA model outputs using Kling-Gupta Efficiency (KGE). More information about each Jupyter notebook and a step-by-step instructions on how to run the notebooks can be found in the Readme.md fie included in this resource. Using these three notebooks, modelers can apply the methodology mentioned above to any (one to all) of the 671 CAMELS basins and simulation periods of their choice. As this resource uses HPC, it enables a high-speed running of simulations which makes it suitable for larger simulations (even as large as the entire 671 CAMELS sites and the whole 60-month simulation period used in the paper) practical and much faster than when no HPC is used.

Subject Keywords

Coverage

Spatial

Coordinate System/Geographic Projection:
WGS 84 EPSG:4326
Coordinate Units:
Decimal degrees
Place/Area Name:
USA
North Latitude
49.1506°
East Longitude
-75.6774°
South Latitude
28.6103°
West Longitude
-123.4899°

Temporal

Start Date:
End Date:

Content

Readme.md

How to run the simulations

This Readme file provides the users with the step-by-step guide to successfully run the three developed notebooks.
The steps, in the order they need to be taken, are explained in what follows.

STEP_0 Preliminary step

In this step the modellers make sure that they have access to the content files of the resource and required compute platform.
- In order to be able to run the three Jupyter notebooks, modelers need to first have a HydroShare account.

  • If the modeler already does not have access to CyberGIS-Jupyter for Water (CJW), they need to ask to get access to it at the CyberGIS-Jupyter for Water platform

    • For the resource, choose open with "CyberGIS-Jupyter for Water"in the dropdown menu on the right side of the resource.

  • If instead the modeler is choosing to run locally, they will need to download the resource and set up a conda environment and install pysumma:

    • Get an Anaconda Python environment set up and install the environment there as follows;
      1. Check the operating system; cd /path/to/home; uname -m;
    • Get Miniconda for that system. For Linux 64 the command is: wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh; chmod 777 Miniconda3-latest-Linux-x86_64.sh; ./Miniconda3-latest-Linux-x86_64.sh;
      1. Close and then re-open your terminal window then iinstall the environment with conda the extra packages, with commands: conda env create -n pysumma -f environment.yml;
      2. This will make a python environment that you can activate and deactivate as: conda activate pysumma *Install it as a kernel in your Jupyter environments: python -m ipykernel install --user --name=pysumma;

Important notes before running the notebooks:
- Users can change the HRU ID and simulation periods to analyze any of the 671 basins in CAMELS datasets for the simulation period of their choice.
- To run each notebook:
1. Click the OpenWith button in the upper-right corner of this HydroShare resource webpage;
2. Select "CyberGIS-Jupyter for Water";
3. Open the notebook and follow instructions;

STEP_1 Create SUMMA input using 1_camels_make_input.ipynb

The first notebook creates SUMMA input using Camels dataset using summa_camels_hydroshare.zip in this resource and OpenDAP resource.

STEP_2 Execute SUMMA using 2_camels_pysumma_hpc.ipynb

This notebook executes SUMMA using original and constant forcing, and different parameters and parameterization combinations via HPC (XSEDE).

STEP_3 Visualize SUMMA output using 3_camels_analyze_output.ipynb

This notebook visualizes the sensitivity of SUMMA output according to the constant forcing and output variables using KGE.

STEP_4 Download raw SUMMA output

Related Resources

The content of this resource is derived from https://www.hydroshare.org/resource/a28685d2dd584fe5885fc368cb76ff2a/

Credits

Funding Agencies

This resource was created using funding from the following sources:
Agency Name Award Title Award Number
National Science Foundation Collaborative Research: SI2-SSI: Cyberinfrastructure for Advancing Hydrologic Knowledge through Collaborative Integration of Data Science, Modeling and Analysis OAC-1664061, OAC-1664018, OAC-1664119

How to Cite

Choi, Y., A. Van Beusekom, Z. Li, B. Nijssen, L. Hay, A. Bennett, D. Tarboton, I. Maghami, J. Goodall, M. P. Clark (2022). SUMMA Simulations using CAMELS Datasets for HPC use with CyberGIS-Jupyter for Water, HydroShare, http://www.hydroshare.org/resource/03dc01d36f0547f5945d93d2c47b48cc

This resource is shared under the Creative Commons Attribution CC BY.

 http://creativecommons.org/licenses/by/4.0/
CC-BY

Comments

There are currently no comments

New Comment

required