Checking for non-preferred file/folder path names (may take a long time depending on the number of files/folders) ...
This resource contains some files/folders that have non-preferred characters in their name. Show non-conforming files/folders.
This resource contains content types with files that need to be updated to match with metadata changes. Show content type files that need updating.
Authors: |
|
|
---|---|---|
Owners: |
|
This resource does not have an owner who is an active HydroShare user. Contact CUAHSI (help@cuahsi.org) for information on this resource. |
Type: | Resource | |
Storage: | The size of this resource is 1.6 MB | |
Created: | Jan 10, 2021 at 12:33 a.m. | |
Last updated: | Feb 23, 2022 at 5:15 a.m. | |
Citation: | See how to cite this resource |
Sharing Status: | Public |
---|---|
Views: | 1503 |
Downloads: | 88 |
+1 Votes: | Be the first one to this. |
Comments: | No comments (yet) |
Abstract
This resource, configured for execution in connected JupyterHub compute platforms using the CyberGIS-Jupyter for Water (CJW) environment's supported High-Performance Computing (HPC) resource (XSEDE Comet) through CyberGIS-Compute Service, helps the modelers to reproduce and build on the results from the paper (Van Beusekom et al., 2021).
For this purpose, three different Jupyter notebooks are developed and included in this resource which explore the paper goal for one example CAMELS site and a pre-selected period of 18-month simulation to demonstrate the capabilities of the notebooks. The first notebook processes the raw input data from CAMELS dataset to be used as input for SUMMA model. The second notebook utilizes the CJW environment's supported HPC resource (XSEDE Comet) through CyberGIS-Compute Service to executes SUMMA model. This notebook uses the input data from first notebook using original and altered forcing, as per further described in the notebook. Finally, the third notebook utilizes the outputs from notebook 2 and visualizes the sensitivity of SUMMA model outputs using Kling-Gupta Efficiency (KGE). More information about each Jupyter notebook and a step-by-step instructions on how to run the notebooks can be found in the Readme.md fie included in this resource. Using these three notebooks, modelers can apply the methodology mentioned above to any (one to all) of the 671 CAMELS basins and simulation periods of their choice. As this resource uses HPC, it enables a high-speed running of simulations which makes it suitable for larger simulations (even as large as the entire 671 CAMELS sites and the whole 60-month simulation period used in the paper) practical and much faster than when no HPC is used.
Subject Keywords
Coverage
Spatial
Temporal
Start Date: | |
---|---|
End Date: |
Content
Readme.md
How to run the simulations
This Readme file provides the users with the step-by-step guide to successfully run the three developed notebooks.
The steps, in the order they need to be taken, are explained in what follows.
STEP_0 Preliminary step
In this step the modellers make sure that they have access to the content files of the resource and required compute platform.
- In order to be able to run the three Jupyter notebooks, modelers need to first have a HydroShare account.
-
If the modeler already does not have access to CyberGIS-Jupyter for Water (CJW), they need to ask to get access to it at the CyberGIS-Jupyter for Water platform
- For the resource, choose open with "CyberGIS-Jupyter for Water"in the dropdown menu on the right side of the resource.
-
If instead the modeler is choosing to run locally, they will need to download the resource and set up a conda environment and install pysumma:
- Get an Anaconda Python environment set up and install the environment there as follows;
- Check the operating system;
cd /path/to/home
;uname -m
;
- Check the operating system;
- Get Miniconda for that system. For Linux 64 the command is:
wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh
;chmod 777 Miniconda3-latest-Linux-x86_64.sh
;./Miniconda3-latest-Linux-x86_64.sh
;- Close and then re-open your terminal window then iinstall the environment with conda the extra packages, with commands:
conda env create -n pysumma -f environment.yml
; - This will make a python environment that you can activate and deactivate as:
conda activate pysumma
*Install it as a kernel in your Jupyter environments:python -m ipykernel install --user --name=pysumma
;
- Close and then re-open your terminal window then iinstall the environment with conda the extra packages, with commands:
- Get an Anaconda Python environment set up and install the environment there as follows;
Important notes before running the notebooks:
- Users can change the HRU ID and simulation periods to analyze any of the 671 basins in CAMELS datasets for the simulation period of their choice.
- To run each notebook:
1. Click the OpenWith button in the upper-right corner of this HydroShare resource webpage;
2. Select "CyberGIS-Jupyter for Water";
3. Open the notebook and follow instructions;
STEP_1 Create SUMMA input using 1_camels_make_input.ipynb
The first notebook creates SUMMA input using Camels dataset using summa_camels_hydroshare.zip
in this resource and OpenDAP resource.
STEP_2 Execute SUMMA using 2_camels_pysumma_hpc.ipynb
This notebook executes SUMMA using original and constant forcing, and different parameters and parameterization combinations via HPC (XSEDE).
STEP_3 Visualize SUMMA output using 3_camels_analyze_output.ipynb
This notebook visualizes the sensitivity of SUMMA output according to the constant forcing and output variables using KGE.
STEP_4 Download raw SUMMA output
Related Resources
The content of this resource is derived from | https://www.hydroshare.org/resource/a28685d2dd584fe5885fc368cb76ff2a/ |
Credits
Funding Agencies
This resource was created using funding from the following sources:
Agency Name | Award Title | Award Number |
---|---|---|
National Science Foundation | Collaborative Research: SI2-SSI: Cyberinfrastructure for Advancing Hydrologic Knowledge through Collaborative Integration of Data Science, Modeling and Analysis | OAC-1664061, OAC-1664018, OAC-1664119 |
How to Cite
This resource is shared under the Creative Commons Attribution CC BY.
http://creativecommons.org/licenses/by/4.0/
Comments
There are currently no comments
New Comment