Checking for non-preferred file/folder path names (may take a long time depending on the number of files/folders) ...

Data and Code for Build and Execute Scientific Workflows in the Cloud


Authors:
Owners: This resource does not have an owner who is an active HydroShare user. Contact CUAHSI (help@cuahsi.org) for information on this resource.
Type: Resource
Storage: The size of this resource is 146.7 MB
Created: May 30, 2024 at 3:28 p.m.
Last updated: May 31, 2024 at 2:22 p.m.
Citation: See how to cite this resource
Sharing Status: Public
Views: 695
Downloads: 292
+1 Votes: Be the first one to 
 this.
Comments: No comments (yet)

Abstract

This resource contains data and codes demonstrating how to build and execute scientific workflows in the cloud using cyberinfrastructure developed as part of the “HydroShare Modernization” CIROH research project. The goal is to illustrate how the general-purpose cloud analysis workflows developed to support common data archival operations can also be leveraged for scientific computing. This notebook describes the process for using the outcomes of the aforementioned CIROH project; however, these capabilities are still under active development and are not ready for widespread public use.

Subject Keywords

Content

readme.md

Content of this resource:

  • img: This folder contains the image (vpu-16.png) of HUC2 16 (the Great Basin Region) referenced in the execute-cfe-in-the-cloud.ipynb file.
  • execute-cfe-in-the-cloud.ipynb: This notebook demonstrates how to run a full simulation of a hydrological model within the ngen framework.
  • modify-parameters-and-execute-cfe.ipynb: This notebook demonstrates how to modify model input parameters (e.g., a parameter used in surface runoff parameterization) and re-run the model with the new configuration.
  • nextgen_16.gpkg: The geopackage of the VPU (vector processing unit) 16. This is one of the input required for mapping purposes in the jupyter notebook and selecting the region of interest and get the id of the most downstream catchment for which we want to delineate the upstream watershed and contrbituing areas and run the model.
  • helpers.py: A Python script containing helper functions used in the notebooks.
  • utils.py: A Python script containing utility functions used in the notebooks.
  • requirements.txt: A text file listing the dependencies required to run the notebooks.
  • 2024-CIROH-Cloud-Workflows-Workshop-Slides: Slides presented at the workshop.

To successfully run the notebooks, please ensure that:

  • ✅ You have a HydroShare account to authorize the CIROH platform to access your resource content.
  • ✅ You have already added the CIROH JupyterHub WebApp to your “Open With” list menu. You can access the "CIROH Production Jupyterhub" resource on HydroShare (https://www.hydroshare.org/resource/2dd1ac86e8854d4fb9fe5fbafaec2b98/). This resource is a "web app connector" allowing you to add the CIROH production JupyterHub to your list of apps available via your "Open with" menu in HydroShare. Ensure that the square icon labeled "Add Web App to Open with list" in HydroShare is green. If it appears red, a single click will change it to green.
  • ✅ You have access to the CIROH JupyterHub environments.

Follow the instructions provided in the Word document to help you check these items above.

Related Geospatial Features

This HydroShare resource is linked to the following geospatial features

${ messageObj.message }
${value.text} ${value.text}

Click a point to search for features that overlap with that location.

Select a feature for more information.

Credits

Funding Agencies

This resource was created using funding from the following sources:
Agency Name Award Title Award Number
National Oceanic and Atmospheric Administration (NOAA), University of Alabama CUAHSI HydroShare Modernization

How to Cite

Garousi-Nejad, I., A. M. Castronova, S. Black (2024). Data and Code for Build and Execute Scientific Workflows in the Cloud, HydroShare, http://www.hydroshare.org/resource/0d0a8d67a7fe4676bc84f6973dde0fc8

This resource is shared under the Creative Commons Attribution CC BY.

http://creativecommons.org/licenses/by/4.0/
CC-BY

Comments

There are currently no comments

New Comment

required