Checking for non-preferred file/folder path names (may take a long time depending on the number of files/folders) ...

(HS 2) Automate Workflows using Jupyter notebook to create Large Extent Spatial Datasets


Authors:
Owners: This resource does not have an owner who is an active HydroShare user. Contact CUAHSI (help@cuahsi.org) for information on this resource.
Type: Resource
Storage: The size of this resource is 2.4 MB
Created: May 13, 2021 at 10:38 p.m.
Last updated: Oct 15, 2024 at 2:23 p.m. (Metadata update)
Published date: Oct 15, 2024 at 2:23 p.m.
DOI: 10.4211/hs.a52df87347ef47c388d9633925cde9ad
Citation: See how to cite this resource
Sharing Status: Published
Views: 1958
Downloads: 45
+1 Votes: Be the first one to 
 this.
Comments: No comments (yet)

Abstract

We implemented automated workflows using Jupyter notebooks for each state. The GIS processing, crucial for merging, extracting, and projecting GeoTIFF data, was performed using ArcPy—a Python package for geographic data analysis, conversion, and management within ArcGIS (Toms, 2015). After generating state-scale LES (large extent spatial) datasets in GeoTIFF format, we utilized the xarray and rioxarray Python packages to convert GeoTIFF to NetCDF. Xarray is a Python package to work with multi-dimensional arrays and rioxarray is rasterio xarray extension. Rasterio is a Python library to read and write GeoTIFF and other raster formats. Xarray facilitated data manipulation and metadata addition in the NetCDF file, while rioxarray was used to save GeoTIFF as NetCDF. These procedures resulted in the creation of three HydroShare resources (HS 3, HS 4 and HS 5) for sharing state-scale LES datasets. Notably, due to licensing constraints with ArcGIS Pro, a commercial GIS software, the Jupyter notebook development was undertaken on a Windows OS.

Subject Keywords

Content

Related Resources

This resource belongs to the following collections:
Title Owners Sharing Status My Permission
(HS 1) Toward Seamless Environmental Modeling: Integration of HydroShare with Server-side Methods for Exposing Large Datasets to Models Iman Maghami · Linnea Saby · Zhiyu/Drew Li · Young-Don Choi · Jonathan Goodall  Published Open Access
COPY FOR ARCHIVING OLD RESOURCES: (HS 1) Toward Seamless Environmental Modeling: Integration of HydroShare with Server-side Methods for Exposing Large Datasets to Models Iman Maghami  Private &  Shareable None

How to Cite

Choi, Y. (2024). (HS 2) Automate Workflows using Jupyter notebook to create Large Extent Spatial Datasets, HydroShare, https://doi.org/10.4211/hs.a52df87347ef47c388d9633925cde9ad

This resource is shared under the Creative Commons Attribution CC BY.

http://creativecommons.org/licenses/by/4.0/
CC-BY

Comments

There are currently no comments

New Comment

required