Tools for downscaling/disaggregating flood hazard grids
To downscale a coarse WSE using a fine resolution DEM, the CLI in main.py can be used:
python fdsc\main.py <path_to_DEM> <path_to_WSE>
an example application with this CLI is provided in example.bat
Alternatively, the downscale function can be called within a python script:
from fdsc.main import downscale
downscale(<path_to_DEM>, <path_to_WSE>)
>>> <path_to_WSE1>, {metadata}
The following downscaling algos have been implemented. These are typically specified via the method key:
employs four phases shown below: 1) grid resampling; 2) least-cost mapping; 3) filtering high-and-dry sub-grid cells; and finally 4) an isolated-cell filter.
FloodDownscaler: original repo for HESS publication work
FloodRescaler: public repo with QGIS processing script port (and aggregation tools)
rimpy: Tools for building, calibrating, and visualizing RIM2D models
2207_dscale2: (DISCONTINUED) project for generating analog inundation grids with LISFLOOD.
FloodPolisher: (DISCONTINUED) mid-2022 inundation downscaling work using simple growth. pyqgis. Should incorporate a version of this into this project.
2112_agg_pub: public repo of analysis for aggregation paper.
TODO: make installation more user-friendly (e.g., containerization or setup-tools)
Installing FloodDownscaler2 is complex and customizeable and requires three basic steps:
- build a python environment per ./environment.yml
- create and customize a ./definitions.py file (see below)
- install/setup whitebox-tools v2.2.0 (see below)
Once setup is complete, its highly advisable to test your install by updating/running ./example.bat
Typically, I build a conda/miniforge environment in windows ./env and write a batch script to activate this (./env/conda_activate.bat)
Some of the functions depend on whitebox-tools (wbt) python API. For these to work, installing FloodDownscaler2 requires installing whitebox-tools (if you haven't already) and telling FloodDownscaler2 where to find it. Below is some guidance/instructions for configuring wbt; however, there are a few ways to do this and not all ways work on all systems.
ammend the wbt_dir variable in definitions.py to point to the directory contining your whitebox_tools.exe
ammend your PYTHONPATH as shown below
compiled binaries are available here for common systems.
This is the preferred method as it provides greater version control. Typically, FloodDownscaler2 project is setup to use whitebox-tools v2.2.0 as a submodule. Typical workflow:
- clone whitebox-tools into the repo as a submodule and point to the v2.2.0 release tag.
git submodule add -b v2.2.0_tweaks https://github.com/cefect/whitebox-tools.git
git mv whitebox-tools whiteboxtools
- compile the tools. call the below within the newly cloned submodule folder. this may take a while and requires you to have rust installed (see whitebox-tools documentation for more info)
cargo build --release - update paths per the above
The project requires the PYTHONPATH to include the source directory, and two whitebox-tools directories.
Below is an example for a project that builds whitebox-tools from scratch. Replace PROJECT_DIR_NAME with the path to your repo. The last directory is created by building whitebox-tools.
PROJECT_DIR_NAME
PROJECT_DIR_NAME\whitebox-tools
PROJECT_DIR_NAME\whitebox-tools\target\release
import os
#default working directory
wrk_dir = r'L:\10_IO\fdsc2'
#test source data directory
test_data_dir = r'l:\10_IO\fdsc2\test_data'
#whitebox-tools exe location
wbt_dir = r'l:\09_REPOS\05_FORKS\whitebox-tools\target\release'
pytests are in ./tests
NOTE: coverage is poor