Draft: Add mini backend #192

LukeWeidenwalker · 2022-08-09T12:43:55Z

This is my attempt at a "mini-backend"!

Spins up a dask-cluster in the background with docker-compose
Installs all the dependencies needed for openeo-processes-python on the workers in a realistic way
added the notebooks/stackstac_example.ipynb notebook to showcase how this can be used interactively

…etry.

LukeWeidenwalker added 30 commits July 25, 2022 16:11

add optional depedencies

584a239

pin xarray to 2022.3.0

011c1ba

Update xarray version range to avoid ufunc deprecation.

4bec57b

Get rid of package renaming in __init__.py, this is now handled by po…

70badd1

…etry.

Update noxfile to install the extras.

e286af6

add example for multiple dispatch

4bfdfb5

Add parsing of requires_dist items

f26cec9

fix remaining issue with regex

7629ad1

more fixes to regex

2a3cbb1

parse name of import

bc8bd47

make raster & dask core again.

82d581d

remove build variants from noxfile.

f8b8108

finish poc for multi type dispatch

389861b

remove the multi dispatch example again

2d892ae

remove unused mypy setting again

204174f

Add docker-compose to spin up dask cluster

5ca1a34

add .dockerignore

dd5e7ed

Update devcontainer to install optional dependencies

b176c9f

update dockerignore.

9444180

minor edits to compose file.

d30341b

progress dump.

4a2a143

fix dockerfile

3dba762

sync versions across all containers.

7869bdd

add lz4 dependency.

80896fb

move docker-compose to .devcontainer folder

131aa2f

update reference to docker-compose

fb90ef6

fix dir for volume mount

f8f88b5

get rid of equi7grid dependency & update lockfile.

2b66310

rename notebook.

f8c0b13

bump dask version

2552e0a

Provide feedback