Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test partial input to Clay v0 #126

Closed
3 tasks
yellowcap opened this issue Jan 18, 2024 · 1 comment · Fixed by #149
Closed
3 tasks

Test partial input to Clay v0 #126

yellowcap opened this issue Jan 18, 2024 · 1 comment · Fixed by #149

Comments

@yellowcap
Copy link
Member

yellowcap commented Jan 18, 2024

After some discussions, we realized that there is a technical possiblity to run the Clay v0 model with partial inputs. We need to

  • Create an example notebook to show how that can be done
  • Test the model with a benchmark that compares partial input (ideally one for Sentinel-2 and one for Sentinel-1) with full inputs.
  • Document this.
@brunosan
Copy link
Member

I suggest we make embeddings of a subset of the training data location, and compare. Probably both the usual average embeddings (at the patch level) and the smaller ones at the self-attention patch level.

In the latter case, we would only have those corresponding to the groups we used as inputs, right?

So we compare:

Input data Embedding Case
All 13 bands Normal ones (average at patch level 5kmx5km) The normal ones
All 13 bands self-attention patch groups 300mx300m Fine-level embeddings
Only RGB Normal ones (average at patch level 5kmx5km) Restricted input, same output
Only RGB self-attention patch groups Fine embedding of band group 300mx300m

yellowcap added a commit that referenced this issue Feb 9, 2024
…149)

* Sort path list in data module

* Add band_group to clay module args

* Add tutorial for partial input burn scar embedding analysis

Closes #126, #136

* Update docs/partial-inputs.ipynb

Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com>

* Update docs/partial-inputs.ipynb

Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com>

* Update docs/partial-inputs.ipynb

Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com>

* Update docs/partial-inputs.ipynb

Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com>

* Update docs/partial-inputs.ipynb

Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com>

* Move partial inputs into tutorial section

* Small improvements on notebook

---------

Co-authored-by: Wei Ji <23487320+weiji14@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants