Dry run of STAC Catalog iteration

[banesullivan]

A dry run test of iterating over the STAC Catalogs. Both Sentinel and Landsat catalogs error after 10000 items, but the Landsat one gives an error message:

search_phase_execution_exception: [illegal_argument_exception] Reason: Result window is too large, from + size must be less than or equal to: [10000] but was [10010]. See the scroll api for a more efficient way to request large data sets. This limit can be set by changing the [index.max_result_window] index level setting.

The S3 static catalogs work fine.

---

This seems relevant: sat-utils/sat-api#225

[codecov-commenter]

Codecov Report

Merging #44 (1bbe14e) into main (0c974ba) will decrease coverage by 0.21%.
The diff coverage is 84.61%.

@@            Coverage Diff             @@
##             main      #44      +/-   ##
==========================================
- Coverage   74.24%   74.03%   -0.22%     
==========================================
  Files          34       34              
  Lines         695      697       +2     
==========================================
  Hits          516      516              
- Misses        179      181       +2     

Impacted Files	Coverage Δ
rgd-watch-client/rgd_watch_client/plugin.py	95.45% <75.00%> (-4.55%)	⬇️
rgd-watch-client/rgd_watch_client/__init__.py	78.57% <83.33%> (-1.43%)	⬇️
watch/core/tests/test_client.py	100.00% <100.00%> (ø)
watch/core/tests/test_stac.py	100.00% <100.00%> (ø)

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8296998...1bbe14e. Read the comment docs.

[banesullivan]

@mcovalt, will you be able to look into this after finishing the deployment scripts, etc?

[banesullivan]

This is working for everything but landsat/sentinel. Merging...

We can enable the LS/S2 in a follow up PR