Image is too large to download

[jordancaraballo]

2025-02-04 12:22:10; INFO; Running CCDC.
GEE initialized successfully
^MQB02_20020321_M1BS_101001000034B200-toa_ccdc.tif: |          | 0.00/4.59M (raw) [  0.0%] in 00:00 (eta:     ?)^M                                                                                                              ^MException: Error downloading tile: Computed image is too large. URL: https://earthengine.googleapis.com/v1/projects/earthengine-legacy/thumbnails/2a9b9a671674e081129c72f9e628b8b4-4b187cf22855d4b5c8c67495c8746f8f:getPixels.
Cancelling...
^MQB02_20020321_M1BS_101001000034B200-toa_ccdc.tif: |          | 0.00/4.59M (raw) [  0.0%] in 00:02 (eta:     ?)2025-02-04 12:22:29; INFO; Exception: Error downloading tile: Computed image is too large. URL: https://earthengine.googleapis.com/v1/projects/earthengine-legacy/thumbnails/2a9b9a671674e081129c72f9e628b8b4-4b187cf22855d4b5c8c67495c8746f8f:getPixels.
Cancelling...
^MQB02_20020321_M1BS_101001000034B200-toa_ccdc.tif: |          | 0.00/4.59M (raw) [  0.0%] in 00:03 (eta:     ?)
Traceback (most recent call last):
  File "/usr/local/ilab/vhr-toolkit/vhr_toolkit/view/vhrToolkit.py", line 281, in <module>
    sys.exit(main())
             ^^^^^^
  File "/usr/local/ilab/vhr-toolkit/vhr_toolkit/view/vhrToolkit.py", line 84, in main
    processToaFile(toaFile, toaDir, toaDirNum, outDir, logger)
  File "/usr/local/ilab/vhr-toolkit/vhr_toolkit/view/vhrToolkit.py", line 156, in processToaFile
    ccdcFile: Path = ccdc.run(toaFile)[0]
                     ^^^^^^^^^^^^^^^^^
  File "/usr/local/ilab/pyCCDC/model/CCDCPipeline.py", line 151, in run
    self.gen_single_image(date_str, coords, outfile=str(out_fpath))
  File "/usr/local/ilab/pyCCDC/model/CCDCPipeline.py", line 108, in gen_single_image
    im.download(outfile, crs=proj, scale=30, region=roi, max_tile_size=2, overwrite=True)
  File "/usr/local/lib/python3.12/dist-packages/geedim/download.py", line 979, in download
    raise ex
  File "/usr/local/lib/python3.12/dist-packages/geedim/download.py", line 975, in download
    future.result()
  File "/usr/lib/python3.12/concurrent/futures/_base.py", line 449, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/lib/python3.12/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/geedim/download.py", line 965, in download_tile
    tile_array = tile.download(session=session, bar=bar)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/geedim/tile.py", line 172, in download
    return self._download_to_array(url, session=session, bar=bar)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/geedim/tile.py", line 94, in _download_to_array
    self._raise_for_status(response)
  File "/usr/local/lib/python3.12/dist-packages/geedim/tile.py", line 85, in _raise_for_status
    raise TileError(msg)
geedim.errors.TileError: Error downloading tile: Computed image is too large. URL: https://earthengine.googleapis.com/v1/projects/earthengine-legacy/thumbnails/2a9b9a671674e081129c72f9e628b8b4-4b187cf22855d4b5c8c67495c8746f8f:getPixels.

[jordancaraballo]

Reproducing the problem:

PYTHONPATH=/explore/nobackup/people/jacaraba/development python view/ccdc_cli.py --gee_config /explore/nobackup/projects/ilab/gee/gee_config.json --footprint_file "/explore/nobackup/projects/ilab/scratch/vhr-toolkit/WV02_20150911_M1BS_1030010049148A00_sr_02m.tif" --output_path /explore/nobackup/projects/ilab/scratch/vhr-toolkit/ccdc-test

[jordancaraballo]

Fails with this one:

-rw-r----- 1 nobody ilab 601M Jan 21 14:12 /explore/nobackup/projects/ilab/ilab_testing/il-tk/ILTK-output2/output.scenes-in-file-Excep-imgs-same-input.flag/5-toas/QB02_20020321_M1BS_101001000034B200-toa.tif

And this one:

-rw-rw-r-- 1 jacaraba ilab 1.7G Oct  5 13:15 /explore/nobackup/projects/ilab/scratch/vhr-toolkit/WV02_20150911_M1BS_1030010049148A00_sr_02m.tif

[jordancaraballo]

Works when adding tile size to be 0.5 MB.

Testing with this 57GB WorldView image:

-rw-rw-r--. 1 nobody nogroup 57G Aug 15  2023 /explore/nobackup/projects/3sl/data/VHR/CAS/M1BS_pansharp/WV02_20211229_M1BS_10300100CB91C300-toa-sharpened.tif
Singular