Huge difference on request response time

[pablo-padua]

Hi, I'm running a quick setup build following titiler's readme docs and I opted for the docker container run.
docker run --name titiler \ -p 8000:8000 \ --env PORT=8000 \ --env WORKERS_PER_CORE=2 \ --rm -it ghcr.io/developmentseed/titiler:latest
However, tile requests are taking forever and when compared to TiTiler's dev environment @ https://titiler.xyz it is insanely faster (6000ms X 100ms in general).

My question is, are there any after-container-up commands that must be run in order to make it faster, should I run the application directly and not via docker or what could possibly be the issue here ?

Via my VPS

Via TiTiler dev env

[maxrjones]

One of the titiler devs may have a more detailed response for you, but FYI the GDAL environment variables referenced in performance tuning are known to hugely influence tiling time.

[vincentsarago]

I think this might mostly be linked to the network. titiler.xyz is deployed on AWS Lambda using this configuration

titiler/deployment/aws/cdk/config.py

Lines 20 to 30 in 725f857

	env: Dict = {
	"GDAL_CACHEMAX": "200", # 200 mb
	"GDAL_DISABLE_READDIR_ON_OPEN": "EMPTY_DIR",
	"GDAL_INGESTED_BYTES_AT_OPEN": "32768", # get more bytes when opening the files.
	"GDAL_HTTP_MERGE_CONSECUTIVE_RANGES": "YES",
	"GDAL_HTTP_MULTIPLEX": "YES",
	"GDAL_HTTP_VERSION": "2",
	"PYTHONWARNINGS": "ignore",
	"VSI_CACHE": "TRUE",
	"VSI_CACHE_SIZE": "5000000", # 5 MB (per file-handle)
	}

we use the same env in the docker compose file

titiler/docker-compose.yml

Lines 24 to 32 in 725f857

	- GDAL_CACHEMAX=75%
	- GDAL_INGESTED_BYTES_AT_OPEN=32768
	- GDAL_DISABLE_READDIR_ON_OPEN=EMPTY_DIR
	- GDAL_HTTP_MERGE_CONSECUTIVE_RANGES=YES
	- GDAL_HTTP_MULTIPLEX=YES
	- GDAL_HTTP_VERSION=2
	- PYTHONWARNINGS=ignore
	- VSI_CACHE=TRUE
	- VSI_CACHE_SIZE=536870912

you may want to set those in your docker run command

[pablo-padua]

@vincentsarago and @maxrjones Awesome, thank you both for the reply.
Since you did say these were on the docker compose file, I ran
git clone https://github.com/developmentseed/titiler.git
cd titiler
docker compose up --build titiler
and I believe the previous way I was running it - was not using any of these commands because the get tile requests are much faster now.
Do you have some docs or guidelines that I should follow when exporting/transforming my .tiff to COG before uploading to BlobStorage/S3 for maximum performance?
I use GDAL.
Also, is there any way to improve the preview performance ? It's a few kb image it should query within a few ms but its taking 1.6s now (compared to the previous 6s that's gold but still could be better I guess)

[vincentsarago]

Do you have some docs or guidelines that I should follow when exporting/transforming my .tiff to COG before uploading to BlobStorage/S3 for maximum performance?

depends what you want to do with your COG, if it's just for viz on a WebMercator map: https://cogeotiff.github.io/rio-cogeo/Advanced/#web-optimized-cog

Also, is there any way to improve the preview performance ? It's a few kb image it should query within a few ms but its taking 1.6s now (compared to the previous 6s that's gold but still could be better I guess)

I have no idea 😬