How long it takes to restart a docker instance if the total jobs are 10Million+ ?

[geminigeek]

hi,

can anyone suggest how long it takes for the docker instance to restart if i had over 10Million jobs listed when i shutdown the docker container, rather i would like to know what happens when the server is restarted, with many durable jobs on disk?

i waited 15 min the instance is still not accessible ? 15 min is too much for whatever process it takes to load data from disk to memory/queue system?

docker stats showing 100% cpu usage, htop showing no significant cpu usage ? total disk files on docker volumes are 24 GB , there seems to be no significant disk IO activity also, my system have 128GB ram

using latest 2.0.2

[spuun]

When I try locally on my laptop (MBP m1), no docker involved, it loads 25M messages (25GB) in ~45 seconds. It feels like your problem is docker related. If you try with log level info, does it log any progress while loading? It should log lines like Loaded 512/3124 segments, 4098048 messages.

We know the startup times aren't perfect and will work on improving this even more.