Better integrate ZIM upload to worker process

[kelson42]

Currently the upload process is not really part of the whole and if it fails it is not reported.

This is a problem because this is really not transparent and:

• Difficult to detect
• Difficult to diagnose
• We can loose ZIM files

I would propose that:

• We integrate it to the process (no full success if not fully uploaded)
• If problem, worker task tries without a end and status is stalled (until it works or task is cancelled)

[Jaifroid]

It looks like wikipedia_en_endless_maxi_2022-04.zim never made it to download.kiwix.org (it should be here). I think it is connected to this issue, but please correct me if wrong.

[rgaudin]

Due to #688 yes

[Jaifroid]

OK, thanks, (though I didn't post in #688 because it was closed in favour of this issue, I think).

[rgaudin]

#688 was a bug that affected that ZIM (look at the dates, it was about a month ago). This ticket is about improving the current system so we're aware when such issues occur.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be now be reviewed manually. Thank you for your contributions.