Can kiwix-tools armv6 and armv8 be made downloadable with version-independent redirects, as with all other arch's?

[holta]

@mgautierfr

As seen on page:

https://www.kiwix.org/en/downloads/kiwix-serve/

Currently these redirects work:

https://download.kiwix.org/release/kiwix-tools/kiwix-tools_win-i686.zip
https://download.kiwix.org/release/kiwix-tools/kiwix-tools_linux-x86_64.tar.gz
https://download.kiwix.org/release/kiwix-tools/kiwix-tools_linux-i586.tar.gz
https://download.kiwix.org/release/kiwix-tools/kiwix-tools_linux-aarch64.tar.gz

Whereas these redirects do not (yet!) work:

https://download.kiwix.org/release/kiwix-tools/kiwix-tools_linux-armv6.tar.gz
https://download.kiwix.org/release/kiwix-tools/kiwix-tools_linux-armv8.tar.gz

Just FYI there's one legacy redirect here, that currently leads to a broken v3.5.0 build:

https://download.kiwix.org/release/kiwix-tools/kiwix-tools_linux-armhf.tar.gz

[kelson42]

@holta Working redirects are listed on Product page. AFAIK all the binaries are available through them, so we don't need anything additional.

@mgautierfr Why do we have newly files kiwix-tools_linux-armv8-3.5.0-1.tar.gz and kiwix-tools_linux-armv6-3.5.0-1.tar.gz. We should stick to the aarch64 and armhf like before, otherwise it should have been discussed. Why we don't have the latest build of kiwix-tools_linux-armhf-3.5.0.tar.gz? It's important we stick to the naming, otherwise it has important consequences.

[mgautierfr]

@mgautierfr Why do we have newly files kiwix-tools_linux-armv8-3.5.0-1.tar.gz and kiwix-tools_linux-armv6-3.5.0-1.tar.gz. We should stick to the aarch64 and armhf like before, otherwise it should have been discussed. Why we don't have the latest build of kiwix-tools_linux-armhf-3.5.0.tar.gz? It's important we stick to the naming, otherwise it has important consequences.

This came from this PR : kiwix/kiwix-build#615

As said in the description: "This introduce a difference between armv6 and armv8."

[kelson42]

@rgaudin Any feedback about the differences and benefits between armhf, armv6, armv7 and armv8?

[rgaudin]

https://github.com/offspot/container-images/wiki/Raspberry-Pi-Models

[rgaudin]

Let me know if should add the redirects ; for Linux we currently build

• kiwix-tools_linux-x86_64
• kiwix-tools_linux-aarch64
• kiwix-tools_linux-armv6
• kiwix-tools_linux-armv8
• kiwix-tools_linux-i586

Here's the Dockerfile for kiwix-tools image (not merged)

kiwix-tools/docker/Dockerfile

Lines 11 to 22 in 91a9dff

	if [ "$TARGETPLATFORM" = "linux/386" ]; then ARCH="i586"; \
	# linux/arm64/v8 points to linux/arm64
	elif [ "$TARGETPLATFORM" = "linux/arm64/v8" \
	-o "$TARGETPLATFORM" = "linux/arm64" ]; then ARCH="aarch64"; \
	# linux/arm translates to linux/arm/v7
	elif [ "$TARGETPLATFORM" = "linux/arm/v7" ]; then ARCH="armv8"; \
	elif [ "$TARGETPLATFORM" = "linux/arm/v6" ]; then ARCH="armv6"; \
	elif [ "$TARGETPLATFORM" = "linux/amd64/v3" \
	-o "$TARGETPLATFORM" = "linux/amd64/v2" \
	-o "$TARGETPLATFORM" = "linux/amd64" ]; then ARCH="x86_64"; \
	# we dont suppot any other arch so let it fail
	else ARCH="unknown"; fi && \

[mgautierfr]

Raspbian armhf means ARMv6 + VFPv2 while Debian armhf means ARMv7.

This confirms to me that we should stay with armv6 and armv8 and stop naming our build with armhf

[rgaudin]

Should we remove the 3.5.0 armhf file? It's broken, there's no update and from what I understand, there won't be.

I just got fooled updating the hotspot with the latest armhf

[kelson42]

@mgautierfr Can you please tell us which meaning of armhf is used (see https://github.com/offspot/container-images/wiki/Raspberry-Pi-Models)

Assuming we use the "Raspian meaning", I hope I understand all the aspects of this problem. Here would be what I would recommend:

• Remove last broken build of armhf for Linux
• Remove armhf link in https://www.kiwix.org/en/downloads/kiwix-serve/
• Add link to armv6 as offer for the ARM 32 bits at https://www.kiwix.org/en/downloads/kiwix-serve/
• Fix kiwix-tools (and kiwix-serve) container images (like @rgaudin as proposed)
• Fix zim-tools container images the same way

@mgautierfr @rgaudin Does that makes sense? What else should be updated?

[rgaudin]

• Remove last broken build of armhf for Linux
• Remove armhf link in https://www.kiwix.org/en/downloads/kiwix-serve/ @Popolechien
• Add link to armv6 as offer for the ARM 32 bits at https://www.kiwix.org/en/downloads/kiwix-serve/ @Popolechien
• Fix kiwix-tools (and kiwix-serve) container images (like @rgaudin as proposed) @mgautierfr
• Fix zim-tools container images the same way.

@kelson42 zim-tools image is x86_64 only

[Popolechien]

I've replaced the armhf link with a link to kiwix-tools_linux-armv6-3.5.0-1.tar.gz but for future iterations it would be good to have a more generic redirect (e.g. kiwix-tools_linux-armv6.tar.gz) much like the others.

[kelson42]

@rgaudin Can you please put the few additional redirects in place?

[rgaudin]

@rgaudin Can you please put the few additional redirects in place?

Done and deployed.
As of today, every single Kiwix and openZIM release file should have a version-less redirect.

[mgautierfr]

Sorry about late reply but:

Remove armhf link in kiwix.org/en/downloads/kiwix-serve @Popolechien

It would be better to setup a redirection instead of removing ?

Add link to armv6 as offer for the ARM 32 bits at kiwix.org/en/downloads/kiwix-serve @Popolechien

What about armv8 ?
If we don't create a redirection for it, I suggest we don't build/publish it neither.

[kelson42]

@Popolechien Two things to fix:

• « x86 ARM (64 bits) » does not exist. « ARM (64 bits) » does
• All redirects are ready now, please use them
• Add a sentence below the binary link like « Older and alternative (for other architectures) can be found at https://download.kiwix.org/release/kiwix-tools/ « .

[Popolechien]

@kelson42 Done.

[kelson42]

@rgaudin so i guess there is only the work on the two container images left.

[rgaudin]

@rgaudin so i guess there is only the work on the two container images left.

What work? This PR has been sitting there for 3 weeks. There's nothing left to do but merge

[kelson42]

@rgaudin (1) Fix kiwix-tools (and kiwix-serve) container images (2) Fix zim-tools container images the same way.

I believe it has not been completed, or do you have PR for this?

[rgaudin]

@rgaudin (1) Fix kiwix-tools (and kiwix-serve) container images (2)

I'm sorry I really don't understand what you are talking about. This is #622

Fix zim-tools container images the same way.

That I haven't submitted a PR yet.

[kelson42]

@rgaudin Thx, I have merged #622

[kelson42]

@rgaudin I have created openzim/zim-tools#351 to request the improvement of container images on ZIM tools. That way we can also close this ticket. @holta Thank you for pointing the many bugs and weaknesses around the distribution of the Kiwix Tools binaries.