Migrate Bintray urls somewhere else

[MikeMcQuaid]

After May 1st all links to Bintray will be broken. Our homebrew/bottles will be migrated in time and probably our homebrew/mirrors but there's a lot of other packages using Bintray that we'll need to find other hosts for:

Using homebrew/mirror:

$ rg 'url ".+bintray' | sort | grep homebrew/homebrew
Formula/afsctool.rb:  url "https://dl.bintray.com/homebrew/mirror/afsctool-1.6.4.zip"
Formula/berkeley-db.rb:  url "https://dl.bintray.com/homebrew/mirror/berkeley-db-18.1.40.tar.gz"
Formula/cabocha.rb:  url "https://dl.bintray.com/homebrew/mirror/cabocha-0.69.tar.bz2"
Formula/caffe.rb:    url "https://bintray.com/homebrew/mirror/download_file?file_path=bvlc_reference_caffenet.caffemodel"
Formula/dpkg.rb:  url "https://dl.bintray.com/homebrew/mirror/dpkg-1.20.7.1.tar.xz"
Formula/gcore.rb:  url "https://dl.bintray.com/homebrew/mirror/gcore-1.3.tar.gz"
Formula/imagemagick.rb:  url "https://dl.bintray.com/homebrew/mirror/ImageMagick-7.0.11-5.tar.xz"
Formula/imagemagick@6.rb:  url "https://dl.bintray.com/homebrew/mirror/ImageMagick-6.9.12-5.tar.xz"
Formula/libelf.rb:  url "https://dl.bintray.com/homebrew/mirror/libelf-0.8.13.tar.gz" # using this url since original source is offline ( https://github.com/Homebrew/homebrew-core/pull/54887 )
Formula/lzop.rb:  url "https://dl.bintray.com/homebrew/mirror/lzop-1.04.tar.gz"
Formula/pdflib-lite.rb:  url "https://dl.bintray.com/homebrew/mirror/pdflib-lite--7.0.5p3.tar.xz"
Formula/qemu.rb:    url "https://dl.bintray.com/homebrew/mirror/FD12FLOPPY.zip"
Formula/snow.rb:  url "https://dl.bintray.com/homebrew/mirror/snow-20130616.tar.gz"

Using something else:

$ rg 'url ".+bintray' | sort | grep -v homebrew/homebrew
Formula/artifactory.rb:    url "https://dl.bintray.com/jfrog/artifactory/"
Formula/artifactory.rb:  url "https://dl.bintray.com/jfrog/artifactory/jfrog-artifactory-oss-6.23.13.zip"
Formula/boost-bcp.rb:  url "https://dl.bintray.com/boostorg/release/1.75.0/source/boost_1_75_0.tar.bz2"
Formula/boost-mpi.rb:  url "https://dl.bintray.com/boostorg/release/1.75.0/source/boost_1_75_0.tar.bz2"
Formula/boost-python.rb:  url "https://dl.bintray.com/boostorg/release/1.74.0/source/boost_1_74_0.tar.bz2"
Formula/boost-python3.rb:  url "https://dl.bintray.com/boostorg/release/1.75.0/source/boost_1_75_0.tar.bz2"
Formula/boost.rb:  url "https://dl.bintray.com/boostorg/release/1.75.0/source/boost_1_75_0.tar.bz2"
Formula/denominator.rb:  url "https://bintray.com/artifact/download/netflixoss/maven/com/netflix/denominator/denominator-cli/4.7.1/denominator-cli-4.7.1-fat.jar"
Formula/embulk.rb:  url "https://bintray.com/artifact/download/embulk/maven/embulk-0.9.23.jar"
Formula/golo.rb:  url "https://bintray.com/artifact/download/golo-lang/downloads/golo-3.3.0.zip"
Formula/griffon.rb:  url "https://dl.bintray.com/content/aalmiray/Griffon/griffon-1.5.0-bin.tgz"
Formula/groovy.rb:    url "https://dl.bintray.com/groovy/maven/"
Formula/groovy.rb:  url "https://dl.bintray.com/groovy/maven/apache-groovy-binary-3.0.7.zip"
Formula/groovysdk.rb:    url "https://dl.bintray.com/groovy/maven/"
Formula/groovysdk.rb:  url "https://dl.bintray.com/groovy/maven/apache-groovy-sdk-3.0.7.zip"
Formula/hyperkit.rb:    url "https://dl.bintray.com/markeissler/homebrew/hyperkit-kernel/tinycorelinux_8.x.tar.gz"
Formula/jbake.rb:  url "https://dl.bintray.com/jbake/binary/jbake-2.6.5-bin.zip"
Formula/kaitai-struct-compiler.rb:  url "https://bintray.com/artifact/download/kaitai-io/universal/0.9/kaitai-struct-compiler-0.9.zip"
Formula/percona-server.rb:    url "https://dl.bintray.com/boostorg/release/1.73.0/source/boost_1_73_0.tar.bz2"
Formula/percona-xtrabackup.rb:    url "https://dl.bintray.com/boostorg/release/1.73.0/source/boost_1_73_0.tar.bz2"
Formula/pushpin.rb:  url "https://dl.bintray.com/fanout/source/pushpin-1.31.0.tar.bz2"
Formula/quantlib.rb:  url "https://dl.bintray.com/quantlib/releases/QuantLib-1.21.tar.gz"
Formula/savana.rb:  url "https://bintray.com/artifact/download/bintray/jcenter/org/codehaus/savana/1.2/savana-1.2-install.tar.gz"
Formula/snzip.rb:  url "https://bintray.com/artifact/download/kubo/generic/snzip-1.0.4.tar.gz"
Formula/swagger2markup-cli.rb:  url "https://jcenter.bintray.com/io/github/swagger2markup/swagger2markup-cli/1.3.3/swagger2markup-cli-1.3.3.jar"
Formula/zurl.rb:  url "https://dl.bintray.com/fanout/source/zurl-1.11.0.tar.bz2"

CC @Homebrew/core for help with this.

[MikeMcQuaid]

Our homebrew/bottles will be migrated in time and probably our homebrew/mirrors

Note, given this: I think it'd be good to migrate all urls using homebrew/mirror to something else for now (where possible) and we can keep our mirrors.

[SMillerDev]

Artifactory does not provide a non-artifactory DL link.

[SMillerDev]

I'm going back to the work people pay me for, anything from groovy and onward is up for grabs.

[Bo98]

Artifactory does not provide a non-artifactory DL link.

Artifactory isn't sunsetting and, as far as I gather, Artifactory repositories that are linked with Bintray are unaffected. We can keep an eye on it however as I imagine they'll update the the link in time if it is in fact going to change.

[Bo98]

Looking through some, it's worth nothing that not everyone has migrated yet and that's ok - there's still a bit of time. Upstream issues can be opened if there's no clear indication of what the plans are.

[Bo98]

Are you referring to bottle downloads? Homebrew 3.1.0 has been released which migrates away from Bintray.

[arximboldi]

Aha! Yeah that was it. It was happening on Github Actions... I'll figure how to upgrade Homebrew there. Thanks a lot for the quick response!

[MikeMcQuaid]

I'll figure how to upgrade Homebrew there

brew update.

[carlocab]

Do brew update before anything else.

[SMillerDev]

Update brew so it pulls from github packages.

[carlocab]

There's a small bug: Homebrew/brew#11126 You'll need to do it manually for now.

[MalinnaLeach]

Forgot that this was a different repo from the PR I wanted to link. Fixed it a few minutes ago. Just please do brew update first.

Great - this is working again - thank you!

[Bo98]

I'm doing a load of migrations in #76334.

There's a couple more (kaitai-struct-compiler and zurl) that I'm discussing with upstream about.

I've ignored griffon and gcore since they are disabled and I unfortunately could not find mirrors for them. I've downloaded a copy locally of them should we need it.

Boost is handled by #75459 but I may open a PR to update the 1.75 links if I don't find a quick fix for the 1.76 blockers.

We need to figure out where to host this since it appears to be a resource created just for our tests.

[MikeMcQuaid]

Thanks @Bo98!

We need to figure out where to host this since it appears to be a resource created just for our tests.

Uploaded it as a GitHub issue comment attachment, lol (and these stick around indefinitely as they are essentially just S3): https://github.com/Homebrew/homebrew-core/files/6405545/tinycorelinux_8.x.tar.gz

[Bo98]

Sneaky! #76337

[carlocab]

Boost is handled by #75459 but I may open a PR to update the 1.75 links if I don't find a quick fix for the 1.76 blockers.

I wouldn't worry too much about Boost. They're staying with JFrog and still posted Bintray links for 1.76, so I suspect any Bintray links for Boost will still resolve correctly.

Edit: They did modify all the links they posted after this announcement. I'll keep an eye on it and change them if needed.

[carlocab]

Boost formulae: #76463

[Bo98]

Final update:

$ grep -R "bintray\.com" .
./gcore.rb:  url "https://dl.bintray.com/homebrew/mirror/gcore-1.3.tar.gz"
./griffon.rb:  url "https://dl.bintray.com/content/aalmiray/Griffon/griffon-1.5.0-bin.tgz"

gcore will remain online until 4th July. The formula is now disabled however. Presumably because it didn't build on Big Sur?

griffon is an old version and was disabled a few weeks ago as a result.

[MikeMcQuaid]

Great work, thanks @Bo98!

[MikeMcQuaid]

(and everyone else like @carlocab, too!)