build: host 390x downloads #16443

bradfitz · 2016-07-20T14:50:43Z

This bug is about

how to cross-compile s390x release binaries for x/build/cmd/release
hosting said binaries on golang.org/dl (but only after we've figured out (1)

@jfrazelle had mentioned CC=gcc-5-s390x-linux-gnu. There a Debian package for that? We want to be able to build s390x binaries on linux-amd64. (All other release builds are built + tested on either native hardware or VMs, but we'll have to stop at just make.bash for s390x).

As for (2), we briefly discussed having a section or column to denote which builds are at which support status. Let's defer that discussion until we have (1) figured out.

/cc @billotosyr, @adg, @broady

The text was updated successfully, but these errors were encountered:

jessfraz · 2016-07-20T15:04:14Z

so this (gcc-s390x-linux-gnu) is unfortunately only in
stretch/sid/experimental
https://packages.debian.org/search?keywords=gcc-s390x-linux-gnu

On Wed, Jul 20, 2016 at 10:51 AM, Brad Fitzpatrick <notifications@github.com

wrote:

This bug is about

how to cross-compile s390x release binaries for x/build/cmd/release

hosting said binaries on golang.org/dl (but only after we've figured
out (1)

@jfrazelle https://github.com/jfrazelle had mentioned
CC=gcc-5-s390x-linux-gnu. There a Debian package for that? We want to be
able to build s390x binaries on linux-amd64. (All other release builds are
built + tested on either native hardware or VMs, but we'll have to stop at
just make.bash for s390x).

As for (2), we briefly discussed having a section or column to denote
which builds are at which support status. Let's defer that discussion until
we have (1) figured out.

/cc @billotosyr https://github.com/billotosyr, @adg
https://github.com/adg, @broady https://github.com/broady

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
#16443, or mute the thread
https://github.com/notifications/unsubscribe-auth/ABYNbDj4gkH-ezRFTROIkJyPUv2qoMj9ks5qXjX8gaJpZM4JQ2_8
.

Jessie Frazelle
4096R / D4C4 DD60 0D66 F65A 8EFC 511E 18F3 685C 0022 BFF3
pgp.mit.edu http://pgp.mit.edu/pks/lookup?op=get&search=0x18F3685C0022BFF3

bradfitz · 2016-07-20T15:06:30Z

That's fine. We can build it in a bleeding-edge-Debian container.

minux · 2016-07-20T20:26:09Z

If we cross compile s390 binary, why not also crosscompile and provide downloads for other Linux ports as well? MIPS and PPC come to mind. Even simpler, we could do a nocgo release, and document how the user could rebuild the choir using packages once unpacked and before installation. This post-unpack rebuild also allow the user to change the embedded GOROOT.

jessfraz · 2016-07-20T20:30:15Z

Can I please volunteer as tribute to figure out MIPS cross compilation,
also fwiw I've played w Power cross compiling as well

On Wednesday, July 20, 2016, Minux Ma notifications@github.com wrote:

If we cross compile s390 binary, why not also crosscompile and provide
downloads for other Linux ports as well? MIPS and PPC come to mind.

Even simpler, we could do a nocgo release, and document how the user could
rebuild the choir using packages once unpacked and before installation.
This post-unpack rebuild also allow the user to change the embedded GOROOT.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
#16443 (comment), or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABYNbP6hafL2iOlAqz8ya1oviCCNY8Hiks5qXoSbgaJpZM4JQ2_8
.

Jessie Frazelle
4096R / D4C4 DD60 0D66 F65A 8EFC 511E 18F3 685C 0022 BFF3
pgp.mit.edu http://pgp.mit.edu/pks/lookup?op=get&search=0x18F3685C0022BFF3

broady · 2016-07-20T23:35:31Z

If we do end up cross-compiling, we should still run the tests on a real machine against the cross-compiled version.

@billotosyr is IBM able to provide access to that?

bradfitz · 2016-07-20T23:36:45Z

@broady, the idea is we'll only run cmd/release at a hash which has already passed on the dashboard for s390x.

billotosyr · 2016-08-17T14:55:28Z

Now that 1.7 is out, is it possible to nudge this issue forward? Thx...

bradfitz · 2016-08-17T15:00:55Z

I'm still waiting for somebody to give me a Docker recipe for building these things.

@jfrazelle had volunteered?

jessfraz · 2016-08-17T20:40:53Z

On it!

gopherbot · 2016-08-17T22:00:39Z

CL https://golang.org/cl/27242 mentions this issue.

billotosyr · 2016-08-29T17:43:27Z

Can this be moved to the next step? Thx.

Update golang/go#16443 Change-Id: I59edb7334ad6236981b96faddb8aeb564579435b Reviewed-on: https://go-review.googlesource.com/27242 Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>

bradfitz · 2016-08-30T20:35:59Z

I tried to deploy this, but it doesn't work and I failed to figure out why.

CL was https://go-review.googlesource.com/c/28172/

/cc @evandbrown @jfrazelle

jessfraz · 2016-08-30T20:40:50Z

maybe i am missing something that is needed for systemd in the container? thats how these run right... i will try some things locally to see

bradfitz · 2016-08-30T20:47:45Z

There's no systemd in these containers.

See x/build/env/linux-x86-std-kube/Dockerfile for a model. These run in Kubernetes.

jessfraz · 2016-08-30T21:00:34Z

oh i know what it is ill make a CL, facepalm

gopherbot · 2016-08-30T21:00:38Z

CL https://golang.org/cl/28172 mentions this issue.

bradfitz · 2016-08-31T00:08:23Z

Can somebody with s390x verify that this build works: https://storage.googleapis.com/go-builder-data/go.devel.linux-s390x.tar.gz.TMP ?

And can somebody review https://go-review.googlesource.com/28172 ? The tarball above was generated with cmd/release from that CL.

minux · 2016-08-31T00:18:20Z

Given that we have cross compiling infrastructure in place, could we also host tarballs for other supported Linux architectures? arm64/ppc64/ppc64le/mips64 and mips64le. None of them can be easily bootstrapped from C without using another architecture. (There is a route for ppc64/ppc64le, but it's very tedious.)

bradfitz · 2016-08-31T00:20:35Z

@minux, I suppose. If we flag the experimental ones as experimental loudly on our downloads page.

mwhudson · 2016-08-31T01:29:53Z

On 31 August 2016 at 12:08, Brad Fitzpatrick notifications@github.com
wrote:

Can somebody with s390x verify that this build works:
https://storage.googleapis.com/go-builder-data/go.devel.
linux-s390x.tar.gz.TMP ?

I downloaded it, unpacked it and "GOROOT=$(pwd) ./bin/go test -short
runtime" passes, enough?

bradfitz · 2016-08-31T01:33:58Z

@mwhudson, can you confirm that cgo works? Maybe just that os/user tests pass without skips? (since os/user uses cgo)

mwhudson · 2016-08-31T01:41:49Z

On 31 August 2016 at 13:34, Brad Fitzpatrick notifications@github.com
wrote:

@mwhudson https://github.com/mwhudson, can you confirm that cgo works?
Maybe just that os/user tests pass without skips? (since os/user uses cgo)

Yeah, that works. I also ran "./bin/go tool dist test" and everything
passed apart from the API check (because there is no src/cmd/api in the
tarball...)

Cheers,
mwh

billotosyr · 2016-08-31T19:50:37Z

This tarball worked fine for me. I did have to export CC=gcc on systems other than Ubuntu, otherwise cgo would give me the error 'exec: "s390x-linux-gnu-gcc": executable file not found in $PATH'. This is only a minor nit, so please feel free to publish the tarball. Thank you very much for taking care of this!!

Also modifies cmd/release to wire it up. Updates golang/go#16443 Change-Id: Ie80a224957f6f662d0aec0fd083e2a57e30436c4 Reviewed-on: https://go-review.googlesource.com/28172 Reviewed-by: Jessica Frazelle <me@jessfraz.com> Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>

bradfitz · 2016-09-01T01:43:28Z

Assigning to @broady at this point, since cmd/release now supports it. Chris, maybe you can put up the s390x binaries tomorrow with Go 1.7.1?

jessfraz · 2016-09-01T22:55:49Z

teamwork!!! high five!!

minux · 2016-09-02T01:04:40Z

I think we need to fix the CC=gcc issue. We can use a gcc wrapper on the builder.

bradfitz · 2016-09-07T22:18:22Z

This happened. Go 1.7.1 includes s390x binaries on https://golang.org/dl/

Thanks, @jfrazelle, @broady, @mwhudson, @billotosyr ...

jessfraz · 2016-09-07T22:54:57Z

🙌🏼🙌🏼

On Wednesday, September 7, 2016, Brad Fitzpatrick notifications@github.com
wrote:

Closed #16443 #16443.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
#16443 (comment), or mute the
thread
https://github.com/notifications/unsubscribe-auth/ABYNbK8X5YUq2BsDHkM8mUBhmOEfD6tgks5qnzhvgaJpZM4JQ2_8
.

Jessie Frazelle
4096R / D4C4 DD60 0D66 F65A 8EFC 511E 18F3 685C 0022 BFF3
pgp.mit.edu http://pgp.mit.edu/pks/lookup?op=get&search=0x18F3685C0022BFF3

billotosyr · 2016-09-07T23:01:36Z

Thanks!

jessfraz · 2016-09-08T03:07:45Z

Let's cross compile MIPS now!!!

On Wednesday, September 7, 2016, billotosyr notifications@github.com
wrote:

Thanks!

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
#16443 (comment), or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABYNbE-VoQK_pT7uBGuKtQqgg7suKGbtks5qn0KQgaJpZM4JQ2_8
.

Jessie Frazelle
4096R / D4C4 DD60 0D66 F65A 8EFC 511E 18F3 685C 0022 BFF3
pgp.mit.edu http://pgp.mit.edu/pks/lookup?op=get&search=0x18F3685C0022BFF3

bradfitz added this to the Unreleased milestone Jul 20, 2016

bradfitz assigned broady Sep 1, 2016

bradfitz closed this as completed Sep 7, 2016

golang locked and limited conversation to collaborators Sep 8, 2017

gopherbot added the FrozenDueToAge label Sep 8, 2017

rsc unassigned broady Jun 23, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

build: host 390x downloads #16443

build: host 390x downloads #16443

bradfitz commented Jul 20, 2016

jessfraz commented Jul 20, 2016

bradfitz commented Jul 20, 2016

minux commented Jul 20, 2016 via email

jessfraz commented Jul 20, 2016

broady commented Jul 20, 2016 •

edited

Loading

bradfitz commented Jul 20, 2016

billotosyr commented Aug 17, 2016

bradfitz commented Aug 17, 2016

jessfraz commented Aug 17, 2016

gopherbot commented Aug 17, 2016

billotosyr commented Aug 29, 2016

bradfitz commented Aug 30, 2016

jessfraz commented Aug 30, 2016

bradfitz commented Aug 30, 2016

jessfraz commented Aug 30, 2016

gopherbot commented Aug 30, 2016

bradfitz commented Aug 31, 2016

minux commented Aug 31, 2016 via email

bradfitz commented Aug 31, 2016

mwhudson commented Aug 31, 2016

bradfitz commented Aug 31, 2016

mwhudson commented Aug 31, 2016

billotosyr commented Aug 31, 2016

bradfitz commented Sep 1, 2016

jessfraz commented Sep 1, 2016

minux commented Sep 2, 2016 via email

bradfitz commented Sep 7, 2016

jessfraz commented Sep 7, 2016

billotosyr commented Sep 7, 2016

jessfraz commented Sep 8, 2016

build: host 390x downloads #16443

build: host 390x downloads #16443

Comments

bradfitz commented Jul 20, 2016

jessfraz commented Jul 20, 2016

bradfitz commented Jul 20, 2016

minux commented Jul 20, 2016 via email

jessfraz commented Jul 20, 2016

broady commented Jul 20, 2016 • edited Loading

bradfitz commented Jul 20, 2016

billotosyr commented Aug 17, 2016

bradfitz commented Aug 17, 2016

jessfraz commented Aug 17, 2016

gopherbot commented Aug 17, 2016

billotosyr commented Aug 29, 2016

bradfitz commented Aug 30, 2016

jessfraz commented Aug 30, 2016

bradfitz commented Aug 30, 2016

jessfraz commented Aug 30, 2016

gopherbot commented Aug 30, 2016

bradfitz commented Aug 31, 2016

minux commented Aug 31, 2016 via email

bradfitz commented Aug 31, 2016

mwhudson commented Aug 31, 2016

bradfitz commented Aug 31, 2016

mwhudson commented Aug 31, 2016

billotosyr commented Aug 31, 2016

bradfitz commented Sep 1, 2016

jessfraz commented Sep 1, 2016

minux commented Sep 2, 2016 via email

bradfitz commented Sep 7, 2016

jessfraz commented Sep 7, 2016

billotosyr commented Sep 7, 2016

jessfraz commented Sep 8, 2016

broady commented Jul 20, 2016 •

edited

Loading