upgrade OpenBLAS to 0.3.0

[vchuravy]

0.3.0 was released just recently and it has some improvement w.r.t to performance on Mac OSX.

[ViralBShah]

Will the ci systems build openblas?

[ViralBShah]

Note this also updates to lapack 3.8

[ViralBShah]

FreeBSD died on Distributed. Appveyor looks like it might have timed out.

[ViralBShah]

Restarted Appveyor build, but not sure if it will help.

[vchuravy]

This might also benefit from #27222

[ViralBShah]

Should we merge #27222 and rebase this on top of that?

[tkelman]

Need to update the checksums.

[vchuravy]

All of Travis stalled out. I was thinking that it might have been an issue with their infrastructure, but there is no report.

IIUC AV doesn't build OpenBLAS since it uses the prebuilt binaries. I kicked of some buildbot runs, but that this point our queue is 18h behind.

[ViralBShah]

Pushed the checksums.

[vchuravy]

5fcc6d3 already had the checksums

[andreasnoack]

Would it make sense to start using https://github.com/staticfloat/OpenBLASBuilder/ instead of building these here?

[vchuravy]

For Appveyor yes, since currently IIUC we are using the dll from the nightly.
We shouldn't move everything to BinaryBuilder since we need to test that the buildystem here is healthy.

(I won't be the person to change us to OpenBLASBuilder, though I have my hands full enough as it is)

[ViralBShah]

@vchuravy I think I had an older branch, which is why I didn't see your checksum commit. Should have pulled.

[ViralBShah]

How do we know whether the windows buildbot successfully built openblas 0.3 last night and that is being picked up here? The appveyor build logs seem to not have any indicating information about openblas.

[vchuravy]

The buildbot builds haven even started yet, and they won't be used for the nightly.

I would propose waiting for them to go through and then merging this. At least I am not seeing any testfailures that are LinAlg related.

[Sacha0]

🎉

[ViralBShah]

This should fix #16653, JuliaLang/LinearAlgebra.jl#501, #25266 when merged.

[ViralBShah]

I am marking as backport for 0.6.3 if @ararslan will allow it, as it will fix outstanding mac performance issues for 0.6 reported in the issues above.

[ararslan]

I'd like to freeze the 0.6.3 backports at this point, otherwise it risks continuously amassing new commits while I try to resolve the one remaining issue.

[ararslan]

Just because I'm curious: @nanosoldier runbenchmarks(ALL, vs=":master")

[nanosoldier]

Something went wrong when running your job:

NanosoldierError: failed to run benchmarks against primary commit: failed process: Process(`sudo cset shield -e su nanosoldier -- -c ./benchscript.sh`, ProcessExited(1)) [1]

Logs and partial data can be found here
cc @ararslan

[KristofferC]

ERROR: LoadError: KeyError: key BenchmarkTools.TagFilter{getfield(Main, Symbol("##3#4"))}(getfield(Main, Symbol("##3#4"))()) not found
Stacktrace:
 [1] getindex at ./dict.jl:485 [inlined]
 [2] getindex(::BenchmarkTools.BenchmarkGroup, ::BenchmarkTools.TagFilter{getfield(Main, Symbol("##3#4"))}) at /home/nanosoldier/.julia/packages/BenchmarkTools/zEzk/src/groups.jl:31
 [3] top-level scope

[ViralBShah]

Will nanosoldier build openblas 0.3 on this branch?

[vchuravy]

Will nanosoldier build openblas 0.3 on this branch?

Yes nanosoldier doesn't use any caching besides ccache.

[vchuravy]

@nanosoldier runbenchmarks(ALL, vs=":master")

[nanosoldier]

Something went wrong when running your job:

NanosoldierError: failed to run benchmarks against primary commit: failed process: Process(`sudo cset shield -e su nanosoldier -- -c ./benchscript.sh`, ProcessExited(1)) [1]

Logs and partial data can be found here
cc @ararslan

[ararslan]

Nanosoldier is broken right now and I haven't yet figured out why.

[ViralBShah]

Do we really need this on the 0.7 milestone? We can do this any time, given that it is completely non-breaking.

I will also note that in reality, it should be easy to merge this shortly.

[ViralBShah]

We'll probably have openblas 0.3.1 by the time we release Julia 0.7. I have not yet seen anything major, and this looks like a good openblas release.