0.7 compile time doesn't work as well anymore

[SimonDanisch]

I'll soon push a branch with snoopcompile + sysimage working.
Meanwhile, the compilation speed improvements are not as drastic anymore.
I hope (am pretty sure?), this is just some flag we need to figure out.

userimg = Pkg.dir("Makie", "test", "precompile.jl")
image_path = PackageCompiler.sysimg_folder()
PackageCompiler.build_sysimg(image_path, userimg, compilecache = "yes")

precompile.jl generated with julia --trace-compilation=yes runtests.jl.
Speed improvement is just from 80s to 20s, with a precompile file that should definitely have everything needed in it.

[SimonDanisch]

Damn, if I try to double check with build_sysimg.jl, I'll get:

PS C:\Users\sdani> julia
ERROR: System image file failed consistency check: maybe opened the wrong version?

With PackageCompiler it works though - and I also double checked that it's not some actual runtime in Makie that takes the 20s.
@vtjnash > 90% of the profile trace point to abstract interpretation, so I guess it's save to assume that some compilation/lowering isn't cached.

[SimonDanisch]

I see:
JuliaLang/julia#27629

[SimonDanisch]

JuliaLang/julia#27451

[SimonDanisch]

Good and bad news :D build_sysimg works exactly the same as PackageCompiler... So guess that means PackageCompiler is already up to date - but also means we don't get such large speed ups for some reason.

[NHDaly]

I talked some about my investigations into this here:
NHDaly/ApplicationBuilder.jl#24

Perhaps I should merge that issue into this one, since this Repo sees a lot more traffic.

But, tl;dr, by setting both --compile=all when compiling, and compile=min in the jloptions in the C driver program at runtime, i was able to actually avoid a bunch of recompilation at runtime. Without this, it was always recompiling everything for me.

Is this already something you're doing in your analysis?

[SimonDanisch]

sigh

signal (11): Segmentation fault
in expression starting at no file:0

But thanks, that gives me something to look into :)

[NHDaly]

Haha XD

yeah no problem. Weee the land of static compiling!

Also, if it's helpful, here's the changes i made to do what I talked about above:
NHDaly/ApplicationBuilder.jl@ed97fc8

    PackageCompiler.build_executable(...
        compile="all",
    ...)

    jl_options.compile_enabled = 3;  // 0 = "no"; 3 = "min"; 1 = "yes" (default)

[lucatrv]

Can this issue be closed?

[SimonDanisch]

@NHDaly you said you compiled your app successfully without JIT overhead in NHDaly/ApplicationBuilder.jl#24 (comment)... But I also can't see compile="all" on the master branch, and the branch you link never got merged - And for me compile="all" still segfaults.
Can you update us on the current status?

[KristofferC]

This is fixed (in Julia 1.3)