Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[wasm][aot] Fails to compile .bc to .o for System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc due to SIGKILL (-9) #65411

Closed
radical opened this issue Feb 15, 2022 · 1 comment · Fixed by #67017
Closed

[wasm][aot] Fails to compile .bc to .o for System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc due to SIGKILL (-9) #65411

radical opened this issue Feb 15, 2022 · 1 comment · Fixed by #67017
Labels
arch-wasm WebAssembly architecture area-Codegen-AOT-mono disabled-test The test is disabled in source code against the issue untriaged New issue has not been triaged by the area owner wasm-aot-test WebAssembly AOT Test

Comments

@radical
Copy link
Member

radical commented Feb 15, 2022

Created from #65356 (comment) .

System.Text.Json.SourceGeneration.Roslyn4.0.Tests console log.

Fails to compile System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc to System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.o with received SIGKILL (-9).

Failed to compile /datadisks/disk1/work/B5660975/w/AB6F0953/e/wasm_build/obj/wasm/for-build/System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc -> /datadisks/disk1/work/B5660975/w/AB6F0953/e/wasm_build/obj/wasm/for-build/System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.o [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
 "/datadisks/disk1/work/B5660975/p/build/emsdk/upstream/bin/clang++" -target wasm32-unknown-emscripten -DEMSCRIPTEN -fno-inline-functions -fvisibility=default -mllvm -combiner-global-alias-analysis=false -mllvm -enable-emscripten-cxx-exceptions -mllvm -enable-emscripten-sjlj -mllvm -disable-lsr -D__EMSCRIPTEN_major__=2 -D__EMSCRIPTEN_minor__=0 -D__EMSCRIPTEN_tiny__=34 -D_LIBCPP_ABI_VERSION=2 -Werror=implicit-function-declaration -Xclang -iwithsysroot/include/SDL --sysroot=/datadisks/disk1/work/B5660975/p/build/emsdk/upstream/emscripten/cache/sysroot -Xclang -iwithsysroot/include/compat -Oz -g -v -c /datadisks/disk1/work/B5660975/w/AB6F0953/e/wasm_build/obj/wasm/for-build/System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc -o /tmp/tmp7U9CUV.tmp [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
clang version 14.0.0 (https://github.com/llvm/llvm-project 3d39612b3dd3f6b67ee63da305d30606abbe7287) [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
Target: wasm32-unknown-emscripten [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
Thread model: posix [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
InstalledDir: /datadisks/disk1/work/B5660975/p/build/emsdk/upstream/bin [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
 (in-process) [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
 "/datadisks/disk1/work/B5660975/p/build/emsdk/upstream/bin/clang++" -cc1 -triple wasm32-unknown-emscripten -emit-obj --mrelax-relocations -disable-free -clear-ast-before-backend -main-file-name System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc -mrelocation-model static -mframe-pointer=none -fno-rounding-math -mconstructor-aliases -target-cpu generic -debug-info-kind=constructor -dwarf-version=4 -debugger-tuning=gdb -v -fcoverage-compilation-dir=/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish -resource-dir /datadisks/disk1/work/B5660975/p/build/emsdk/upstream/lib/clang/14.0.0 -Oz -Werror=implicit-function-declaration -fdebug-compilation-dir=/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish -ferror-limit 19 -fvisibility default -fgnuc-version=4.2.1 -fno-inline-functions -vectorize-slp -iwithsysroot/include/SDL -iwithsysroot/include/compat -mllvm -combiner-global-alias-analysis=false -mllvm -enable-emscripten-cxx-exceptions -mllvm -enable-emscripten-sjlj -mllvm -disable-lsr -o /tmp/tmp7U9CUV.tmp -x ir /datadisks/disk1/work/B5660975/w/AB6F0953/e/wasm_build/obj/wasm/for-build/System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
clang -cc1 version 14.0.0 based upon LLVM 14.0.0git default target x86_64-unknown-linux-gnu [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
emcc: error: '/datadisks/disk1/work/B5660975/p/build/emsdk/upstream/bin/clang++ -target wasm32-unknown-emscripten -DEMSCRIPTEN -fno-inline-functions -fvisibility=default -mllvm -combiner-global-alias-analysis=false -mllvm -enable-emscripten-cxx-exceptions -mllvm -enable-emscripten-sjlj -mllvm -disable-lsr -D__EMSCRIPTEN_major__=2 -D__EMSCRIPTEN_minor__=0 -D__EMSCRIPTEN_tiny__=34 -D_LIBCPP_ABI_VERSION=2 -Werror=implicit-function-declaration -Xclang -iwithsysroot/include/SDL --sysroot=/datadisks/disk1/work/B5660975/p/build/emsdk/upstream/emscripten/cache/sysroot -Xclang -iwithsysroot/include/compat -Oz -g -v -c /datadisks/disk1/work/B5660975/w/AB6F0953/e/wasm_build/obj/wasm/for-build/System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc -o /tmp/tmp7U9CUV.tmp' failed (received SIGKILL (-9)) [took 390.453s] [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
@radical radical added arch-wasm WebAssembly architecture disabled-test The test is disabled in source code against the issue labels Feb 15, 2022
@ghost
Copy link

ghost commented Feb 15, 2022

Tagging subscribers to 'arch-wasm': @lewing
See info in area-owners.md if you want to be subscribed.

Issue Details

Created from #65356 (comment) .

System.Text.Json.SourceGeneration.Roslyn4.0.Tests console log.

Fails to compile System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc to System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.o with received SIGKILL (-9).

Failed to compile /datadisks/disk1/work/B5660975/w/AB6F0953/e/wasm_build/obj/wasm/for-build/System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc -> /datadisks/disk1/work/B5660975/w/AB6F0953/e/wasm_build/obj/wasm/for-build/System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.o [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
 "/datadisks/disk1/work/B5660975/p/build/emsdk/upstream/bin/clang++" -target wasm32-unknown-emscripten -DEMSCRIPTEN -fno-inline-functions -fvisibility=default -mllvm -combiner-global-alias-analysis=false -mllvm -enable-emscripten-cxx-exceptions -mllvm -enable-emscripten-sjlj -mllvm -disable-lsr -D__EMSCRIPTEN_major__=2 -D__EMSCRIPTEN_minor__=0 -D__EMSCRIPTEN_tiny__=34 -D_LIBCPP_ABI_VERSION=2 -Werror=implicit-function-declaration -Xclang -iwithsysroot/include/SDL --sysroot=/datadisks/disk1/work/B5660975/p/build/emsdk/upstream/emscripten/cache/sysroot -Xclang -iwithsysroot/include/compat -Oz -g -v -c /datadisks/disk1/work/B5660975/w/AB6F0953/e/wasm_build/obj/wasm/for-build/System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc -o /tmp/tmp7U9CUV.tmp [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
clang version 14.0.0 (https://github.com/llvm/llvm-project 3d39612b3dd3f6b67ee63da305d30606abbe7287) [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
Target: wasm32-unknown-emscripten [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
Thread model: posix [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
InstalledDir: /datadisks/disk1/work/B5660975/p/build/emsdk/upstream/bin [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
 (in-process) [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
 "/datadisks/disk1/work/B5660975/p/build/emsdk/upstream/bin/clang++" -cc1 -triple wasm32-unknown-emscripten -emit-obj --mrelax-relocations -disable-free -clear-ast-before-backend -main-file-name System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc -mrelocation-model static -mframe-pointer=none -fno-rounding-math -mconstructor-aliases -target-cpu generic -debug-info-kind=constructor -dwarf-version=4 -debugger-tuning=gdb -v -fcoverage-compilation-dir=/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish -resource-dir /datadisks/disk1/work/B5660975/p/build/emsdk/upstream/lib/clang/14.0.0 -Oz -Werror=implicit-function-declaration -fdebug-compilation-dir=/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish -ferror-limit 19 -fvisibility default -fgnuc-version=4.2.1 -fno-inline-functions -vectorize-slp -iwithsysroot/include/SDL -iwithsysroot/include/compat -mllvm -combiner-global-alias-analysis=false -mllvm -enable-emscripten-cxx-exceptions -mllvm -enable-emscripten-sjlj -mllvm -disable-lsr -o /tmp/tmp7U9CUV.tmp -x ir /datadisks/disk1/work/B5660975/w/AB6F0953/e/wasm_build/obj/wasm/for-build/System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
clang -cc1 version 14.0.0 based upon LLVM 14.0.0git default target x86_64-unknown-linux-gnu [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
emcc: error: '/datadisks/disk1/work/B5660975/p/build/emsdk/upstream/bin/clang++ -target wasm32-unknown-emscripten -DEMSCRIPTEN -fno-inline-functions -fvisibility=default -mllvm -combiner-global-alias-analysis=false -mllvm -enable-emscripten-cxx-exceptions -mllvm -enable-emscripten-sjlj -mllvm -disable-lsr -D__EMSCRIPTEN_major__=2 -D__EMSCRIPTEN_minor__=0 -D__EMSCRIPTEN_tiny__=34 -D_LIBCPP_ABI_VERSION=2 -Werror=implicit-function-declaration -Xclang -iwithsysroot/include/SDL --sysroot=/datadisks/disk1/work/B5660975/p/build/emsdk/upstream/emscripten/cache/sysroot -Xclang -iwithsysroot/include/compat -Oz -g -v -c /datadisks/disk1/work/B5660975/w/AB6F0953/e/wasm_build/obj/wasm/for-build/System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc -o /tmp/tmp7U9CUV.tmp' failed (received SIGKILL (-9)) [took 390.453s] [/datadisks/disk1/work/B5660975/w/AB6F0953/e/publish/ProxyProjectForAOTOnHelix.proj]
Author: radical
Assignees: -
Labels:

arch-wasm, disabled-test
Milestone: -

@dotnet-issue-labeler dotnet-issue-labeler bot added area-Codegen-AOT-mono untriaged New issue has not been triaged by the area owner labels Feb 15, 2022
radical added a commit to radical/runtime that referenced this issue Feb 16, 2022
@radical
[wasm] Disable aot tests failing due to OOM
583bbbf 
- dotnet#65356 - OOM while linking
    `System.Text.Json.SourceGeneration.Roslyn3.11.Tests`

- dotnet#65411 - possible OOM when
  compiling `System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc` -> `.o`
     `System.Text.Json.SourceGeneration.Roslyn4.0.Tests`

- dotnet#61524 - OOM while linking
    `System.Text.Json.Tests`
@radical radical mentioned this issue Feb 16, 2022
Merged
@radical radical added the wasm-aot-test WebAssembly AOT Test label Feb 16, 2022
radical added a commit that referenced this issue Feb 17, 2022
@radical
[wasm] Disable aot tests failing due to OOM (#65413)
2196c35 
* [wasm] Disable aot tests failing due to OOM

- #65356 - OOM while linking
    `System.Text.Json.SourceGeneration.Roslyn3.11.Tests`

- #65411 - possible OOM when
  compiling `System.Text.Json.SourceGeneration.Roslyn4.0.Tests.dll.bc` -> `.o`
     `System.Text.Json.SourceGeneration.Roslyn4.0.Tests`

- #61524 - OOM while linking
    `System.Text.Json.Tests`

* Disable System.Collections.Immutable.Tests due to #65335
@elinor-fung elinor-fung mentioned this issue Feb 17, 2022
Merged
@radical radical mentioned this issue Mar 7, 2022
Open
@radical radical mentioned this issue Mar 23, 2022
Merged
@ghost ghost added the in-pr There is an active PR which will close this issue when it is merged label Mar 23, 2022
radical added a commit that referenced this issue Mar 25, 2022
@radical
[wasm][aot] Run the high resource AOT tests on build machine itself (#…
286492c 
…67017)

Some library tests fail to AOT on helix by getting oomkill'ed. Since the
build machine have more resources than helix, we can AOT these specific
library tests there, and send the built output to helix to run.

Specifically:
- `System.Text.Json.SourceGeneration.Roslyn3.11.Tests`
- `System.Text.Json.SourceGeneration.Roslyn4.0.Tests`
- `System.Text.Json.Tests`
- `Microsoft.Extensions.Logging.Generators.Roslyn3.11.Tests` 

This adds two new jobs to `runtime-wasm`, and for rolling builds - `LibraryTests_HighResource_AOT` for linux, and windows.

Fixes #65356 
Fixes #65411
Fixes #61524 
Fixes #66647
@ghost ghost removed the in-pr There is an active PR which will close this issue when it is merged label Mar 25, 2022
radekdoulik pushed a commit to radekdoulik/runtime that referenced this issue Mar 30, 2022
@radical @radekdoulik
[wasm][aot] Run the high resource AOT tests on build machine itself (d…
96fdef6 
…otnet#67017)

Some library tests fail to AOT on helix by getting oomkill'ed. Since the
build machine have more resources than helix, we can AOT these specific
library tests there, and send the built output to helix to run.

Specifically:
- `System.Text.Json.SourceGeneration.Roslyn3.11.Tests`
- `System.Text.Json.SourceGeneration.Roslyn4.0.Tests`
- `System.Text.Json.Tests`
- `Microsoft.Extensions.Logging.Generators.Roslyn3.11.Tests` 

This adds two new jobs to `runtime-wasm`, and for rolling builds - `LibraryTests_HighResource_AOT` for linux, and windows.

Fixes dotnet#65356 
Fixes dotnet#65411
Fixes dotnet#61524 
Fixes dotnet#66647
@ghost ghost locked as resolved and limited conversation to collaborators Apr 25, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
arch-wasm WebAssembly architecture area-Codegen-AOT-mono disabled-test The test is disabled in source code against the issue untriaged New issue has not been triaged by the area owner wasm-aot-test WebAssembly AOT Test
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[wasm][aot] Run the high resource AOT tests on build machine itself radical/runtime
1 participant
@radical