Index projects on infra #13249

jonathanmetzman · 2025-04-23T20:30:35Z

No description provided.

jonathanmetzman · 2025-04-23T20:32:29Z

/gcbrun trial_build.py c c++ --fuzzing-engines libfuzzer --sanitizers address

jonathanmetzman · 2025-04-23T21:46:30Z

/gcbrun trial_build.py c c++ --fuzzing-engines libfuzzer --sanitizers address

jonathanmetzman · 2025-04-23T22:04:36Z

/gcbrun trial_build.py c c++ --fuzzing-engines libfuzzer --sanitizers address

jonathanmetzman · 2025-04-24T20:01:44Z

/gcbrun trial_build.py c c++ --fuzzing-engines libfuzzer --sanitizers address

jonathanmetzman · 2025-04-25T20:53:17Z

/gcbrun trial_build.py unrar --fuzzing-engines libfuzzer --sanitizers address

jonathanmetzman · 2025-04-28T18:38:46Z

/gcbrun trial_build.py unrar --fuzzing-engines libfuzzer --sanitizers address

jonathanmetzman · 2025-04-28T18:59:27Z

/gcbrun trial_build.py jq --fuzzing-engines libfuzzer --sanitizers address

jonathanmetzman · 2025-04-28T21:29:13Z

/gcbrun trial_build.py jq unrar --fuzzing-engines libfuzzer --sanitizers address

jonathanmetzman · 2025-04-29T16:25:54Z

/gcbrun trial_build.py jq unrar --fuzzing-engines libfuzzer --sanitizers address

jonathanmetzman · 2025-04-29T17:22:18Z

/gcbrun trial_build.py c c++ --fuzzing-engines libfuzzer --sanitizers address

oliverchang · 2025-04-29T19:53:12Z

/gcbrun trial_build.py yara expat --fuzzing-engines libfuzzer --sanitizers address

oliverchang · 2025-04-29T20:43:04Z

/gcbrun trial_build.py yara expat --fuzzing-engines libfuzzer --sanitizers address

oliverchang · 2025-04-29T21:01:41Z

/gcbrun trial_build.py yara expat --fuzzing-engines libfuzzer --sanitizers address

oliverchang · 2025-04-29T22:30:02Z

/gcbrun trial_build.py yara harfbuzz glslang --fuzzing-engines libfuzzer --sanitizers address

oliverchang · 2025-04-30T00:34:21Z

/gcbrun trial_build.py openssl --fuzzing-engines libfuzzer --sanitizers address

oliverchang · 2025-04-30T03:13:01Z

/gcbrun trial_build.py openssl --fuzzing-engines libfuzzer --sanitizers address

oliverchang · 2025-04-30T21:23:29Z

/gcbrun trial_build.py c c++ --fuzzing-engines libfuzzer --sanitizers address

jonathanmetzman · 2025-05-01T17:56:31Z

/gcbrun trial_build.py systemd --fuzzing-engines libfuzzer --sanitizers address

jonathanmetzman · 2025-05-01T18:15:35Z

Oliver, do you get this when trying to build systemd locally?

INFO:root:Found 95 linker JSON files.
INFO:root:trying to find 90b5a3e665376882
Traceback (most recent call last):
  File "/opt/indexer/index_build.py", line 613, in <module>
    main()
  File "/opt/indexer/index_build.py", line 607, in main
    index()
  File "/opt/indexer/index_build.py", line 566, in index
    targets = enumerate_build_targets(root)
  File "/opt/indexer/index_build.py", line 249, in enumerate_build_targets
    binary_path = find_fuzzer_binary(OUT, build_id)
  File "/opt/indexer/index_build.py", line 224, in find_fuzzer_binary
    assert False, "failed to find fuzzer binary"
AssertionError: failed to find fuzzer binary
ERROR:__main__:Indexer failed.

oliverchang · 2025-05-01T18:35:58Z

Oliver, do you get this when trying to build systemd locally?

INFO:root:Found 95 linker JSON files.
INFO:root:trying to find 90b5a3e665376882
Traceback (most recent call last):
  File "/opt/indexer/index_build.py", line 613, in <module>
    main()
  File "/opt/indexer/index_build.py", line 607, in main
    index()
  File "/opt/indexer/index_build.py", line 566, in index
    targets = enumerate_build_targets(root)
  File "/opt/indexer/index_build.py", line 249, in enumerate_build_targets
    binary_path = find_fuzzer_binary(OUT, build_id)
  File "/opt/indexer/index_build.py", line 224, in find_fuzzer_binary
    assert False, "failed to find fuzzer binary"
AssertionError: failed to find fuzzer binary
ERROR:__main__:Indexer failed.

My bad -- I had a fix that I didn't push. pushed now.

jonathanmetzman · 2025-05-01T19:31:25Z

/gcbrun trial_build.py systemd --fuzzing-engines libfuzzer --sanitizers address

oliverchang · 2025-05-01T19:37:01Z

/gcbrun trial_build.py openssl libfido2 nss --fuzzing-engines libfuzzer --sanitizers address

oliverchang · 2025-05-01T21:05:54Z

/gcbrun trial_build.py openssl systemd --fuzzing-engines libfuzzer --sanitizers address

jonathanmetzman · 2025-05-01T22:24:23Z

/gcbrun trial_build.py boringssl --fuzzing-engines libfuzzer --sanitizers address

oliverchang · 2025-05-01T22:31:38Z

/gcbrun trial_build.py nss --fuzzing-engines libfuzzer --sanitizers address

oliverchang · 2025-05-02T00:37:23Z

/gcbrun trial_build.py c c++ --fuzzing-engines libfuzzer --sanitizers address

oliverchang · 2025-05-02T03:45:03Z

/gcbrun trial_build.py c c++ --fuzzing-engines libfuzzer --sanitizers address

Change path so our wrapper is loaded when "clang" is called. To deal with build systems that inspect the directory of the clang binary, we symlink to every thing (except clang and clang++) from the indexer directory. Also, handle people hardcoding -fsanitize=fuzzer and using libFuzzingEngine.a for linking.

jonathanmetzman · 2025-05-02T05:34:43Z

/gcbrun trial_build.py c c++ --fuzzing-engines libfuzzer --sanitizers address

jonathanmetzman added 7 commits April 25, 2025 16:50

fix

e817ee0

Fix

7a1fa7c

Fix

24f2434

Get indexes working on infra

0226aef

fix

c8cd735

fix

73acd85

Include shared objects

0b698c4

jonathanmetzman force-pushed the idnexbuilds branch from bba4927 to 0b698c4 Compare April 25, 2025 20:50

Allow failures

15284f9

don't mkdir

353da73

don't link libc++abi always

83721ab

allow non-existent files when copying index files.

95f7092

don't rm openssl

29e0804

use larger buildpool with more disk

c6f6d55

jonathanmetzman and others added 3 commits April 30, 2025 16:44

try to solve shared libs issues with permissions

26ce92a

Merge remote-tracking branch 'origin/idnexbuilds' into idnexbuilds

356b1a2

add more logging, and skip binaries we can't find.

cb26cb7

Try to fix shared object issue.

53f2b9f

jonathanmetzman force-pushed the idnexbuilds branch from cb26cb7 to 53f2b9f Compare May 1, 2025 17:55

Merge remote-tracking branch 'origin/idnexbuilds' into idnexbuilds

3569424

don't build all openssl branches

d475ee7

Update index_build.py

07c19b1

wip: move indexing to link time.

3576bcc

Merge remote-tracking branch 'origin/idnexbuilds' into idnexbuilds

d7a5df9

Merge remote-tracking branch 'origin/master' into idnexbuilds

ef2b670

oliverchang added 3 commits May 2, 2025 13:08

revert bath to rpath, and fix another bug

ccffbde

use newer patchelf

183a842

chmod

3dffe46

jonathanmetzman force-pushed the idnexbuilds branch 2 times, most recently from 32f1cf7 to 53f2b9f Compare May 2, 2025 05:29

oliverchang closed this May 2, 2025

Index projects on infra #13249

Index projects on infra #13249

Uh oh!

Conversation

jonathanmetzman commented Apr 23, 2025

Uh oh!

jonathanmetzman commented Apr 23, 2025

Uh oh!

jonathanmetzman commented Apr 23, 2025

Uh oh!

jonathanmetzman commented Apr 23, 2025

Uh oh!

jonathanmetzman commented Apr 24, 2025

Uh oh!

jonathanmetzman commented Apr 25, 2025

Uh oh!

jonathanmetzman commented Apr 28, 2025

Uh oh!

jonathanmetzman commented Apr 28, 2025

Uh oh!

jonathanmetzman commented Apr 28, 2025

Uh oh!

jonathanmetzman commented Apr 29, 2025

Uh oh!

jonathanmetzman commented Apr 29, 2025

Uh oh!

oliverchang commented Apr 29, 2025

Uh oh!

oliverchang commented Apr 29, 2025

Uh oh!

oliverchang commented Apr 29, 2025

Uh oh!

oliverchang commented Apr 29, 2025

Uh oh!

oliverchang commented Apr 30, 2025

Uh oh!

oliverchang commented Apr 30, 2025

Uh oh!

oliverchang commented Apr 30, 2025

Uh oh!

jonathanmetzman commented May 1, 2025

Uh oh!

jonathanmetzman commented May 1, 2025

Uh oh!

oliverchang commented May 1, 2025

Uh oh!

jonathanmetzman commented May 1, 2025

Uh oh!

oliverchang commented May 1, 2025

Uh oh!

oliverchang commented May 1, 2025

Uh oh!

jonathanmetzman commented May 1, 2025

Uh oh!

oliverchang commented May 1, 2025

Uh oh!

oliverchang commented May 2, 2025

Uh oh!

oliverchang commented May 2, 2025

Uh oh!

jonathanmetzman commented May 2, 2025

Uh oh!