bwrap: execvp /usr/bin/gcc: No such file or directory

[jigpu]

Could be the same problem as #580, but in this case I'm experiencing it with GCC (though clang is also broken for me as well). Replacing sccache's auto-generated toolchain with one created by icecc-create-env fixes the issue.

The client, scheduler, and server are all running Arch Linux and using sccache from git at commit 84bac03. I have GCC 9.2.0-4 installed.

Toolchain Comparison

Oddly, in addition to the icecc archive having more files, the files that are common between the two sometimes have different sizes (e.g. lib64/ld-linux-x86-64.so.2 whose size is correct in the sccache archive, but has been modified in the icecc one)...

$ sccache --package-toolchain /usr/bin/gcc sccache-gcc-toolchain.tar.gz
$ tar tvf sccache-gcc-toolchain.tar.gz
drwxrwxrwt 0/0               0 2019-11-08 08:50 tmp
-rw-r--r-- 0/0             117 2019-10-06 08:44 etc/ld.so.conf
-rwxr-xr-x 0/0         1133400 2019-10-30 07:24 usr/bin/gcc
-rwxr-xr-x 0/0        27468144 2019-10-30 07:24 usr/lib/gcc/x86_64-pc-linux-gnu/9.2.0/cc1
-rwxr-xr-x 0/0        28946320 2019-10-30 07:24 usr/lib/gcc/x86_64-pc-linux-gnu/9.2.0/cc1plus
-rwxr-xr-x 0/0           88928 2019-10-30 07:24 usr/lib/gcc/x86_64-pc-linux-gnu/9.2.0/liblto_plugin.so
-rwxr-xr-x 0/0         2149496 2019-10-20 23:14 usr/lib/libc.so.6
-rwxr-xr-x 0/0           14512 2019-10-20 23:14 usr/lib/libdl.so.2
-rwxr-xr-x 0/0          600368 2018-11-06 06:22 usr/lib/libgmp.so.10
-rwxr-xr-x 0/0         1329264 2019-10-20 23:14 usr/lib/libm.so.6
-rwxr-xr-x 0/0           99952 2018-01-17 03:41 usr/lib/libmpc.so.3
-rwxr-xr-x 0/0          513864 2019-02-02 14:15 usr/lib/libmpfr.so.6
-rwxr-xr-x 0/0           91912 2018-07-23 00:01 usr/lib/libz.so.1
-rwxr-xr-x 0/0          198392 2019-10-20 23:14 usr/lib64/ld-linux-x86-64.so.2

$ /usr/lib/icecream/bin/icecc-create-env /usr/bin/gcc
adding file /bin/true=/usr/bin/true
adding file /usr/lib/libc.so.6=/usr/lib/libc-2.30.so
adding file /lib64/ld-linux-x86-64.so.2=/usr/lib/ld-2.30.so
adding file /usr/bin/gcc
adding file /usr/lib/libm.so.6=/usr/lib/libm-2.30.so
adding file /usr/bin/g++
adding file /usr/bin/cc1=/usr/lib/gcc/x86_64-pc-linux-gnu/9.2.0/cc1
adding file /usr/lib/libmpc.so.3=/usr/lib/libmpc.so.3.1.0
adding file /usr/lib/libmpfr.so.6=/usr/lib/libmpfr.so.6.0.2
adding file /usr/lib/libgmp.so.10=/usr/lib/libgmp.so.10.3.2
adding file /usr/lib/libdl.so.2=/usr/lib/libdl-2.30.so
adding file /usr/lib/libz.so.1=/usr/lib/libz.so.1.2.11
adding file /usr/bin/cc1plus=/usr/lib/gcc/x86_64-pc-linux-gnu/9.2.0/cc1plus
adding file /usr/bin/as
adding file /usr/lib/libopcodes-2.33.1.so
adding file /usr/lib/libbfd-2.33.1.so
adding file /usr/lib/gcc/x86_64-pc-linux-gnu/9.2.0/liblto_plugin.so=/usr/lib/gcc/x86_64-pc-linux-gnu/9.2.0/liblto_plugin.so.0.0.0
adding file /usr/lib64/ld-linux-x86-64.so.2=/usr/lib/ld-2.30.so
adding file /usr/bin/objcopy
adding file /etc/ld.so.conf=/tmp/icecc_ld_so_confaeYUmM
creating 88f6b431abe9c8ab5f73be8e4ce4f7ee.tar.gz
$ tar tvf 88f6b431abe9c8ab5f73be8e4ce4f7ee.tar.gz
-rwxr-xr-x 1000/1000     34888 2019-10-06 08:31 bin/true
-rw-r--r-- 1000/1000       792 2019-11-08 09:05 etc/ld.so.cache
-rw------- 1000/1000       118 2019-11-08 09:05 etc/ld.so.conf
-rwxr-xr-x 1000/1000    177856 2019-10-20 23:14 lib64/ld-linux-x86-64.so.2
-rwxr-xr-x 1000/1000    814832 2019-10-20 23:07 usr/bin/as
-rwxr-xr-x 1000/1000  27468144 2019-10-30 07:24 usr/bin/cc1
-rwxr-xr-x 1000/1000  28946320 2019-10-30 07:24 usr/bin/cc1plus
-rwxr-xr-x 1000/1000   1137496 2019-10-30 07:24 usr/bin/g++
-rwxr-xr-x 1000/1000   1133400 2019-10-30 07:24 usr/bin/gcc
-rwxr-xr-x 1000/1000    182248 2019-10-20 23:07 usr/bin/objcopy
-rwxr-xr-x 1000/1000    177856 2019-10-20 23:14 usr/lib64/ld-linux-x86-64.so.2
-rwxr-xr-x 1000/1000     88928 2019-10-30 07:24 usr/lib/gcc/x86_64-pc-linux-gnu/9.2.0/liblto_plugin.so
-rwxr-xr-x 1000/1000   1297312 2019-10-20 23:07 usr/lib/libbfd-2.33.1.so
-rwxr-xr-x 1000/1000   1847624 2019-10-20 23:14 usr/lib/libc.so.6
-rwxr-xr-x 1000/1000     14512 2019-10-20 23:14 usr/lib/libdl.so.2
-rwxr-xr-x 1000/1000    600368 2018-11-06 06:22 usr/lib/libgmp.so.10
-rwxr-xr-x 1000/1000     99952 2018-01-17 03:41 usr/lib/libmpc.so.3
-rwxr-xr-x 1000/1000    513864 2019-02-02 14:15 usr/lib/libmpfr.so.6
-rwxr-xr-x 1000/1000   1329264 2019-10-20 23:14 usr/lib/libm.so.6
-rwxr-xr-x 1000/1000   1541000 2019-10-20 23:07 usr/lib/libopcodes-2.33.1.so
-rwxr-xr-x 1000/1000     91912 2018-07-23 00:01 usr/lib/libz.so.1

[froydnj]

What are the error messages you get? What's the output of ldd /usr/bin/gcc? Maybe we should have some sort of debugging option that spits out appropriate error messages from the dynamic linker...

[jigpu]

The text of the error is simply bwrap: execvp /usr/bin/gcc: No such file or directory.

This is a sample of me compiling the xf86-input-wacom driver (though the same results occur with any codebase). Note that I've updated my machines since the report, and now have commit cdb9268 installed locally and commit 9a6e110 on ther server. GCC remains at version 9.2.0-4.

Local machine

$ make CC="sccache gcc"
if test -x ./git-version-gen; then ./git-version-gen -u; fi
0.38.0.4.ge82f3a7
make  all-recursive
make[1]: Entering directory '/srv/src/linuxwacom/xf86-input-wacom'
Making all in conf
make[2]: Entering directory '/srv/src/linuxwacom/xf86-input-wacom/conf'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/srv/src/linuxwacom/xf86-input-wacom/conf'
Making all in doc
make[2]: Entering directory '/srv/src/linuxwacom/xf86-input-wacom/doc'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/srv/src/linuxwacom/xf86-input-wacom/doc'
Making all in src
make[2]: Entering directory '/srv/src/linuxwacom/xf86-input-wacom/src'
  CC       xf86Wacom.lo
bwrap: execvp /usr/bin/gcc: No such file or directory
Compiler killed by signal 1
make[2]: *** [Makefile:518: xf86Wacom.lo] Error 1
make[2]: Leaving directory '/srv/src/linuxwacom/xf86-input-wacom/src'
make[1]: *** [Makefile:519: all-recursive] Error 1
make[1]: Leaving directory '/srv/src/linuxwacom/xf86-input-wacom'
make: *** [Makefile:428: all] Error 2

Build server

# RUST_LOG=sccache=trace SCCACHE_NO_DAEMON=0 /usr/bin/sccache-dist server --config /etc/sccache-dist/server.conf
DEBUG 2019-12-09T22:20:20Z: sccache::config: Attempting to read config file at "/etc/sccache-dist/server.conf"
 INFO 2019-12-09T22:20:20Z: sccache_dist::build: Creating overlay builder
TRACE 2019-12-09T22:20:20Z: sccache::dist::cache: Using TcCache("/mnt/cache/wacom-sccache/toolchains/tc", 1073741824)
 INFO 2019-12-09T22:20:21Z: sccache::dist::http::server: Server listening for clients on 10.191.4.89:10501
TRACE 2019-12-09T22:20:21Z: sccache::dist::http::server: Performing heartbeat
TRACE 2019-12-09T22:20:21Z: sccache::dist::http::server: Heartbeat success is_new=true
TRACE 2019-12-09T22:20:37Z: sccache::dist::http::server: Req 0 (10.191.4.89:54158): Request { method: "POST", url: "/api/v1/distserver/assign_job/1", headers: [("user-agent", "reqwest/0.9.13"), ("accept", "*/*"), ("authorization", "Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJqb2JfaWQiOjF9.-9dUGiGOA502P-zZ2GBggN-XpkxfP31XIWHZvJFp5Q0"), ("content-type", "application/octet-stream"), ("content-length", "136"), ("accept-encoding", "gzip"), ("host", "10.191.4.89:10501")], https: false, remote_addr: V4(10.191.4.89:54158) }
TRACE 2019-12-09T22:20:37Z: sccache::dist::http::server: Req 0: assign_job(1): Toolchain { archive_id: "ebaf573c31a87571530fd249737b0fd0a601c393c018a8f54eb9661d659cd88f6f84d690013455b70222cc33af35096a7acfcfc9e7381bc4c82fd04f042d8816" }
TRACE 2019-12-09T22:20:37Z: sccache::dist::http::server: Res 0: Response { status_code: 200, headers: [("Content-Type", "application/octet-stream")] }
TRACE 2019-12-09T22:20:37Z: sccache::dist::http::server: Req 1 (10.191.6.73:53876): Request { method: "POST", url: "/api/v1/distserver/run_job/1", headers: [("user-agent", "reqwest/0.9.13"), ("accept", "*/*"), ("authorization", "Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJqb2JfaWQiOjF9.-9dUGiGOA502P-zZ2GBggN-XpkxfP31XIWHZvJFp5Q0"), ("content-type", "application/octet-stream"), ("content-length", "476218"), ("accept-encoding", "gzip"), ("host", "10.191.4.89:10501")], https: false, remote_addr: V4(10.191.6.73:53876) }
TRACE 2019-12-09T22:20:37Z: sccache::dist::http::server: Req 1: run_job(1): RunJobHttpRequest { command: CompileCommand { executable: "/usr/bin/gcc", arguments: ["-x", "c", "-c", "../src/xf86Wacom.c", "-o", ".libs/xf86Wacom.o", "-DHAVE_CONFIG_H", "-fvisibility=hidden", "-Wall", "-Wpointer-arith", "-Wmissing-declarations", "-Wformat=2", "-Wstrict-prototypes", "-Wmissing-prototypes", "-Wnested-externs", "-Wbad-function-cast", "-Wold-style-definition", "-Wdeclaration-after-statement", "-Wunused", "-Wuninitialized", "-Wshadow", "-Wmissing-noreturn", "-Wmissing-format-attribute", "-Wredundant-decls", "-Wlogical-op", "-Werror=implicit", "-Werror=nonnull", "-Werror=init-self", "-Werror=main", "-Werror=missing-braces", "-Werror=sequence-point", "-Werror=return-type", "-Werror=trigraphs", "-Werror=array-bounds", "-Werror=write-strings", "-Werror=address", "-Werror=int-to-pointer-cast", "-Werror=pointer-to-int-cast", "-fno-strict-aliasing", "-g", "-O2", "-fPIC", "-DPIC"], env_vars: [("SHELL", "/bin/sh"), ("SESSION_MANAGER", "local/jigpu-box:@/tmp/.ICE-unix/4100,unix/jigpu-box:/tmp/.ICE-unix/4100"), ("LESSHISTFILE", "/home/jigpu/.local/share/less/history"), ("COLORTERM", "truecolor"), ("LESS", "-S -R"), ("HISTCONTROL", "ignorespace"), ("XDG_MENU_PREFIX", "gnome-"), ("ICEAUTHORITY", "/run/user/1000/ICEauthority"), ("MAKE_TERMOUT", "/dev/pts/0"), ("SSH_AUTH_SOCK", "/run/user/1000/keyring/ssh"), ("XDG_DATA_HOME", "/home/jigpu/.local/share"), ("XDG_CONFIG_HOME", "/home/jigpu/.config"), ("GNUPGHOME", "/home/jigpu/.config/gnupg"), ("DESKTOP_SESSION", "gnome-xorg"), ("EDITOR", "nano"), ("PWD", "/home/jigpu/Development/linuxwacom/xf86-input-wacom/src"), ("XDG_SESSION_DESKTOP", "gnome-xorg"), ("LOGNAME", "jigpu"), ("XDG_SESSION_TYPE", "x11"), ("CCACHE_DIR", "/home/jigpu/.cache/ccache"), ("MAKEOVERRIDES", "${-*-command-variables-*-}"), ("XAUTHORITY", "/run/user/1000/gdm/Xauthority"), ("GJS_DEBUG_TOPICS", "JS ERROR;JS LOG"), ("WINDOWPATH", "2"), ("GDM_LANG", "en_US.UTF-8"), ("HOME", "/home/jigpu"), ("USERNAME", "jigpu"), ("LANG", "en_US.UTF-8"), ("LS_COLORS", "no=00:fi=00:di=34:ow=34;40:ln=35:pi=30;44:so=35;44:do=35;44:bd=33;44:cd=37;44:or=05;37;41:mi=05;37;41:ex=01;31:*.cmd=01;31:*.exe=01;31:*.com=01;31:*.bat=01;31:*.reg=01;31:*.app=01;31:*.txt=32:*.org=32:*.md=32:*.mkd=32:*.h=32:*.hpp=32:*.c=32:*.C=32:*.cc=32:*.cpp=32:*.cxx=32:*.objc=32:*.cl=32:*.sh=32:*.bash=32:*.csh=32:*.zsh=32:*.el=32:*.vim=32:*.java=32:*.pl=32:*.pm=32:*.py=32:*.rb=32:*.hs=32:*.php=32:*.htm=32:*.html=32:*.shtml=32:*.erb=32:*.haml=32:*.xml=32:*.rdf=32:*.css=32:*.sass=32:*.scss=32:*.less=32:*.js=32:*.coffee=32:*.man=32:*.0=32:*.1=32:*.2=32:*.3=32:*.4=32:*.5=32:*.6=32:*.7=32:*.8=32:*.9=32:*.l=32:*.n=32:*.p=32:*.pod=32:*.tex=32:*.go=32:*.sql=32:*.csv=32:*.bmp=33:*.cgm=33:*.dl=33:*.dvi=33:*.emf=33:*.eps=33:*.gif=33:*.jpeg=33:*.jpg=33:*.JPG=33:*.mng=33:*.pbm=33:*.pcx=33:*.pdf=33:*.pgm=33:*.png=33:*.PNG=33:*.ppm=33:*.pps=33:*.ppsx=33:*.ps=33:*.svg=33:*.svgz=33:*.tga=33:*.tif=33:*.tiff=33:*.xbm=33:*.xcf=33:*.xpm=33:*.xwd=33:*.xwd=33:*.yuv=33:*.aac=33:*.au=33:*.flac=33:*.m4a=33:*.mid=33:*.midi=33:*.mka=33:*.mp3=33:*.mpa=33:*.mpeg=33:*.mpg=33:*.ogg=33:*.opus=33:*.ra=33:*.wav=33:*.anx=33:*.asf=33:*.avi=33:*.axv=33:*.flc=33:*.fli=33:*.flv=33:*.gl=33:*.m2v=33:*.m4v=33:*.mkv=33:*.mov=33:*.MOV=33:*.mp4=33:*.mp4v=33:*.mpeg=33:*.mpg=33:*.nuv=33:*.ogm=33:*.ogv=33:*.ogx=33:*.qt=33:*.rm=33:*.rmvb=33:*.swf=33:*.vob=33:*.webm=33:*.wmv=33:*.doc=31:*.docx=31:*.rtf=31:*.odt=31:*.dot=31:*.dotx=31:*.ott=31:*.xls=31:*.xlsx=31:*.ods=31:*.ots=31:*.ppt=31:*.pptx=31:*.odp=31:*.otp=31:*.fla=31:*.psd=31:*.7z=1;35:*.apk=1;35:*.arj=1;35:*.bin=1;35:*.bz=1;35:*.bz2=1;35:*.cab=1;35:*.deb=1;35:*.dmg=1;35:*.gem=1;35:*.gz=1;35:*.iso=1;35:*.jar=1;35:*.msi=1;35:*.rar=1;35:*.rpm=1;35:*.tar=1;35:*.tbz=1;35:*.tbz2=1;35:*.tgz=1;35:*.tx=1;35:*.war=1;35:*.xpi=1;35:*.xz=1;35:*.z=1;35:*.Z=1;35:*.zip=1;35:*.ANSI-30-black=30:*.ANSI-01;30-brblack=01;30:*.ANSI-31-red=31:*.ANSI-01;31-brred=01;31:*.ANSI-32-green=32:*.ANSI-01;32-brgreen=01;32:*.ANSI-33-yellow=33:*.ANSI-01;33-bryellow=01;33:*.ANSI-34-blue=34:*.ANSI-01;34-brblue=01;34:*.ANSI-35-magenta=35:*.ANSI-01;35-brmagenta=01;35:*.ANSI-36-cyan=36:*.ANSI-01;36-brcyan=01;36:*.ANSI-37-white=37:*.ANSI-01;37-brwhite=01;37:*.log=01;32:*~=01;32:*#=01;32:*.bak=01;33:*.BAK=01;33:*.old=01;33:*.OLD=01;33:*.org_archive=01;33:*.off=01;33:*.OFF=01;33:*.dist=01;33:*.DIST=01;33:*.orig=01;33:*.ORIG=01;33:*.swp=01;33:*.swo=01;33:*,v=01;33:*.gpg=34:*.gpg=34:*.pgp=34:*.asc=34:*.3des=34:*.aes=34:*.enc=34:*.sqlite=34:"), ("XDG_CURRENT_DESKTOP", "GNOME"), ("GIMP2_DIRECTORY", "/home/jigpu/.config/gimp-2.8"), ("VTE_VERSION", "5803"), ("GNOME_TERMINAL_SCREEN", "/org/gnome/Terminal/screen/0b334f1a_0fbe_4138_ac57_968dbb9f3663"), ("INVOCATION_ID", "4ec40899039444ae861baed856991559"), ("MANAGERPID", "3693"), ("MFLAGS", "-w"), ("XDG_CACHE_HOME", "/home/jigpu/.cache"), ("GJS_DEBUG_OUTPUT", "stderr"), ("XDG_SESSION_CLASS", "user"), ("MAKEFLAGS", "w -- CC=sccache\\ gcc"), ("TERM", "xterm-256color"), ("USER", "jigpu"), ("MAKE_TERMERR", "/dev/pts/0"), ("GNOME_TERMINAL_SERVICE", ":1.272"), ("DISPLAY", ":0"), ("SHLVL", "4"), ("GIT_EDITOR", "nano"), ("MAKELEVEL", "3"), ("DUALCASE", "1"), ("XDG_RUNTIME_DIR", "/run/user/1000"), ("JOURNAL_STREAM", "9:32648"), ("XDG_DATA_DIRS", "/home/jigpu/.local/share/flatpak/exports/share/:/var/lib/flatpak/exports/share/:/usr/local/share/:/usr/share/"), ("PATH", "~/.local/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/bin/site_perl:/usr/bin/vendor_perl:/usr/bin/core_perl:/usr/bin/site_perl:/usr/bin/vendor_perl:/usr/bin/core_perl:/opt/android-sdk/platform-tools"), ("GDMSESSION", "gnome-xorg"), ("CC", "gcc"), ("DBUS_SESSION_BUS_ADDRESS", "unix:path=/run/user/1000/bus"), ("MAIL", "/var/spool/mail/jigpu"), ("MAILRC", "/home/jigpu/.config/mailrc"), ("LESSKEY", "/home/jigpu/.config/less/keys"), ("OLDPWD", "/home/jigpu/Development/linuxwacom/xf86-input-wacom"), ("_", "/usr/bin/sccache")], cwd: "/srv/src/linuxwacom/xf86-input-wacom/src" }, outputs: ["/srv/src/linuxwacom/xf86-input-wacom/src/.libs/xf86Wacom.o"] }
DEBUG 2019-12-09T22:20:37Z: sccache_dist::build: Preparing overlay
TRACE 2019-12-09T22:20:37Z: sccache_dist::build: Creating toolchain directory for ebaf573c31a87571530fd249737b0fd0a601c393c018a8f54eb9661d659cd88f6f84d690013455b70222cc33af35096a7acfcfc9e7381bc4c82fd04f042d8816
TRACE 2019-12-09T22:20:38Z: sccache_dist::build: Creating build directory for ebaf573c31a87571530fd249737b0fd0a601c393c018a8f54eb9661d659cd88f6f84d690013455b70222cc33af35096a7acfcfc9e7381bc4c82fd04f042d8816-1
DEBUG 2019-12-09T22:20:38Z: sccache_dist::build: Performing build in OverlaySpec { build_dir: "/mnt/cache/wacom-sccache/build/builds/ebaf573c31a87571530fd249737b0fd0a601c393c018a8f54eb9661d659cd88f6f84d690013455b70222cc33af35096a7acfcfc9e7381bc4c82fd04f042d8816-1", toolchain_dir: "/mnt/cache/wacom-sccache/build/toolchains/ebaf573c31a87571530fd249737b0fd0a601c393c018a8f54eb9661d659cd88f6f84d690013455b70222cc33af35096a7acfcfc9e7381bc4c82fd04f042d8816" }
TRACE 2019-12-09T22:20:38Z: sccache_dist::build: Compile environment: [("SHELL", "/bin/sh"), ("SESSION_MANAGER", "local/jigpu-box:@/tmp/.ICE-unix/4100,unix/jigpu-box:/tmp/.ICE-unix/4100"), ("LESSHISTFILE", "/home/jigpu/.local/share/less/history"), ("COLORTERM", "truecolor"), ("LESS", "-S -R"), ("HISTCONTROL", "ignorespace"), ("XDG_MENU_PREFIX", "gnome-"), ("ICEAUTHORITY", "/run/user/1000/ICEauthority"), ("MAKE_TERMOUT", "/dev/pts/0"), ("SSH_AUTH_SOCK", "/run/user/1000/keyring/ssh"), ("XDG_DATA_HOME", "/home/jigpu/.local/share"), ("XDG_CONFIG_HOME", "/home/jigpu/.config"), ("GNUPGHOME", "/home/jigpu/.config/gnupg"), ("DESKTOP_SESSION", "gnome-xorg"), ("EDITOR", "nano"), ("PWD", "/home/jigpu/Development/linuxwacom/xf86-input-wacom/src"), ("XDG_SESSION_DESKTOP", "gnome-xorg"), ("LOGNAME", "jigpu"), ("XDG_SESSION_TYPE", "x11"), ("CCACHE_DIR", "/home/jigpu/.cache/ccache"), ("MAKEOVERRIDES", "${-*-command-variables-*-}"), ("XAUTHORITY", "/run/user/1000/gdm/Xauthority"), ("GJS_DEBUG_TOPICS", "JS ERROR;JS LOG"), ("WINDOWPATH", "2"), ("GDM_LANG", "en_US.UTF-8"), ("HOME", "/home/jigpu"), ("USERNAME", "jigpu"), ("LANG", "en_US.UTF-8"), ("LS_COLORS", "no=00:fi=00:di=34:ow=34;40:ln=35:pi=30;44:so=35;44:do=35;44:bd=33;44:cd=37;44:or=05;37;41:mi=05;37;41:ex=01;31:*.cmd=01;31:*.exe=01;31:*.com=01;31:*.bat=01;31:*.reg=01;31:*.app=01;31:*.txt=32:*.org=32:*.md=32:*.mkd=32:*.h=32:*.hpp=32:*.c=32:*.C=32:*.cc=32:*.cpp=32:*.cxx=32:*.objc=32:*.cl=32:*.sh=32:*.bash=32:*.csh=32:*.zsh=32:*.el=32:*.vim=32:*.java=32:*.pl=32:*.pm=32:*.py=32:*.rb=32:*.hs=32:*.php=32:*.htm=32:*.html=32:*.shtml=32:*.erb=32:*.haml=32:*.xml=32:*.rdf=32:*.css=32:*.sass=32:*.scss=32:*.less=32:*.js=32:*.coffee=32:*.man=32:*.0=32:*.1=32:*.2=32:*.3=32:*.4=32:*.5=32:*.6=32:*.7=32:*.8=32:*.9=32:*.l=32:*.n=32:*.p=32:*.pod=32:*.tex=32:*.go=32:*.sql=32:*.csv=32:*.bmp=33:*.cgm=33:*.dl=33:*.dvi=33:*.emf=33:*.eps=33:*.gif=33:*.jpeg=33:*.jpg=33:*.JPG=33:*.mng=33:*.pbm=33:*.pcx=33:*.pdf=33:*.pgm=33:*.png=33:*.PNG=33:*.ppm=33:*.pps=33:*.ppsx=33:*.ps=33:*.svg=33:*.svgz=33:*.tga=33:*.tif=33:*.tiff=33:*.xbm=33:*.xcf=33:*.xpm=33:*.xwd=33:*.xwd=33:*.yuv=33:*.aac=33:*.au=33:*.flac=33:*.m4a=33:*.mid=33:*.midi=33:*.mka=33:*.mp3=33:*.mpa=33:*.mpeg=33:*.mpg=33:*.ogg=33:*.opus=33:*.ra=33:*.wav=33:*.anx=33:*.asf=33:*.avi=33:*.axv=33:*.flc=33:*.fli=33:*.flv=33:*.gl=33:*.m2v=33:*.m4v=33:*.mkv=33:*.mov=33:*.MOV=33:*.mp4=33:*.mp4v=33:*.mpeg=33:*.mpg=33:*.nuv=33:*.ogm=33:*.ogv=33:*.ogx=33:*.qt=33:*.rm=33:*.rmvb=33:*.swf=33:*.vob=33:*.webm=33:*.wmv=33:*.doc=31:*.docx=31:*.rtf=31:*.odt=31:*.dot=31:*.dotx=31:*.ott=31:*.xls=31:*.xlsx=31:*.ods=31:*.ots=31:*.ppt=31:*.pptx=31:*.odp=31:*.otp=31:*.fla=31:*.psd=31:*.7z=1;35:*.apk=1;35:*.arj=1;35:*.bin=1;35:*.bz=1;35:*.bz2=1;35:*.cab=1;35:*.deb=1;35:*.dmg=1;35:*.gem=1;35:*.gz=1;35:*.iso=1;35:*.jar=1;35:*.msi=1;35:*.rar=1;35:*.rpm=1;35:*.tar=1;35:*.tbz=1;35:*.tbz2=1;35:*.tgz=1;35:*.tx=1;35:*.war=1;35:*.xpi=1;35:*.xz=1;35:*.z=1;35:*.Z=1;35:*.zip=1;35:*.ANSI-30-black=30:*.ANSI-01;30-brblack=01;30:*.ANSI-31-red=31:*.ANSI-01;31-brred=01;31:*.ANSI-32-green=32:*.ANSI-01;32-brgreen=01;32:*.ANSI-33-yellow=33:*.ANSI-01;33-bryellow=01;33:*.ANSI-34-blue=34:*.ANSI-01;34-brblue=01;34:*.ANSI-35-magenta=35:*.ANSI-01;35-brmagenta=01;35:*.ANSI-36-cyan=36:*.ANSI-01;36-brcyan=01;36:*.ANSI-37-white=37:*.ANSI-01;37-brwhite=01;37:*.log=01;32:*~=01;32:*#=01;32:*.bak=01;33:*.BAK=01;33:*.old=01;33:*.OLD=01;33:*.org_archive=01;33:*.off=01;33:*.OFF=01;33:*.dist=01;33:*.DIST=01;33:*.orig=01;33:*.ORIG=01;33:*.swp=01;33:*.swo=01;33:*,v=01;33:*.gpg=34:*.gpg=34:*.pgp=34:*.asc=34:*.3des=34:*.aes=34:*.enc=34:*.sqlite=34:"), ("XDG_CURRENT_DESKTOP", "GNOME"), ("GIMP2_DIRECTORY", "/home/jigpu/.config/gimp-2.8"), ("VTE_VERSION", "5803"), ("GNOME_TERMINAL_SCREEN", "/org/gnome/Terminal/screen/0b334f1a_0fbe_4138_ac57_968dbb9f3663"), ("INVOCATION_ID", "4ec40899039444ae861baed856991559"), ("MANAGERPID", "3693"), ("MFLAGS", "-w"), ("XDG_CACHE_HOME", "/home/jigpu/.cache"), ("GJS_DEBUG_OUTPUT", "stderr"), ("XDG_SESSION_CLASS", "user"), ("MAKEFLAGS", "w -- CC=sccache\\ gcc"), ("TERM", "xterm-256color"), ("USER", "jigpu"), ("MAKE_TERMERR", "/dev/pts/0"), ("GNOME_TERMINAL_SERVICE", ":1.272"), ("DISPLAY", ":0"), ("SHLVL", "4"), ("GIT_EDITOR", "nano"), ("MAKELEVEL", "3"), ("DUALCASE", "1"), ("XDG_RUNTIME_DIR", "/run/user/1000"), ("JOURNAL_STREAM", "9:32648"), ("XDG_DATA_DIRS", "/home/jigpu/.local/share/flatpak/exports/share/:/var/lib/flatpak/exports/share/:/usr/local/share/:/usr/share/"), ("PATH", "~/.local/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/bin/site_perl:/usr/bin/vendor_perl:/usr/bin/core_perl:/usr/bin/site_perl:/usr/bin/vendor_perl:/usr/bin/core_perl:/opt/android-sdk/platform-tools"), ("GDMSESSION", "gnome-xorg"), ("CC", "gcc"), ("DBUS_SESSION_BUS_ADDRESS", "unix:path=/run/user/1000/bus"), ("MAIL", "/var/spool/mail/jigpu"), ("MAILRC", "/home/jigpu/.config/mailrc"), ("LESSKEY", "/home/jigpu/.config/less/keys"), ("OLDPWD", "/home/jigpu/Development/linuxwacom/xf86-input-wacom"), ("_", "/usr/bin/sccache")]
TRACE 2019-12-09T22:20:38Z: sccache_dist::build: Compile command: "/usr/bin/gcc" ["-x", "c", "-c", "../src/xf86Wacom.c", "-o", ".libs/xf86Wacom.o", "-DHAVE_CONFIG_H", "-fvisibility=hidden", "-Wall", "-Wpointer-arith", "-Wmissing-declarations", "-Wformat=2", "-Wstrict-prototypes", "-Wmissing-prototypes", "-Wnested-externs", "-Wbad-function-cast", "-Wold-style-definition", "-Wdeclaration-after-statement", "-Wunused", "-Wuninitialized", "-Wshadow", "-Wmissing-noreturn", "-Wmissing-format-attribute", "-Wredundant-decls", "-Wlogical-op", "-Werror=implicit", "-Werror=nonnull", "-Werror=init-self", "-Werror=main", "-Werror=missing-braces", "-Werror=sequence-point", "-Werror=return-type", "-Werror=trigraphs", "-Werror=array-bounds", "-Werror=write-strings", "-Werror=address", "-Werror=int-to-pointer-cast", "-Werror=pointer-to-int-cast", "-fno-strict-aliasing", "-g", "-O2", "-fPIC", "-DPIC"]
TRACE 2019-12-09T22:20:38Z: sccache_dist::build: copying in inputs
TRACE 2019-12-09T22:20:38Z: sccache_dist::build: creating output directories
TRACE 2019-12-09T22:20:38Z: sccache_dist::build: performing compile
TRACE 2019-12-09T22:20:38Z: sccache_dist::build: compile_output: Output { status: ExitStatus(ExitStatus(256)), stdout: "", stderr: "bwrap: execvp /usr/bin/gcc: No such file or directory\n" }
TRACE 2019-12-09T22:20:38Z: sccache_dist::build: retrieving ["/srv/src/linuxwacom/xf86-input-wacom/src/.libs/xf86Wacom.o"]
DEBUG 2019-12-09T22:20:38Z: sccache_dist::build: Missing output path "/srv/src/linuxwacom/xf86-input-wacom/src/.libs/xf86Wacom.o"
DEBUG 2019-12-09T22:20:38Z: sccache_dist::build: Finishing with overlay
DEBUG 2019-12-09T22:20:38Z: sccache_dist::build: Returning result
TRACE 2019-12-09T22:20:38Z: sccache::dist::http::server: Res 1: Response { status_code: 200, headers: [("Content-Type", "application/octet-stream")] }
TRACE 2019-12-09T22:20:51Z: sccache::dist::http::server: Performing heartbeat
TRACE 2019-12-09T22:20:51Z: sccache::dist::http::server: Heartbeat success is_new=false
TRACE 2019-12-09T22:21:21Z: sccache::dist::http::server: Performing heartbeat
TRACE 2019-12-09T22:21:21Z: sccache::dist::http::server: Heartbeat success is_new=false

Output from ldd on the local machine

$ ldd /usr/bin/gcc
	linux-vdso.so.1 (0x00007fff937f8000)
	libm.so.6 => /usr/lib/libm.so.6 (0x00007f8777856000)
	libc.so.6 => /usr/lib/libc.so.6 (0x00007f877768f000)
	/lib64/ld-linux-x86-64.so.2 => /usr/lib64/ld-linux-x86-64.so.2 (0x00007f87779da000)

[chmanchester]

Is this #389 ?

[melvyn2]

I have the same issue (gcc/g++/clang all not found), though the server/scheduler is running NixOS.