Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cluster builds using Dockerfiles fail #111

Open
tmcgilchrist opened this issue Apr 18, 2023 · 0 comments
Open

Cluster builds using Dockerfiles fail #111

tmcgilchrist opened this issue Apr 18, 2023 · 0 comments
Labels
bug Something isn't working

Comments

@tmcgilchrist
Copy link
Member

Running docs-ci using CI_PROFILE=docker seems like the Dockerfile submitted is poorly defined. Changing it over to production or dev which uses obuilder specs fixed the issue. The step command for creating the prep/universes is causing the error https://github.com/ocurrent/ocaml-docs-ci/blob/main/src/lib/storage.ml#L42-L51

Logs:

#21 [stage-1 13/13] RUN --mount=type=secret,id=ssh_privkey,target=/home/opam/.ssh/id_rsa,uid=1000 --mount=type=secret,id=ssh_pubkey,target=/home/opam/.ssh/id_rsa.pub,uid=1000 --mount=type=secret,id=ssh_config,target=/home/opam/.ssh/config,uid=1000 (echo '0.834307') && (for DATA in prep/universes/7d8209269530ba031e0dae5415095ca4/topkg/1.0.7,topkg.1.0.7-7d8209269530ba031e0dae5415095ca4,topkg.1.0.7 prep/universes/efb7484280b8d1f8589b4b784d9b12a9/stdint/0.7.2,stdint.0.7.2-efb7484280b8d1f8589b4b784d9b12a9,stdint.0.7.2 prep/universes/b4ff2927357c9ead2679e5d779bd6414/ocamlfind/1.9.6,ocamlfind.1.9.6-b4ff2927357c9ead2679e5d779bd6414,ocamlfind.1.9.6 prep/universes/b4ff2927357c9ead2679e5d779bd6414/ocamlbuild/0.14.2,ocamlbuild.0.14.2-b4ff2927357c9ead2679e5d779bd6414,ocamlbuild.0.14.2 prep/universes/7c62a60b0db47a8cfb2eaa2f159ef861/ocaml-config/2,ocaml-config.2-7c62a60b0db47a8cfb2eaa2f159ef861,ocaml-config.2 prep/universes/d41d8cd98f00b204e9800998ecf8427e/ocaml-base-compiler/4.14.1,ocaml-base-compiler.4.14.1-d41d8cd98f00b204e9800998ecf8427e,ocaml-base-compiler.4.14.1 prep/universes/f93dc14fbe1cce67b64997e50ae3afca/ocaml/4.14.1,ocaml.4.14.1-f93dc14fbe1cce67b64997e50ae3afca,ocaml.4.14.1 prep/universes/b093f767a90d63c3c3b7c16a04bfe363/logs/0.7.0,logs.0.7.0-b093f767a90d63c3c3b7c16a04bfe363,logs.0.7.0 prep/universes/7327e140e1aeb42b7944e88e03dcc002/fmt/0.9.0,fmt.0.9.0-7327e140e1aeb42b7944e88e03dcc002,fmt.0.9.0 prep/universes/51262f1934f91269be94879aa270c8f5/dune/3.7.1,dune.3.7.1-51262f1934f91269be94879aa270c8f5,dune.3.7.1 prep/universes/d41d8cd98f00b204e9800998ecf8427e/base-unix/base,base-unix.base-d41d8cd98f00b204e9800998ecf8427e,base-unix.base prep/universes/d41d8cd98f00b204e9800998ecf8427e/base-threads/base,base-threads.base-d41d8cd98f00b204e9800998ecf8427e,base-threads.base prep/universes/cf0775d03f6860fb1b43568215b623bd/astring/0.8.5,astring.0.8.5-cf0775d03f6860fb1b43568215b623bd,astring.0.8.5 prep/universes/cf0775d03f6860fb1b43568215b623bd/asetmap/0.8.1,asetmap.0.8.1-cf0775d03f6860fb1b43568215b623bd,asetmap.0.8.1 prep/universes/a9d75d19645e80b713ef642efaa79858/capnp-rpc/1.2.3,capnp-rpc.1.2.3-a9d75d19645e80b713ef642efaa79858,capnp-rpc.1.2.3; do IFS=","; set -- $DATA; ([ -d $1 ] || (echo "FAILED:$2" && mkdir -p $1 && cp ~/opam.err.log $1 && opam show $3 --raw > $1/opam)) && (shopt -s nullglob && ((tar -cvf $1.tar $1/*  && rm -R $1/* && mv $1.tar $1/content.tar) || (echo 'Empty directory'))) done) && (for DATA in prep/universes/7d8209269530ba031e0dae5415095ca4/topkg/1.0.7,topkg.1.0.7-7d8209269530ba031e0dae5415095ca4,topkg.1.0.7 prep/universes/efb7484280b8d1f8589b4b784d9b12a9/stdint/0.7.2,stdint.0.7.2-efb7484280b8d1f8589b4b784d9b12a9,stdint.0.7.2 prep/universes/b4ff2927357c9ead2679e5d779bd6414/ocamlfind/1.9.6,ocamlfind.1.9.6-b4ff2927357c9ead2679e5d779bd6414,ocamlfind.1.9.6 prep/universes/b4ff2927357c9ead2679e5d779bd6414/ocamlbuild/0.14.2,ocamlbuild.0.14.2-b4ff2927357c9ead2679e5d779bd6414,ocamlbuild.0.14.2 prep/universes/7c62a60b0db47a8cfb2eaa2f159ef861/ocaml-config/2,ocaml-config.2-7c62a60b0db47a8cfb2eaa2f159ef861,ocaml-config.2 prep/universes/d41d8cd98f00b204e9800998ecf8427e/ocaml-base-compiler/4.14.1,ocaml-base-compiler.4.14.1-d41d8cd98f00b204e9800998ecf8427e,ocaml-base-compiler.4.14.1 prep/universes/f93dc14fbe1cce67b64997e50ae3afca/ocaml/4.14.1,ocaml.4.14.1-f93dc14fbe1cce67b64997e50ae3afca,ocaml.4.14.1 prep/universes/b093f767a90d63c3c3b7c16a04bfe363/logs/0.7.0,logs.0.7.0-b093f767a90d63c3c3b7c16a04bfe363,logs.0.7.0 prep/universes/7327e140e1aeb42b7944e88e03dcc002/fmt/0.9.0,fmt.0.9.0-7327e140e1aeb42b7944e88e03dcc002,fmt.0.9.0 prep/universes/51262f1934f91269be94879aa270c8f5/dune/3.7.1,dune.3.7.1-51262f1934f91269be94879aa270c8f5,dune.3.7.1 prep/universes/d41d8cd98f00b204e9800998ecf8427e/base-unix/base,base-unix.base-d41d8cd98f00b204e9800998ecf8427e,base-unix.base prep/universes/d41d8cd98f00b204e9800998ecf8427e/base-threads/base,base-threads.base-d41d8cd98f00b204e9800998ecf8427e,base-threads.base prep/universes/cf0775d03f6860fb1b43568215b623bd/astring/0.8.5,astring.0.8.5-cf0775d03f6860fb1b43568215b623bd,astring.0.8.5 prep/universes/cf0775d03f6860fb1b43568215b623bd/asetmap/0.8.1,asetmap.0.8.1-cf0775d03f6860fb1b43568215b623bd,asetmap.0.8.1 prep/universes/a9d75d19645e80b713ef642efaa79858/capnp-rpc/1.2.3,capnp-rpc.1.2.3-a9d75d19645e80b713ef642efaa79858,capnp-rpc.1.2.3; do IFS=","; set -- $DATA; rsync -aR --no-p ./$1 172.17.0.1:/data/.; done) && (for DATA in prep/universes/7d8209269530ba031e0dae5415095ca4/topkg/1.0.7,topkg.1.0.7-7d8209269530ba031e0dae5415095ca4,topkg.1.0.7 prep/universes/efb7484280b8d1f8589b4b784d9b12a9/stdint/0.7.2,stdint.0.7.2-efb7484280b8d1f8589b4b784d9b12a9,stdint.0.7.2 prep/universes/b4ff2927357c9ead2679e5d779bd6414/ocamlfind/1.9.6,ocamlfind.1.9.6-b4ff2927357c9ead2679e5d779bd6414,ocamlfind.1.9.6 prep/universes/b4ff2927357c9ead2679e5d779bd6414/ocamlbuild/0.14.2,ocamlbuild.0.14.2-b4ff2927357c9ead2679e5d779bd6414,ocamlbuild.0.14.2 prep/universes/7c62a60b0db47a8cfb2eaa2f159ef861/ocaml-config/2,ocaml-config.2-7c62a60b0db47a8cfb2eaa2f159ef861,ocaml-config.2 prep/universes/d41d8cd98f00b204e9800998ecf8427e/ocaml-base-compiler/4.14.1,ocaml-base-compiler.4.14.1-d41d8cd98f00b204e9800998ecf8427e,ocaml-base-compiler.4.14.1 prep/universes/f93dc14fbe1cce67b64997e50ae3afca/ocaml/4.14.1,ocaml.4.14.1-f93dc14fbe1cce67b64997e50ae3afca,ocaml.4.14.1 prep/universes/b093f767a90d63c3c3b7c16a04bfe363/logs/0.7.0,logs.0.7.0-b093f767a90d63c3c3b7c16a04bfe363,logs.0.7.0 prep/universes/7327e140e1aeb42b7944e88e03dcc002/fmt/0.9.0,fmt.0.9.0-7327e140e1aeb42b7944e88e03dcc002,fmt.0.9.0 prep/universes/51262f1934f91269be94879aa270c8f5/dune/3.7.1,dune.3.7.1-51262f1934f91269be94879aa270c8f5,dune.3.7.1 prep/universes/d41d8cd98f00b204e9800998ecf8427e/base-unix/base,base-unix.base-d41d8cd98f00b204e9800998ecf8427e,base-unix.base prep/universes/d41d8cd98f00b204e9800998ecf8427e/base-threads/base,base-threads.base-d41d8cd98f00b204e9800998ecf8427e,base-threads.base prep/universes/cf0775d03f6860fb1b43568215b623bd/astring/0.8.5,astring.0.8.5-cf0775d03f6860fb1b43568215b623bd,astring.0.8.5 prep/universes/cf0775d03f6860fb1b43568215b623bd/asetmap/0.8.1,asetmap.0.8.1-cf0775d03f6860fb1b43568215b623bd,asetmap.0.8.1 prep/universes/a9d75d19645e80b713ef642efaa79858/capnp-rpc/1.2.3,capnp-rpc.1.2.3-a9d75d19645e80b713ef642efaa79858,capnp-rpc.1.2.3; do IFS=","; set -- $DATA; HASH=$((sha256sum $1/content.tar | cut -d " " -f 1)  || echo -n 'empty'); printf "HASHES:$2:$HASH\n"; done)
#21 0.830 /bin/sh: 1: Syntax error: Missing '))'
@tmcgilchrist tmcgilchrist added the bug Something isn't working label Apr 18, 2023
tmcgilchrist added a commit that referenced this issue Apr 20, 2023
CI_PROFILE=docker has a bug with composing Dockerfiles #111
Plus this path exercises the same obuilder spec path as we use in production.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant