[new release] ocluster (4 packages) (0.3.0)

[benmandrew]

Distribute build jobs to workers

• Project page: https://github.com/ocurrent/ocluster
• Documentation: https://ocurrent.github.io/ocluster/

CHANGES:

• Support OBuilder Docker backend on Windows and Linux (@MisterDA Hook Obuilder Docker backend ocurrent/ocluster#143)
• Support OBuilder FreeBSD worker (@tmcgilchrist Create initial FreeBSD worker ocurrent/ocluster#236)
• Specify upper bound on number of items in OBuilder store (@mtelvers Disk space and number of items in the store ocurrent/ocluster#229)
• Add Prometheus statistics for OBuilder cache hit rate (@mtelvers Added basic Obuilder cache statistics to Prometheus ocurrent/ocluster#238)

[raphael-proust]

@benmandrew There seems to be errors here too:

[ERROR] The compilation of ocluster-worker.0.3.0 failed at "dune build -p ocluster-worker -j 71 @install".

#=== ERROR while compiling ocluster-worker.0.3.0 ==============================#
# context              2.2.0~beta1 | linux/x86_64 | ocaml-base-compiler.4.14.1 | pinned(https://github.com/ocurrent/ocluster/releases/download/v0.3.0/ocluster-0.3.0.tbz)
# path                 ~/.opam/4.14/.opam-switch/build/ocluster-worker.0.3.0
# command              ~/.opam/opam-init/hooks/sandbox.sh build dune build -p ocluster-worker -j 71 @install
# exit-code            1
# env-file             ~/.opam/log/ocluster-worker-7-c20427.env
# output-file          ~/.opam/log/ocluster-worker-7-c20427.out
### output ###
# (cd _build/default && /home/opam/.opam/4.14/bin/ocamlc.opt -w -40 -g -bin-annot -I worker/.cluster_worker.objs/byte -I /home/opam/.opam/4.14/lib/angstrom -I /home/opam/.opam/4.14/lib/asetmap -I /home/opam/.opam/4.14/lib/astring -I /home/opam/.opam/4.14/lib/base64 -I /home/opam/.opam/4.14/lib/bigstringaf -I /home/opam/.opam/4.14/lib/bytes -I /home/opam/.opam/4.14/lib/camlp-streams -I /home/opam/.opam/4.14/lib/capnp -I /home/opam/.opam/4.14/lib/capnp-rpc -I /home/opam/.opam/4.14/lib/capnp-rpc-lwt -I /home/opam/.opam/4.14/lib/cmdliner -I /home/opam/.opam/4.14/lib/cohttp -I /home/opam/.opam/4.14/lib/cohttp-lwt -I /home/opam/.opam/4.14/lib/cohttp-lwt-unix -I /home/opam/.opam/4.14/lib/conduit -I /home/opam/.opam/4.14/lib/conduit-lwt -I /home/opam/.opam/4.14/lib/conduit-lwt-unix -I /home/opam/.opam/4.14/lib/cstruct -I /home/opam/.opam/4.14/lib/cstruct-lwt -I /home/opam/.opam/4.14/lib/digestif -I /home/opam/.opam/4.14/lib/domain-name -I /home/opam/.opam/4.14/lib/eqaf -I /home/opam/.opam/4.14/lib/extunix -I /home/opam/.opam/4.14/lib/fmt -I /home/opam/.opam/4.14/lib/fpath -I /home/opam/.opam/4.14/lib/ipaddr -I /home/opam/.opam/4.14/lib/ipaddr-sexp -I /home/opam/.opam/4.14/lib/ipaddr/unix -I /home/opam/.opam/4.14/lib/logs -I /home/opam/.opam/4.14/lib/lwt -I /home/opam/.opam/4.14/lib/lwt/unix -I /home/opam/.opam/4.14/lib/macaddr -I /home/opam/.opam/4.14/lib/magic-mime -I /home/opam/.opam/4.14/lib/obuilder -I /home/opam/.opam/4.14/lib/obuilder-spec -I /home/opam/.opam/4.14/lib/ocaml/threads -I /home/opam/.opam/4.14/lib/ocluster-api -I /home/opam/.opam/4.14/lib/ocplib-endian -I /home/opam/.opam/4.14/lib/ocplib-endian/bigstring -I /home/opam/.opam/4.14/lib/parsexp -I /home/opam/.opam/4.14/lib/ppx_deriving/runtime -I /home/opam/.opam/4.14/lib/ppx_deriving_yojson/runtime -I /home/opam/.opam/4.14/lib/ppx_sexp_conv/runtime-lib -I /home/opam/.opam/4.14/lib/prometheus -I /home/opam/.opam/4.14/lib/prometheus-app -I /home/opam/.opam/4.14/lib/re -I /home/opam/.opam/4.14/lib/res -I /home/opam/.opam/4.14/lib/result -I /home/opam/.opam/4.14/lib/seq -I /home/opam/.opam/4.14/lib/sexplib -I /home/opam/.opam/4.14/lib/sexplib0 -I /home/opam/.opam/4.14/lib/sha -I /home/opam/.opam/4.14/lib/sqlite3 -I /home/opam/.opam/4.14/lib/stdint -I /home/opam/.opam/4.14/lib/stdlib-shims -I /home/opam/.opam/4.14/lib/stringext -I /home/opam/.opam/4.14/lib/tar -I /home/opam/.opam/4.14/lib/tar-unix -I /home/opam/.opam/4.14/lib/uri -I /home/opam/.opam/4.14/lib/uri-sexp -I /home/opam/.opam/4.14/lib/uri/services -I /home/opam/.opam/4.14/lib/yojson -intf-suffix .ml -no-alias-deps -open Cluster_worker__ -o worker/.cluster_worker.objs/byte/cluster_worker__Fetcher.cmo -c -impl worker/fetcher.ml)
# File "worker/fetcher.ml", line 1, characters 8-31:
# 1 | include Obuilder.Docker_extract
#             ^^^^^^^^^^^^^^^^^^^^^^^
# Error: Unbound module Obuilder.Docker_extract
# (cd _build/default && /home/opam/.opam/4.14/bin/ocamlopt.opt -w -40 -g -I worker/.cluster_worker.objs/byte -I worker/.cluster_worker.objs/native -I /home/opam/.opam/4.14/lib/angstrom -I /home/opam/.opam/4.14/lib/asetmap -I /home/opam/.opam/4.14/lib/astring -I /home/opam/.opam/4.14/lib/base64 -I /home/opam/.opam/4.14/lib/bigstringaf -I /home/opam/.opam/4.14/lib/bytes -I /home/opam/.opam/4.14/lib/camlp-streams -I /home/opam/.opam/4.14/lib/capnp -I /home/opam/.opam/4.14/lib/capnp-rpc -I /home/opam/.opam/4.14/lib/capnp-rpc-lwt -I /home/opam/.opam/4.14/lib/cmdliner -I /home/opam/.opam/4.14/lib/cohttp -I /home/opam/.opam/4.14/lib/cohttp-lwt -I /home/opam/.opam/4.14/lib/cohttp-lwt-unix -I /home/opam/.opam/4.14/lib/conduit -I /home/opam/.opam/4.14/lib/conduit-lwt -I /home/opam/.opam/4.14/lib/conduit-lwt-unix -I /home/opam/.opam/4.14/lib/cstruct -I /home/opam/.opam/4.14/lib/cstruct-lwt -I /home/opam/.opam/4.14/lib/digestif -I /home/opam/.opam/4.14/lib/domain-name -I /home/opam/.opam/4.14/lib/eqaf -I /home/opam/.opam/4.14/lib/extunix -I /home/opam/.opam/4.14/lib/fmt -I /home/opam/.opam/4.14/lib/fpath -I /home/opam/.opam/4.14/lib/ipaddr -I /home/opam/.opam/4.14/lib/ipaddr-sexp -I /home/opam/.opam/4.14/lib/ipaddr/unix -I /home/opam/.opam/4.14/lib/logs -I /home/opam/.opam/4.14/lib/lwt -I /home/opam/.opam/4.14/lib/lwt/unix -I /home/opam/.opam/4.14/lib/macaddr -I /home/opam/.opam/4.14/lib/magic-mime -I /home/opam/.opam/4.14/lib/obuilder -I /home/opam/.opam/4.14/lib/obuilder-spec -I /home/opam/.opam/4.14/lib/ocaml/threads -I /home/opam/.opam/4.14/lib/ocluster-api -I /home/opam/.opam/4.14/lib/ocplib-endian -I /home/opam/.opam/4.14/lib/ocplib-endian/bigstring -I /home/opam/.opam/4.14/lib/parsexp -I /home/opam/.opam/4.14/lib/ppx_deriving/runtime -I /home/opam/.opam/4.14/lib/ppx_deriving_yojson/runtime -I /home/opam/.opam/4.14/lib/ppx_sexp_conv/runtime-lib -I /home/opam/.opam/4.14/lib/prometheus -I /home/opam/.opam/4.14/lib/prometheus-app -I /home/opam/.opam/4.14/lib/re -I /home/opam/.opam/4.14/lib/res -I /home/opam/.opam/4.14/lib/result -I /home/opam/.opam/4.14/lib/seq -I /home/opam/.opam/4.14/lib/sexplib -I /home/opam/.opam/4.14/lib/sexplib0 -I /home/opam/.opam/4.14/lib/sha -I /home/opam/.opam/4.14/lib/sqlite3 -I /home/opam/.opam/4.14/lib/stdint -I /home/opam/.opam/4.14/lib/stdlib-shims -I /home/opam/.opam/4.14/lib/stringext -I /home/opam/.opam/4.14/lib/tar -I /home/opam/.opam/4.14/lib/tar-unix -I /home/opam/.opam/4.14/lib/uri -I /home/opam/.opam/4.14/lib/uri-sexp -I /home/opam/.opam/4.14/lib/uri/services -I /home/opam/.opam/4.14/lib/yojson -intf-suffix .ml -no-alias-deps -open Cluster_worker__ -o worker/.cluster_worker.objs/native/cluster_worker__Fetcher.cmx -c -impl worker/fetcher.ml)
# File "worker/fetcher.ml", line 1, characters 8-31:
# 1 | include Obuilder.Docker_extract
#             ^^^^^^^^^^^^^^^^^^^^^^^
# Error: Unbound module Obuilder.Docker_extract
# (cd _build/default && /home/opam/.opam/4.14/bin/ocamlc.opt -w -40 -g -bin-annot -I worker/.cluster_worker.objs/byte -I /home/opam/.opam/4.14/lib/angstrom -I /home/opam/.opam/4.14/lib/asetmap -I /home/opam/.opam/4.14/lib/astring -I /home/opam/.opam/4.14/lib/base64 -I /home/opam/.opam/4.14/lib/bigstringaf -I /home/opam/.opam/4.14/lib/bytes -I /home/opam/.opam/4.14/lib/camlp-streams -I /home/opam/.opam/4.14/lib/capnp -I /home/opam/.opam/4.14/lib/capnp-rpc -I /home/opam/.opam/4.14/lib/capnp-rpc-lwt -I /home/opam/.opam/4.14/lib/cmdliner -I /home/opam/.opam/4.14/lib/cohttp -I /home/opam/.opam/4.14/lib/cohttp-lwt -I /home/opam/.opam/4.14/lib/cohttp-lwt-unix -I /home/opam/.opam/4.14/lib/conduit -I /home/opam/.opam/4.14/lib/conduit-lwt -I /home/opam/.opam/4.14/lib/conduit-lwt-unix -I /home/opam/.opam/4.14/lib/cstruct -I /home/opam/.opam/4.14/lib/cstruct-lwt -I /home/opam/.opam/4.14/lib/digestif -I /home/opam/.opam/4.14/lib/domain-name -I /home/opam/.opam/4.14/lib/eqaf -I /home/opam/.opam/4.14/lib/extunix -I /home/opam/.opam/4.14/lib/fmt -I /home/opam/.opam/4.14/lib/fpath -I /home/opam/.opam/4.14/lib/ipaddr -I /home/opam/.opam/4.14/lib/ipaddr-sexp -I /home/opam/.opam/4.14/lib/ipaddr/unix -I /home/opam/.opam/4.14/lib/logs -I /home/opam/.opam/4.14/lib/lwt -I /home/opam/.opam/4.14/lib/lwt/unix -I /home/opam/.opam/4.14/lib/macaddr -I /home/opam/.opam/4.14/lib/magic-mime -I /home/opam/.opam/4.14/lib/obuilder -I /home/opam/.opam/4.14/lib/obuilder-spec -I /home/opam/.opam/4.14/lib/ocaml/threads -I /home/opam/.opam/4.14/lib/ocluster-api -I /home/opam/.opam/4.14/lib/ocplib-endian -I /home/opam/.opam/4.14/lib/ocplib-endian/bigstring -I /home/opam/.opam/4.14/lib/parsexp -I /home/opam/.opam/4.14/lib/ppx_deriving/runtime -I /home/opam/.opam/4.14/lib/ppx_deriving_yojson/runtime -I /home/opam/.opam/4.14/lib/ppx_sexp_conv/runtime-lib -I /home/opam/.opam/4.14/lib/prometheus -I /home/opam/.opam/4.14/lib/prometheus-app -I /home/opam/.opam/4.14/lib/re -I /home/opam/.opam/4.14/lib/res -I /home/opam/.opam/4.14/lib/result -I /home/opam/.opam/4.14/lib/seq -I /home/opam/.opam/4.14/lib/sexplib -I /home/opam/.opam/4.14/lib/sexplib0 -I /home/opam/.opam/4.14/lib/sha -I /home/opam/.opam/4.14/lib/sqlite3 -I /home/opam/.opam/4.14/lib/stdint -I /home/opam/.opam/4.14/lib/stdlib-shims -I /home/opam/.opam/4.14/lib/stringext -I /home/opam/.opam/4.14/lib/tar -I /home/opam/.opam/4.14/lib/tar-unix -I /home/opam/.opam/4.14/lib/uri -I /home/opam/.opam/4.14/lib/uri-sexp -I /home/opam/.opam/4.14/lib/uri/services -I /home/opam/.opam/4.14/lib/yojson -no-alias-deps -open Cluster_worker__ -o worker/.cluster_worker.objs/byte/cluster_worker__Obuilder_build.cmi -c -intf worker/obuilder_build.mli)
# File "worker/obuilder_build.mli", line 6, characters 23-53:
# 6 |   val v : [ `Native of Obuilder.Native_sandbox.config
#                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
# Error: Unbound module Obuilder.Native_sandbox

[benmandrew]

This is dependent on the new release of obuilder.0.6.0 #25147, so I'll wait until I've corrected that and see if merging it fixes the CI for this PR.

[benmandrew]

CI failures are unrelated, now that obuilder.0.6.0 has been merged so can this PR.

[mseri]

Thanks