zookeeper--3.7.0_1 fails to install on Intel Mac Big Sur

[pixelpshr]

Installing on:

$ uname -a
Darwin MM271190-PC 20.6.0 Darwin Kernel Version 20.6.0: Tue Oct 12 18:33:42 PDT 2021; root:xnu-7195.141.8~1/RELEASE_X86_64 x86_64

When I try to install zookeeper, I get these messages:

brew install zookeeper
==> Downloading https://ghcr.io/v2/homebrew/core/zookeeper/manifests/3.7.0_1
######################################################################## 100.0%
==> Downloading https://ghcr.io/v2/homebrew/core/zookeeper/blobs/sha256:7a09b012f9b2e0c6dde46dfebf2f66846ab86e154087310b991
==> Downloading from https://pkg-containers.githubusercontent.com/ghcr1/blobs/sha256:7a09b012f9b2e0c6dde46dfebf2f66846ab86e
######################################################################## 100.0%
==> Pouring zookeeper--3.7.0_1.big_sur.bottle.tar.gz
Warning: The post-install step did not complete successfully
You can try again using:
  brew postinstall zookeeper
==> Caveats
To start zookeeper now and restart at login:
  brew services start zookeeper
Or, if you don't want/need a background service you can just run:
  zkServer start
==> Summary
🍺  /usr/local/Cellar/zookeeper/3.7.0_1: 1,074 files, 42.4MB

Running zkServer shows me a possible error:

$ zkServer start
/usr/local/bin/zkServer: line 3: /usr/local/etc/zookeeper/defaults: No such file or directory
ZooKeeper JMX enabled by default
Using config: /usr/local/Cellar/zookeeper/3.7.0_1/libexec/bin/../etc/zookeeper/zoo.cfg
grep: /usr/local/Cellar/zookeeper/3.7.0_1/libexec/bin/../etc/zookeeper/zoo.cfg: No such file or directory
grep: /usr/local/Cellar/zookeeper/3.7.0_1/libexec/bin/../etc/zookeeper/zoo.cfg: No such file or directory
mkdir: : No such file or directory
Starting zookeeper ... /usr/local/Cellar/zookeeper/3.7.0_1/libexec/bin/zkServer.sh: line 175: /zookeeper_server.pid: Read-only file system
FAILED TO WRITE PID

There actually is a /usr/local/etc/zookeeper/zoo.cfg file, but there is no defaults directory there. The path shown in the "Using config:" line is incorrect. And, it looks like the zhServer.sh script is trying to write the PID lock file to the root directory. This is obviously not going to work.

I've never had to debug a brew formulae before. I hope this is enough information for someone to figure out what is going wrong.

Thanks,
Thom

[SMillerDev]

What does brew postinstall zookeeper --debug output?

[pixelpshr]

The --debug option gave me enough info to find the permission problem. Thanks!

[pixelpshr]

Hopefully, this will mean more to you than it does me! ;)

$ brew postinstall zookeeper --debug
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::FormulaLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/zookeeper.rb
==> Postinstalling zookeeper
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::FromPathLoader): loading /usr/local/opt/zookeeper/.brew/zookeeper.rb
Warning: The post-install step did not complete successfully
You can try again using:
  brew postinstall zookeeper
==> An exception occurred within a child process:
  Errno::EACCES: Permission denied @ dir_s_mkdir - /usr/local/var/run/zookeeper

/usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.8/lib/ruby/2.6.0/fileutils.rb:239:in `mkdir'
/usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.8/lib/ruby/2.6.0/fileutils.rb:239:in `fu_mkdir'
/usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.8/lib/ruby/2.6.0/fileutils.rb:217:in `block (2 levels) in mkdir_p'
/usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.8/lib/ruby/2.6.0/fileutils.rb:215:in `reverse_each'
/usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.8/lib/ruby/2.6.0/fileutils.rb:215:in `block in mkdir_p'
/usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.8/lib/ruby/2.6.0/fileutils.rb:200:in `each'
/usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.8/lib/ruby/2.6.0/fileutils.rb:200:in `mkdir_p'
/usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.8/lib/ruby/2.6.0/pathname.rb:578:in `mkpath'
/usr/local/Homebrew/Library/Homebrew/extend/pathname.rb:215:in `cp_path_sub'
/usr/local/Homebrew/Library/Homebrew/install_renamed.rb:20:in `cp_path_sub'
/usr/local/Homebrew/Library/Homebrew/formula.rb:1122:in `block (2 levels) in run_post_install'
/usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.8/lib/ruby/2.6.0/find.rb:49:in `block (2 levels) in find'
/usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.8/lib/ruby/2.6.0/find.rb:48:in `catch'
/usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.8/lib/ruby/2.6.0/find.rb:48:in `block in find'
/usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.8/lib/ruby/2.6.0/find.rb:43:in `each'
/usr/local/Homebrew/Library/Homebrew/vendor/portable-ruby/2.6.8/lib/ruby/2.6.0/find.rb:43:in `find'
/usr/local/Homebrew/Library/Homebrew/formula.rb:1119:in `block in run_post_install'
/usr/local/Homebrew/Library/Homebrew/utils.rb:550:in `with_env'
/usr/local/Homebrew/Library/Homebrew/formula.rb:1114:in `run_post_install'
/usr/local/Homebrew/Library/Homebrew/postinstall.rb:22:in `<main>'

[pixelpshr]

Ahhh... maybe a solution! The owner of the /usr/local/var/run directory was root. I changed that so that I'm the owner and things started looking better.

$ brew postinstall zookeeper --debug
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::FormulaLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/zookeeper.rb
==> Postinstalling zookeeper
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::FromPathLoader): loading /usr/local/opt/zookeeper/.brew/zookeeper.rb
$
$ zkServer start
ZooKeeper JMX enabled by default
Using config: /usr/local/etc/zookeeper/zoo.cfg
Starting zookeeper ... STARTED
$
$ zkServer status
ZooKeeper JMX enabled by default
Using config: /usr/local/etc/zookeeper/zoo.cfg
Client port found: 2181. Client address: localhost. Client SSL: false.
Mode: standalone
$

[SMillerDev]

It seems you used sudo brew services to start zookeeper before. This means you manually need to fix permissions on every update, as was also printed when you ran it.

sudo chown $(whoami) /usr/local/* will restore all permissions for now, but next time you might want to do sudo brew services stop zookeeper before you update.

[pixelpshr]

There was actually something else that had created and was using the /usr/local/var/run directory. I'm not sure where lldpd came from, but it was created by root. This is what it looks like now:

$ ll /usr/local/var/run
total 0
drwxr-xr-x  3 root      admin     96B Oct 18 10:07 lldpd
srwxrwx---  1 _lldpd    _lldpd     0B Nov 18 07:51 lldpd.socket
drwxr-xr-x  3 tdecarlo  admin     96B Nov 19 12:22 zookeeper

[pixelpshr]

Interesting (and troubling) that when I list the active brew services, it shows zookeeper status as error, but when I list with the --debug option it shows that zookeeper has started.

$ brew services list
1024
Name      Status  User     File
kafka     started tdecarlo
zookeeper error   tdecarlo
$
$ brew services list --debug
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/hwloc.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/gmp.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/mpich.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/cmake.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/mpfr.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/hdf5.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/boost.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/maven.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/icu4c.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/gcc.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/open-mpi.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/zookeeper.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/openjdk.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/kafka.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/ca-certificates.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/gettext.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/zstd.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/googletest.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/netcdf.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/isl.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/pcre2.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/libevent.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/openssl@1.1.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/dos2unix.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/szip.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/boost-mpi.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/git.rb
/usr/local/Homebrew/Library/Homebrew/brew.rb (Formulary::TapLoader): loading /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core/Formula/libmpc.rb
Name      Status  User     File
kafka     started tdecarlo
zookeeper started tdecarlo ~/Library/LaunchAgents/homebrew.mxcl.zookeeper.plist
$
$ brew services list
1024
Name      Status  User     File
kafka     started tdecarlo
zookeeper error   tdecarlo