state of nix-shell on mac os X

[thedavidmeister]

overview

sister of state of nix in travis #633
sister of state of nix in ubuntu #635
child of shell.nix instead of makefile for nixos #627

This issue is tracking the state of nix-shell on mac os x

Equal parts bug/followup from "shell.nix instead of makefile for nixos #627" and "nice to have" feature request since everyone actively developing on mac currently has docker/native setups already working fine.

what is working?

• there were some initial issues we faced around getting native frameworks in nix-shell, these have been addressed in the .nix files
  • https://stackoverflow.com/questions/51161225/how-can-i-make-macos-frameworks-available-to-clang-in-a-nix-environment

what is broken?

errors like this for hc-test and hc-format commands:

  = note: "/nix/store/l928iaj0m48lfb7dib6h7p22d50l566x-clang-wrapper-5.0.2/bin/cc" "-m64" "-L" "/nix/store/9mlgmipqar210mkaiqz3c5il0lxdyrl6-rustc-1.30.0/lib/rustlib/x86_64-apple-darwin/lib" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.0.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.1.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.10.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.11.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.12.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.13.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.14.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.15.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.2.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.3.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.4.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.5.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.6.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.7.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.8.rcgu.o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.in.7rcbfp3g-cgu.9.rcgu.o" "-o" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out" "/private/var/folders/4t/hfyj286s3y7033_vmf6f4c9r0000gn/T/nix-build-rustup-1.13.0.drv-0/rustup.GmVckiMwjoM2/out.2dagjz6qwbd3h9hi.rcgu.o" "-Wl,-dead_strip" "-nodefaultlibs" "-L" "/nix/store/9mlgmipqar210mkaiqz3c5il0lxdyrl6-rustc-1.30.0/lib/rustlib/x86_64-apple-darwin/lib" "/nix/store/9mlgmipqar210mkaiqz3c5il0lxdyrl6-rustc-1.30.0/lib/rustlib/x86_64-apple-darwin/lib/libstd-8b3bb8561e753cc3.rlib" "/nix/store/9mlgmipqar210mkaiqz3c5il0lxdyrl6-rustc-1.30.0/lib/rustlib/x86_64-apple-darwin/lib/libpanic_abort-b9ee24c84d0e59de.rlib" "/nix/store/9mlgmipqar210mkaiqz3c5il0lxdyrl6-rustc-1.30.0/lib/rustlib/x86_64-apple-darwin/lib/liballoc_jemalloc-9da3194f26c70d30.rlib" "/nix/store/9mlgmipqar210mkaiqz3c5il0lxdyrl6-rustc-1.30.0/lib/rustlib/x86_64-apple-darwin/lib/libunwind-91c49fb092ee9054.rlib" "/nix/store/9mlgmipqar210mkaiqz3c5il0lxdyrl6-rustc-1.30.0/lib/rustlib/x86_64-apple-darwin/lib/liballoc_system-d1c4ab3dde829aca.rlib" "/nix/store/9mlgmipqar210mkaiqz3c5il0lxdyrl6-rustc-1.30.0/lib/rustlib/x86_64-apple-darwin/lib/liblibc-1c3f2cdb3479574a.rlib" "/nix/store/9mlgmipqar210mkaiqz3c5il0lxdyrl6-rustc-1.30.0/lib/rustlib/x86_64-apple-darwin/lib/liballoc-892a8b2345126695.rlib" "/nix/store/9mlgmipqar210mkaiqz3c5il0lxdyrl6-rustc-1.30.0/lib/rustlib/x86_64-apple-darwin/lib/libcore-f0e74186ea2048a9.rlib" "/nix/store/9mlgmipqar210mkaiqz3c5il0lxdyrl6-rustc-1.30.0/lib/rustlib/x86_64-apple-darwin/lib/libcompiler_builtins-b360031db1b4c6a3.rlib" "-lSystem" "-lresolv" "-lpthread" "-lc" "-lm"
  = note: dyld: Symbol not found: __ZTIN4llvm2cl18GenericOptionValueE
            Referenced from: /nix/store/9v5i115b2g6wh0rmpmw4lyzmkfqqpc6w-llvm-5.0.2-lib/lib/libLTO.dylib
            Expected in: /nix/store/9mlgmipqar210mkaiqz3c5il0lxdyrl6-rustc-1.30.0/lib/rustlib/x86_64-apple-darwin/lib/libLLVM.dylib
           in /nix/store/9v5i115b2g6wh0rmpmw4lyzmkfqqpc6w-llvm-5.0.2-lib/lib/libLTO.dylib
          clang-5.0: error: unable to execute command: Abort trap: 6
          clang-5.0: error: linker command failed due to signal (use -v to see invocation)

interestingly, hc-wasm-build works.

R&D

some research on the topic highlights a few things:

• Mac os Mojave definitely brought in breaking changes to nix shell that are still being cleaned up and look similar to this "Symbol not found"
  • dyld: Symbol not found: ___CFObjCIsCollectable NixOS/nixpkgs#45042
  • Nix is completely broken after major macOS update NixOS/nix#2444
• Nix does not like case insensitive file systems
  • found a potential solution that involves mounting a case sensitive ISO to /nix via. virtualbox
  • https://functional-orbitz.blogspot.com/2013/05/setting-up-nixops-on-mac-os-x-with.html
  • https://github.com/zefhemel/nixops-mac-setup
  • requires a clean starting point with no pre-installed nix
    • i installed it using the standard linux script
    • Mac OS X scripted uninstall is still WIP so i'll have to work through a manual uninstall
    • How to completely remove Nix from OS X NixOS/nix#458
    • Documenting uninstall for multi-user on macOS NixOS/nix#1551
• Mac OS isn't even linux and obviously Apple probably don't care at all about Nixos
  • i seriously doubt this is even on their radar, i assume they would be somewhere between apathetic to hostile towards making Mac more Nixos-y
  • Mac OS is fundamentally a very stateful system, there are frequently new updates being rolled out that disable/break/throttle/remove functionality that previously worked, across both hardware and software
  • Mac OS is fundamentally a proprietary system, so we are relying on the Nixos community to keep pace with updates, tbh i'm impressed that they generally manage to get things working eventually, just not quite as fast as new OS releases land in the apple app store
• docker can probably be made to work also, i haven't put any time into testing the idea, it doesn't appear as simple as you might think though
  • current official docker is just an alpine box + nix package manager, not a full nixos
  • https://hub.docker.com/r/nixos/nix/
  • somewhat limited by docker's limitations it seems Running NixOS inside Docker NixOS/nixpkgs#2878
  • https://github.com/LnL7/nix-docker#readme

[thedavidmeister]

nix cold build on mac here https://circleci.com/gh/holochain/holochain-rust/16197