SIGBUS: Illegal storage access. (Attempt to read from nil?) on macOS #122

metasyn · 2019-06-11T00:11:41Z

❯ curl https://nim-lang.org/choosenim/init.sh -sSf | sh
choosenim-init: Downloading choosenim-0.4.0_macosx_amd64
SIGBUS: Illegal storage access. (Attempt to read from nil?)

on zsh/bash on macOS 10.14.2

The text was updated successfully, but these errors were encountered:

dom96 · 2019-06-11T20:39:23Z

That's a shame. @genotrance any chance you could take a look?

metasyn · 2019-06-12T00:02:54Z

Happy to help debug if there is anything I can do

metasyn · 2019-06-12T00:07:00Z

Using Nim:

❯ nim --version
Nim Compiler Version 0.20.99 [MacOSX: amd64]
Compiled at 2019-06-11
Copyright (c) 2006-2019 by Andreas Rumpf

git hash: ced0527ae334439a10e1719d1eccb727c19dc781
active boot switches: -d:release

and Nimble:

❯ nimble --version
nimble v0.10.2 compiled at 2019-06-11 00:09:59
git hash: d15c8530cb7480ce39ffa85a2dd9819d2d4fc645

If I run tests:

~/code/choosenim master
❯ nimble test
  Executing task test in /Users/aljohnson/code/choosenim/choosenim.nimble
Hint: used config file '/Users/aljohnson/code/Nim/config/nim.cfg' [Conf]
Hint: used config file '/Users/aljohnson/code/Nim/config/config.nims' [Conf]
Hint: system [Processing]
Hint: widestrs [Processing]
Hint: io [Processing]
Hint: tester [Processing]
Hint: osproc [Processing]
Hint: strutils [Processing]
Hint: parseutils [Processing]
Hint: math [Processing]
Hint: bitops [Processing]
Hint: macros [Processing]
Hint: algorithm [Processing]
Hint: unicode [Processing]
Hint: os [Processing]
Hint: pathnorm [Processing]
Hint: osseps [Processing]
Hint: posix [Processing]
Hint: times [Processing]
Hint: options [Processing]
Hint: typetraits [Processing]
Hint: strtabs [Processing]
Hint: hashes [Processing]
Hint: streams [Processing]
Hint: cpuinfo [Processing]
Hint: kqueue [Processing]
Hint: unittest [Processing]
Hint: sets [Processing]
Hint: terminal [Processing]
Hint: strformat [Processing]
Hint: colors [Processing]
Hint: tables [Processing]
Hint: termios [Processing]
Hint: sequtils [Processing]
Hint: future [Processing]
/Users/aljohnson/code/choosenim/tests/tester.nim(3, 59) Warning: Use the new 'sugar' module instead; future is deprecated [Deprecated]
CC: stdlib_assertions.nim
CC: stdlib_io.nim
CC: stdlib_system.nim
CC: stdlib_parseutils.nim
CC: stdlib_math.nim
CC: stdlib_unicode.nim
CC: stdlib_strutils.nim
CC: stdlib_pathnorm.nim
CC: stdlib_posix.nim
CC: stdlib_times.nim
CC: stdlib_os.nim
CC: stdlib_hashes.nim
CC: stdlib_strtabs.nim
CC: stdlib_streams.nim
CC: stdlib_cpuinfo.nim
CC: stdlib_osproc.nim
CC: stdlib_sets.nim
CC: stdlib_strformat.nim
CC: stdlib_terminal.nim
CC: stdlib_unittest.nim
CC: stdlib_future.nim
CC: tester.nim
Hint:  [Link]
Hint: operation successful (68147 lines compiled; 2.008 sec total; 72.781MiB peakmem; Debug Build) [SuccessX]
Hint: /Users/aljohnson/code/choosenim/tests/tester  [Exec]
  Verifying dependencies for choosenim@0.4.0
      Info: Dependency on nimble@>= 0.8.5 already satisfied
  Verifying dependencies for nimble@0.10.2
      Info: Dependency on untar@>= 0.1.0 already satisfied
  Verifying dependencies for untar@0.1.0
      Info: Dependency on libcurl@>= 1.0.0 already satisfied
  Verifying dependencies for libcurl@1.0.0
      Info: Dependency on analytics@>= 0.2.0 already satisfied
  Verifying dependencies for analytics@0.2.0
      Info: Dependency on uuids@>= 0.1.7 already satisfied
  Verifying dependencies for uuids@0.1.10
      Info: Dependency on isaac@>= 0.1.3 already satisfied
  Verifying dependencies for isaac@0.1.3
      Info: Dependency on osinfo@>= 0.3.0 already satisfied
  Verifying dependencies for osinfo@0.3.0
      Info: Dependency on osinfo@>= 0.3.0 already satisfied
  Verifying dependencies for osinfo@0.3.0
   Building choosenim/choosenim using c backend
[OK] can compile choosenim
/Users/aljohnson/code/choosenim/tests/tester.nim(117, 17): Check failed: inLines(output.processOutput, "invalid")
/Users/aljohnson/code/choosenim/tests/tester.nim(118, 17): Check failed: inLines(output.processOutput, "version")
/Users/aljohnson/code/choosenim/tests/tester.nim(119, 17): Check failed: inLines(output.processOutput, "path")
/Users/aljohnson/code/choosenim/tests/tester.nim(124, 17): Check failed: inLines(output.processOutput, "no")
/Users/aljohnson/code/choosenim/tests/tester.nim(125, 17): Check failed: inLines(output.processOutput, "binary")
/Users/aljohnson/code/choosenim/tests/tester.nim(126, 17): Check failed: inLines(output.processOutput, "found")
[FAILED] refuses invalid path
/Users/aljohnson/code/choosenim/tests/tester.nim(132, 15): Check failed: inLines(output.processOutput, "unknown")
/Users/aljohnson/code/choosenim/tests/tester.nim(133, 15): Check failed: inLines(output.processOutput, "flag")
[FAILED] fails on bad flag
    Prompt: Can choosenim record and send anonymised telemetry data? [y/n]
        ... Anonymous aggregate user analytics allow us to prioritise
        ... fixes and features based on how, where and when people use Nim.
        ... For more details see: https://goo.gl/NzUEPf.
    Answer: Forced Yes
Traceback (most recent call last)
/Users/aljohnson/code/choosenim/src/choosenim.nim(268) choosenim
/Users/aljohnson/code/choosenim/src/choosenim/telemetry.nim(120) loadAnalytics
/Users/aljohnson/.nimble/pkgs/analytics-0.2.0/analytics.nim(63) newAsyncAnalytics
/Users/aljohnson/code/Nim/lib/pure/httpclient.nim(658) newAnalyticsRef
/Users/aljohnson/code/Nim/lib/pure/httpclient.nim(412) getDefaultSSL
/Users/aljohnson/code/Nim/lib/pure/net.nim(532) newContext
SIGBUS: Illegal storage access. (Attempt to read from nil?)
/Users/aljohnson/code/choosenim/tests/tester.nim(139, 19): Check failed: exitCode == QuitSuccess
exitCode was 1
QuitSuccess was 0
/Users/aljohnson/code/choosenim/tests/tester.nim(141, 17): Check failed: inLines(output.processOutput, "building")
/Users/aljohnson/code/choosenim/tests/tester.nim(142, 17): Check failed: inLines(output.processOutput, "downloading")
/Users/aljohnson/code/choosenim/tests/tester.nim(146, 19): Check failed: inLines(output.processOutput, "building tools")
/Users/aljohnson/code/choosenim/tests/tester.nim(147, 17): Check failed: hasLine(output.processOutput, "switched to nim 0.16.0")
/Users/aljohnson/code/choosenim/tests/tester.nim(151, 19): Check failed: exitCode == QuitSuccess
exitCode was 1
QuitSuccess was 0
/Users/aljohnson/code/choosenim/tests/tester.nim(153, 17): Check failed: hasLine(output.processOutput, "info: version 0.16.0 already selected")
/Users/aljohnson/code/choosenim/tests/tester.nim(157, 19): Check failed: exitCode == QuitSuccess
exitCode was 127
QuitSuccess was 0
/Users/aljohnson/code/choosenim/tests/tester.nim(158, 17): Check failed: inLines(output.processOutput, "v0.8.2")
[FAILED] can choose v0.16.0
Error: execution of an external program failed: '/Users/aljohnson/code/choosenim/tests/tester '
stack trace: (most recent call last)
/private/var/folders/cy/fp9dph0x14x9s7fszwjjjh4c0000gn/T/nimblecache/nimscriptapi.nim(164, 16)
/Users/aljohnson/code/choosenim/choosenim_8672.nims(28, 10) testTask
/Users/aljohnson/code/Nim/lib/system/nimscript.nim(242, 7) exec
/Users/aljohnson/code/Nim/lib/system/nimscript.nim(242, 7) Error: unhandled exception: FAILED: nim c -r tester
     Error: Exception raised during nimble script execution

Not positive if this is helpful

dom96 · 2019-06-12T20:56:23Z

Seems like this is where the crash is coming from:

Traceback (most recent call last)
/Users/aljohnson/code/choosenim/src/choosenim.nim(268) choosenim
/Users/aljohnson/code/choosenim/src/choosenim/telemetry.nim(120) loadAnalytics
/Users/aljohnson/.nimble/pkgs/analytics-0.2.0/analytics.nim(63) newAsyncAnalytics
/Users/aljohnson/code/Nim/lib/pure/httpclient.nim(658) newAnalyticsRef
/Users/aljohnson/code/Nim/lib/pure/httpclient.nim(412) getDefaultSSL
/Users/aljohnson/code/Nim/lib/pure/net.nim(532) newContext
SIGBUS: Illegal storage access. (Attempt to read from nil?)

Can you look into that code and debug why that's nil?

genotrance · 2019-06-13T14:43:26Z

Sorry I've not had OSX access for some time, but feels like an SSL setup issue. Might be worth checking which version of openssl is present, updating with brew, and checking the order of versions in the Nim openssl wrapper.

metasyn · 2019-06-13T18:37:16Z

Hmm - it could be - here is my version:

❯ openssl version
OpenSSL 1.1.0j  20 Nov 2018

At the end of httpclient.nim, I added:

when isMainModule:
  let j = getDefaultSSL()

with no error when I run it.

When I check the the wrapper (lib/wrappers/openssl.nim):

  when defined(osx):
    const versions = "(.1.1|.38|.39|.41|.43|.44|.45|.46|.10|.1.0.2|.1.0.1|.1.0.0|.0.9.9|.0.9.8|)"
  else:
    const versions = "(.1.1|.1.0.2|.1.0.1|.1.0.0|.0.9.9|.0.9.8|.46|.45|.44|.43|.41|.39|.38|.10|)"

When I build and test the wrapper:

❯ ./bin/nim c -d:ssl -p:. -r tests/untestable/tssl.nim
Hint: used config file '/Users/aljohnson/code/Nim/config/nim.cfg' [Conf]
Hint: used config file '/Users/aljohnson/code/Nim/config/config.nims' [Conf]
Hint: system [Processing]
Hint: widestrs [Processing]
Hint: io [Processing]
Hint: tssl [Processing]
Hint: httpclient [Processing]
Hint: net [Processing]
Hint: nativesockets [Processing]
Hint: os [Processing]
Hint: strutils [Processing]
Hint: parseutils [Processing]
Hint: math [Processing]
Hint: bitops [Processing]
Hint: macros [Processing]
Hint: algorithm [Processing]
Hint: unicode [Processing]
Hint: pathnorm [Processing]
Hint: osseps [Processing]
Hint: posix [Processing]
Hint: times [Processing]
Hint: options [Processing]
Hint: typetraits [Processing]
Hint: sets [Processing]
Hint: hashes [Processing]
Hint: openssl [Processing]
Hint: dynlib [Processing]
Hint: uri [Processing]
Hint: strtabs [Processing]
Hint: base64 [Processing]
Hint: mimetypes [Processing]
Hint: random [Processing]
Hint: httpcore [Processing]
Hint: tables [Processing]
Hint: streams [Processing]
Hint: asyncnet [Processing]
Hint: asyncdispatch [Processing]
Hint: heapqueue [Processing]
Hint: lists [Processing]
Hint: asyncstreams [Processing]
Hint: asyncfutures [Processing]
Hint: deques [Processing]
Hint: cstrutils [Processing]
Hint: selectors [Processing]
Hint: kqueue [Processing]
Hint: asyncfile [Processing]
CC: stdlib_assertions.nim
CC: stdlib_io.nim
CC: stdlib_system.nim
CC: stdlib_parseutils.nim
CC: stdlib_math.nim
CC: stdlib_strutils.nim
CC: stdlib_pathnorm.nim
CC: stdlib_posix.nim
CC: stdlib_options.nim
CC: stdlib_times.nim
CC: stdlib_os.nim
CC: stdlib_nativesockets.nim
CC: stdlib_hashes.nim
CC: stdlib_sets.nim
CC: stdlib_dynlib.nim
CC: stdlib_openssl.nim
CC: stdlib_net.nim
CC: stdlib_uri.nim
CC: stdlib_base64.nim
CC: stdlib_random.nim
CC: stdlib_tables.nim
CC: stdlib_httpcore.nim
CC: stdlib_streams.nim
CC: stdlib_heapqueue.nim
CC: stdlib_deques.nim
CC: stdlib_asyncfutures.nim
CC: stdlib_kqueue.nim
CC: stdlib_selectors.nim
CC: stdlib_asyncdispatch.nim
CC: stdlib_httpclient.nim
CC: tssl.nim
Hint:  [Link]
Hint: operation successful (77530 lines compiled; 2.348 sec total; 90.57MiB peakmem; Debug Build) [SuccessX]
Hint: /Users/aljohnson/code/Nim/tests/untestable/tssl  [Exec]
version: 0x00000000101000AF
done

Test:

❯ ./bin/nim c -d:ssl -p:. --dynlibOverride:ssl --passL:-lcrypto --passL:-lssl -r tests/untestable/tssl.nim
Hint: used config file '/Users/aljohnson/code/Nim/config/nim.cfg' [Conf]
Hint: used config file '/Users/aljohnson/code/Nim/config/config.nims' [Conf]
Hint: system [Processing]
Hint: widestrs [Processing]
Hint: io [Processing]
Hint: tssl [Processing]
Hint: httpclient [Processing]
Hint: net [Processing]
Hint: nativesockets [Processing]
Hint: os [Processing]
Hint: strutils [Processing]
Hint: parseutils [Processing]
Hint: math [Processing]
Hint: bitops [Processing]
Hint: macros [Processing]
Hint: algorithm [Processing]
Hint: unicode [Processing]
Hint: pathnorm [Processing]
Hint: osseps [Processing]
Hint: posix [Processing]
Hint: times [Processing]
Hint: options [Processing]
Hint: typetraits [Processing]
Hint: sets [Processing]
Hint: hashes [Processing]
Hint: openssl [Processing]
Hint: dynlib [Processing]
Hint: uri [Processing]
Hint: strtabs [Processing]
Hint: base64 [Processing]
Hint: mimetypes [Processing]
Hint: random [Processing]
Hint: httpcore [Processing]
Hint: tables [Processing]
Hint: streams [Processing]
Hint: asyncnet [Processing]
Hint: asyncdispatch [Processing]
Hint: heapqueue [Processing]
Hint: lists [Processing]
Hint: asyncstreams [Processing]
Hint: asyncfutures [Processing]
Hint: deques [Processing]
Hint: cstrutils [Processing]
Hint: selectors [Processing]
Hint: kqueue [Processing]
Hint: asyncfile [Processing]
CC: stdlib_system.nim
CC: stdlib_strutils.nim
CC: stdlib_openssl.nim
CC: stdlib_net.nim
Hint:  [Link]
Undefined symbols for architecture x86_64:
  "_OPENSSL_init_ssl", referenced from:
      _SSL_library_init_6SfBfS64wp6JZihQGGrnKg in stdlib_openssl.nim.c.o
  "_OpenSSL_version_num", referenced from:
      _getOpenSSLVersion_dJsO04BYfgh1GDCx4NNEgA in stdlib_openssl.nim.c.o
ld: symbol(s) not found for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
Error: execution of an external program failed: 'clang   -o /Users/aljohnson/code/Nim/tests/untestable/tssl  /Users/aljohnson/.cache/nim/tssl_d/stdlib_assertions.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_io.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_system.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_parseutils.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_math.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_strutils.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_pathnorm.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_posix.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_options.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_times.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_os.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_nativesockets.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_hashes.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_sets.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_openssl.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_net.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_uri.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_base64.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_random.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_tables.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_httpcore.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_streams.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_heapqueue.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_deques.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_asyncfutures.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_kqueue.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_selectors.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_asyncdispatch.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/stdlib_httpclient.nim.c.o /Users/aljohnson/.cache/nim/tssl_d/tssl.nim.c.o  -lm  -lcrypto -lssl  -ldl'

which looks like it could be part of the issue. I'll try changing some openssl stuff and see whats going on...

dom96 · 2019-06-13T20:08:52Z

I don't think that's an issue, don't mess with --dynlibOverride. Do try using httpclient and see if you can reproduce this.

metasyn · 2019-07-12T02:11:37Z

I've since moved to using a different computer (also macOS) which does not have this problem. I'm going to chock it up to my weird setup on the old machine and close; someone else can re-open if this becomes an issue or something :)

Thanks!

Milerius · 2019-12-13T20:47:19Z

@dom96

can we reopen:

➜ bin curl https://nim-lang.org/choosenim/init.sh -sSf | sh
choosenim-init: Downloading choosenim-0.4.0_macosx_amd64
SIGBUS: Illegal storage access. (Attempt to read from nil?)

OSX Catalina, AppleClang 11.

dom96 · 2019-12-13T23:06:53Z

@Milerius can you have a look at the above posts by me and the original author and see if you can reproduce by using httpclient? (you can install Nim some other way to try compiling a program which uses httpclient).

genotrance · 2020-01-11T23:45:37Z

I just tried on Mojave with openssl 1.1.1d and it all works fine. This is with Nim 1.0.4 and choosenim 0.5.0+.

dom96 · 2020-01-12T14:33:31Z

We need a debug build of choosenim so that we can ask users who receive such crashes to try it and give us a stack trace.

genotrance · 2020-01-12T17:07:39Z

--debuginfo --debugger:native or just no -d:release / -d:danger?

dom96 · 2020-01-12T17:52:50Z

just no -d:release / -d:danger

Just this.

genotrance · 2020-01-12T18:13:34Z

Okay, I'll add it to the CI and debug builds will get posted for every release.

genotrance · 2020-01-13T20:52:38Z

PR #160 now posts debug builds. Next minor release will have debug builds which can be used for such issues going forward.

timotheecour · 2020-01-19T20:25:28Z

this bug affects github actions installing nim, which affects nimble packages like glob, eg see Revert "fix: normalize input paths (#37)" haltcase/glob#43 (comment)
this issues doesn't occur on my osx catalina (10.15.2 ) but might be depending on environment
on an older OSX sierra 10.12 it gave additional warning msgs:

curl https://nim-lang.org/choosenim/init.sh -sSf | sh
...
Extracting nim-1.0.4.tar.xz
dyld: lazy symbol binding failed: Symbol not found: _futimens
  Referenced from: /var/folders/bb/0tr5gkzx6s9dvb2t67_pfpj80000gn/T//choosenim-0.5.1_macosx_amd64 (which was built for Mac OS X 10.13)
  Expected in: /usr/lib/libSystem.B.dylib

dyld: Symbol not found: _futimens
  Referenced from: /var/folders/bb/0tr5gkzx6s9dvb2t67_pfpj80000gn/T//choosenim-0.5.1_macosx_amd64 (which was built for Mac OS X 10.13)
  Expected in: /usr/lib/libSystem.B.dylib

SIGABRT: Abnormal termination.

here's more debugging information:
curl https://nim-lang.org/choosenim/init.sh -sSf > /tmp/z01.sh
instrument /tmp/z01.sh to see where it fails
=> it fails here: "$temp_prefix/$filename" $CHOOSE_VERSION --firstInstall ${debug} < /dev/tty

lldb -- /var/folders/bb/0tr5gkzx6s9dvb2t67_pfpj80000gn/T//choosenim-0.5.1_macosx_amd64 stable --firstInstall
(lldb) target create "/var/folders/bb/0tr5gkzx6s9dvb2t67_pfpj80000gn/T//choosenim-0.5.1_macosx_amd64"
Current executable set to '/var/folders/bb/0tr5gkzx6s9dvb2t67_pfpj80000gn/T//choosenim-0.5.1_macosx_amd64' (x86_64).
(lldb) settings set -- target.run-args  "stable" "--firstInstall"
(lldb) br s -r raiseEIO
Breakpoint 1: where = choosenim-0.5.1_macosx_amd64`raiseEIO__ZYk14k3sVNZUIjJjtqzFZQ, address = 0x0000000100000970
(lldb) r
Process 34986 launched: '/var/folders/bb/0tr5gkzx6s9dvb2t67_pfpj80000gn/T/choosenim-0.5.1_macosx_amd64' (x86_64)
Process 34986 stopped
* thread #1, queue = 'com.apple.main-thread', stop reason = breakpoint 1.1
    frame #0: 0x0000000100000970 choosenim-0.5.1_macosx_amd64 raiseEIO__ZYk14k3sVNZUIjJjtqzFZQ
choosenim-0.5.1_macosx_amd64`raiseEIO__ZYk14k3sVNZUIjJjtqzFZQ:
->  0x100000970 <+0>: pushq  %rbp
    0x100000971 <+1>: movq   %rsp, %rbp
    0x100000974 <+4>: pushq  %r15
    0x100000976 <+6>: pushq  %r14
(lldb) bt
* thread #1, queue = 'com.apple.main-thread', stop reason = breakpoint 1.1
  * frame #0: 0x0000000100000970 choosenim-0.5.1_macosx_amd64 raiseEIO__ZYk14k3sVNZUIjJjtqzFZQ
    frame #1: 0x0000000100000b59 choosenim-0.5.1_macosx_amd64 checkErr__fU6ZlJAtQ9bre04EDZLdGsA_2 + 201
    frame #2: 0x0000000100000d03 choosenim-0.5.1_macosx_amd64 readLine__FbqDHP9bu7nqCh9c04dnSOxw + 275
    frame #3: 0x00000001000589a9 choosenim-0.5.1_macosx_amd64 execCmdEx__9cTpvDl4v9c9c9aFgpXBZMyDDA + 201
    frame #4: 0x00000001000753a5 choosenim-0.5.1_macosx_amd64 getGccArch__gysFd5ujvW9bK2GKrR6wd5Q + 37
    frame #5: 0x0000000100078df0 choosenim-0.5.1_macosx_amd64 downloadImpl__APUzNJHIRqTLTZCmJ9b374A_2 + 48
    frame #6: 0x00000001000794cc choosenim-0.5.1_macosx_amd64 download__APUzNJHIRqTLTZCmJ9b374A + 444
    frame #7: 0x000000010007bee6 choosenim-0.5.1_macosx_amd64 installVersion__LgWo0VcoCCEa5sgqTkZhNw + 22
    frame #8: 0x000000010007d767 choosenim-0.5.1_macosx_amd64 chooseVersion__SmQmVmFkupfp23z9csm1ITQ + 263
    frame #9: 0x000000010007d7e2 choosenim-0.5.1_macosx_amd64 choose__eOkZxeZJ268InN39bcwFneA_6 + 98
    frame #10: 0x000000010007d8e9 choosenim-0.5.1_macosx_amd64 performAction__eOkZxeZJ268InN39bcwFneA + 201
    frame #11: 0x000000010007e0af choosenim-0.5.1_macosx_amd64 NimMainModule + 975
    frame #12: 0x000000010007e194 choosenim-0.5.1_macosx_amd64 main + 68
    frame #13: 0x00007fffac0ff235 libdyld.dylib start + 1
    frame #14: 0x00007fffac0ff235 libdyld.dylib start + 1

EDIT: this is probably a red herring, caused by nim-lang/Nim#9634

EDIT

after instrumenting the sh file to instead use debug build choosenim-0.5.1_macosx_amd64_debug I get:

Traceback (most recent call last)
/Users/travis/build/dom96/choosenim/src/choosenim.nim(267) choosenim
/Users/travis/build/dom96/choosenim/src/choosenim.nim(248) performAction
/Users/travis/build/dom96/choosenim/src/choosenim.nim(66) choose
/Users/travis/build/dom96/choosenim/src/choosenim.nim(53) chooseVersion
/Users/travis/build/dom96/choosenim/src/choosenim.nim(19) installVersion
/Users/travis/build/dom96/choosenim/src/choosenimpkg/utils.nim(47) extract
/Users/travis/.nimble/pkgs/nimarchive-0.3.5/nimarchive.nim(84) extract
SIGABRT: Abnormal termination.

which means error isn't caught here, which points to your code @genotrance :)

proc extract*(path: string, extractDir: string) =
  display("Extracting", path.extractFilename(), priority = HighPriority)

  try:
    nimarchive.extract(path, extractDir)
  except Exception as exc:
    raise newException(ChooseNimError, "Unable to extract. Error was '$1'." %
                       exc.msg)

nixfreak · 2020-01-21T16:36:25Z

./choosenim-0.5.1_macosx_amd64_debug show [10:35:17]
Traceback (most recent call last)
/Users/travis/build/dom96/choosenim/src/choosenim.nim(266) choosenim
/Users/travis/build/dom96/choosenim/src/choosenimpkg/telemetry.nim(120) loadAnalytics
/Users/travis/.nimble/pkgs/analytics-0.2.0/analytics.nim(63) newAsyncAnalytics
/Users/travis/.choosenim/toolchains/nim-1.0.4/lib/pure/httpclient.nim(534) newAnalyticsRef
/Users/travis/.choosenim/toolchains/nim-1.0.4/lib/pure/httpclient.nim(288) getDefaultSSL
/Users/travis/.choosenim/toolchains/nim-1.0.4/lib/pure/net.nim(543) newContext
SIGBUS: Illegal storage access. (Attempt to read from nil?)

nixfreak · 2020-01-21T16:36:39Z

./choosenim-0.5.1_macosx_amd64_debug devel [10:33:20]
Traceback (most recent call last)
/Users/travis/build/dom96/choosenim/src/choosenim.nim(266) choosenim
/Users/travis/build/dom96/choosenim/src/choosenimpkg/telemetry.nim(120) loadAnalytics
/Users/travis/.nimble/pkgs/analytics-0.2.0/analytics.nim(63) newAsyncAnalytics
/Users/travis/.choosenim/toolchains/nim-1.0.4/lib/pure/httpclient.nim(534) newAnalyticsRef
/Users/travis/.choosenim/toolchains/nim-1.0.4/lib/pure/httpclient.nim(288) getDefaultSSL
/Users/travis/.choosenim/toolchains/nim-1.0.4/lib/pure/net.nim(543) newContext
SIGBUS: Illegal storage access. (Attempt to read from nil?)

nixfreak · 2020-01-27T15:32:33Z

Just tried to install via Curl curl https://nim-lang.org/choosenim/init.sh -sSf | sh
choosenim-init: Downloading choosenim-0.5.1_macosx_amd64
SIGBUS: Illegal storage access. (Attempt to read from nil?)

Is there another way I can update nim to the latest without building ? Should I use brew ?

genotrance · 2020-01-27T15:49:35Z

On OSX, we do not ship official binaries yet, it has to be built even with choosenim. I'm not sure if Nim is in brew or what version it is at either, easiest is to build from source - shouldn't take too long.

nixfreak · 2020-01-27T16:20:16Z

Ok thanks for the fast update

nixfreak · 2020-01-27T18:20:29Z

Not sure if this is relevant or not but I have pasted below the build script using brew on Osx.
brew doesn't have the latest release, after this I will edit the ruby files and build again.

brew info nim [12:03:12]
nim: stable 1.0.4 (bottled), HEAD
Statically typed compiled systems programming language
https://nim-lang.org/
Not installed
From: https://github.com/Homebrew/homebrew-core/blob/master/Formula/nim.rb
==> Options
--HEAD
Install HEAD version
==> Analytics
install: 498 (30 days), 3,006 (90 days), 10,891 (365 days)
install-on-request: 479 (30 days), 2,830 (90 days), 10,010 (365 days)
build-error: 0 (30 days)

brew install nim --HEAD

==> Cloning https://github.com/nim-lang/Nim.git
Cloning into '/Users/aaronm/Library/Caches/Homebrew/nim--git'...
==> Checking out branch devel
Already on 'devel'
Your branch is up to date with 'origin/devel'.
==> Cloning https://github.com/nim-lang/csources.git
Cloning into '/Users/aaronm/Library/Caches/Homebrew/nim--csources--git'...
Checking out files: 100% (10876/10876), done.
==> Checking out branch master
Already on 'master'
Your branch is up to date with 'origin/master'.
==> /bin/sh build.sh
==> bin/nim c -d:release koch
==> ./koch boot -d:release -d:useLinenoise
==> ./koch tools
==> ./koch geninstall
==> /bin/sh install.sh /usr/local/Cellar/nim/HEAD-32f0910
🍺 /usr/local/Cellar/nim/HEAD-32f0910: 436 files, 14.4MB, built in 14 minutes 6 seconds

nim -v [12:18:17]
Nim Compiler Version 1.0.4 [MacOSX: amd64]
Compiled at 2019-11-27
Copyright (c) 2006-2019 by Andreas Rumpf

git hash: c8998c498f5e2a0874846eb31309e1d1630faca6
active boot switches: -d:release

Edited the ruby file for brew -- NOTE you have to uninstall first brew uninstall nim
Didn't work , I did something wrong , just going to build instead.

dom96 · 2020-01-27T23:15:24Z

So this is the line that is crashing: https://github.com/nim-lang/Nim/blob/devel/lib/pure/net.nim#L543

I wonder if some versions of macOS have an OpenSSL which disallows this. @nixfreak what's your macOS version? Can you try the following code and see whether it works for you?

import httpclient
let client = newHttpClient()
echo(client.getContent("https://google.com")

Make sure to compile with -d:ssl.

dom96 · 2020-01-28T21:50:50Z

That's odd and suggests to me that there may be a bug in how choosenim was built.

nixfreak · 2020-01-29T14:37:37Z

Yeah I still can't install via choosnim I had to build nim and now I have 1.1.1 installed.
Is there anyway we can install multiple versions of nim on one system? Sort of of like a virtualenv ? Then I can test quite a bit.

genotrance · 2020-01-31T17:17:30Z

#139 is also similar.

genotrance · 2020-01-31T18:50:39Z

I did some additional testing and was able to reproduce this issue.

My macOS 10.14.6 with clang 11.0.0 has LibreSSL 2.6.5 installed in /usr/lib. That is what I get when I run openssl version. Both libssl.dylib and libcrypto.dylib are linked to libxxx.35.dylib, whatever that version means. I also have 0.9.7, 0.9.8, 41, 42, 43 and 44 in the folder. The Nim openssl wrapper loads libxxx.dylib first so v35 is getting loaded and it all works.

Now, brew has installed two additional versions of openssl in the cellar, 1.0.2s and 1.1.1.d. I tried testing both those versions with export DYLD_LIBRARY_PATH=/usr/local/opt/openssl@1.x/lib, one at a time, and could get the system to crash with 1.1.1.d as reported but it works fine with 1.0.2s.

I don't know why this version of openssl is not working with choosenim but hope someone has some ideas to proceed here.

timotheecour · 2020-01-31T19:00:36Z

@genotrance did you see #122 (comment)

which means error isn't caught here, which points to your code @genotrance :)

there could be more than 1 bug involved here, potentially.

genotrance · 2020-01-31T19:12:13Z

Yes but I focused first on the openssl variation since that's been reported more often.

genotrance · 2020-01-31T20:24:47Z

As suggested by @timotheecour in IRC, I recompiled choosenim with openssl 1.1.1d as the active version using DYLD_LIBRARY_PATH and it compiled fine. However, it crashes in that window just like before.

If I switch to another window using the default libressl version or the openssl version of 1.0.2s, it works again. So it doesn't matter what version of library we build against, only runtime matters.

It appears our Nim openssl wrapper has some bug with the 1.1.1d version of openssl on OSX.

cc @Araq @treeform @krux02 @SolitudeSF

treeform · 2020-01-31T21:26:55Z

I spent a ton of time on openssl crap. My opinion openssl project breaks their API all the time but you are forced to use it, as it's practically part of the os. Just find nim-openssl pairing that works and stick with it. It's very fregile. It's easy to get openssl microversion that is not compatible or just plain buggy.

genotrance · 2020-02-01T05:13:10Z

This is a duplicate of nim-lang/Nim#9419 and can be tracked there. Just replace libpq with libcurl in this case.

dom96 · 2020-02-07T21:18:57Z

This is a duplicate of nim-lang/Nim#9419 and can be tracked there. Just replace libpq with libcurl in this case.

So the root cause is loading libcurl + openssl in the same program (where libcurl loads a different openssl version)? We should start a bug hall of fame just for this :)

Thank you for testing this @genotrance, can you confirm by compiling choosenim without libcurl and see if that fixes the problem? (you can just comment this out to do that: https://github.com/dom96/choosenim/blob/master/src/choosenim.nims#L2).

genotrance · 2020-02-09T04:53:27Z

can you confirm by compiling choosenim without libcurl and see if that fixes the problem?

Just tried this test and it works fine without libcurl. Compile it back in and it crashes again.

genotrance · 2020-02-13T03:21:08Z

As mentioned in the Nim issue, we can fix this quite easily for choosenim.

metasyn · 2020-02-19T04:51:26Z

Nice job ya'll! Been following this just to see what happens after opening it half a year ago

D-Nice · 2020-02-20T02:42:56Z

Issue is closed, but I'm still experiencing it on github actions:

https://github.com/D-Nice/argon2_bind/runs/456797271?check_suite_focus=true

Run curl https://nim-lang.org/choosenim/init.sh -sSf | sh -s -- -y
  curl https://nim-lang.org/choosenim/init.sh -sSf | sh -s -- -y
  shell: /bin/bash -e {0}
choosenim-init: Downloading choosenim-0.5.1_macosx_amd64
    Prompt: Can choosenim record and send anonymised telemetry data? [y/n]
        ... Anonymous aggregate user analytics allow us to prioritise
        ... fixes and features based on how, where and when people use Nim.
        ... For more details see: https://goo.gl/NzUEPf.
SIGBUS: Illegal storage access. (Attempt to read from nil?)
    Answer: Forced Yes
##[error]Process completed with exit code 1.

OT: but especially for CI/headless environments, shouldn't the analytics prompt be opt-out by default, or can a -n flag be passed.

genotrance · 2020-02-20T03:39:43Z

Issue has been fixed in #head but a new release hasn't been cut yet. We are close.

metasyn closed this as completed Jul 12, 2019

dom96 reopened this Dec 13, 2019

haltcase mentioned this issue Jan 18, 2020

Revert "fix: normalize input paths (#37)" haltcase/glob#43

Merged

jiro4989 referenced this issue in haltcase/glob Jan 19, 2020

ci(github): try the setup-nim action instead

ad4e1ea

This was referenced Jan 19, 2020

Dynamic linking genotrance/nimarchive#5

Open

github action CI broken haltcase/glob#44

Closed

dom96 added Bug High Priority labels Jan 26, 2020

jiro4989 mentioned this issue Jan 27, 2020

Is the build failing a red herring? jiro4989/setup-nim-action#3

Closed

This comment has been minimized.

Sign in to view

genotrance mentioned this issue Feb 1, 2020

httpclient -d:ssl and db_postgres incompatible and cause SIGSEGV! (MacOSX) nim-lang/Nim#9419

Open

genotrance mentioned this issue Feb 13, 2020

Fix #122 - openssl crash on osx #178

Merged

genotrance mentioned this issue Feb 13, 2020

Init can't download choosenim #139

Closed

dom96 closed this as completed in 4133e80 Feb 18, 2020

SIGBUS: Illegal storage access. (Attempt to read from nil?) on macOS #122

SIGBUS: Illegal storage access. (Attempt to read from nil?) on macOS #122

Comments

metasyn commented Jun 11, 2019 • edited Loading

dom96 commented Jun 11, 2019

metasyn commented Jun 12, 2019

metasyn commented Jun 12, 2019 • edited Loading

dom96 commented Jun 12, 2019

genotrance commented Jun 13, 2019

metasyn commented Jun 13, 2019

dom96 commented Jun 13, 2019

metasyn commented Jul 12, 2019

Milerius commented Dec 13, 2019

dom96 commented Dec 13, 2019

genotrance commented Jan 11, 2020

dom96 commented Jan 12, 2020

genotrance commented Jan 12, 2020

dom96 commented Jan 12, 2020

genotrance commented Jan 12, 2020

genotrance commented Jan 13, 2020

timotheecour commented Jan 19, 2020 • edited Loading

EDIT

nixfreak commented Jan 21, 2020

nixfreak commented Jan 21, 2020

nixfreak commented Jan 27, 2020 • edited Loading

genotrance commented Jan 27, 2020

nixfreak commented Jan 27, 2020

nixfreak commented Jan 27, 2020 • edited Loading

dom96 commented Jan 27, 2020

This comment has been minimized.

dom96 commented Jan 28, 2020

nixfreak commented Jan 29, 2020 • edited Loading

genotrance commented Jan 31, 2020

genotrance commented Jan 31, 2020

timotheecour commented Jan 31, 2020 • edited Loading

genotrance commented Jan 31, 2020

genotrance commented Jan 31, 2020

treeform commented Jan 31, 2020

genotrance commented Feb 1, 2020

dom96 commented Feb 7, 2020

genotrance commented Feb 9, 2020

genotrance commented Feb 13, 2020

metasyn commented Feb 19, 2020 • edited Loading

D-Nice commented Feb 20, 2020

genotrance commented Feb 20, 2020

metasyn commented Jun 11, 2019 •

edited

Loading

metasyn commented Jun 12, 2019 •

edited

Loading

timotheecour commented Jan 19, 2020 •

edited

Loading

nixfreak commented Jan 27, 2020 •

edited

Loading

nixfreak commented Jan 27, 2020 •

edited

Loading

nixfreak commented Jan 29, 2020 •

edited

Loading

timotheecour commented Jan 31, 2020 •

edited

Loading

metasyn commented Feb 19, 2020 •

edited

Loading