Symbol not found: _node_module_register - during dynamic link with better-sqlite3 #1155

Light-Keeper · 2021-04-29T12:29:29Z

versions and tools invovled

Node 14.16.1, installed by asdf
pkg 5.1.0
better-sqlite3 7.1.15
target - node14-macos-x64

Here is an example that fails - https://github.com/Light-Keeper/minimal-pkg

pkg --target node14-macos-x64 ./index.js - executes well, creates index binary. But when I run it, there is an error:

➜  minimal-pkg git:(main) ./index
dyld: lazy symbol binding failed: Symbol not found: _node_module_register
  Referenced from: /Users/vyanushkevich/Projects/test/minimal-pkg/node_modules/better-sqlite3/build/Release/better_sqlite3.node
  Expected in: flat namespace

dyld: Symbol not found: _node_module_register
  Referenced from: /Users/vyanushkevich/Projects/test/minimal-pkg/node_modules/better-sqlite3/build/Release/better_sqlite3.node
  Expected in: flat namespace

[1]    73829 abort      ./index

According to this output, the .node file has been found. but, it depends on _node_module_register symbol that should be exported from node executable, but is not actually exported from the prebuilt node binary.

Here are exported symbols from the app built with pkg:

nm ./index | wc -l
4025

nm ./index | grep node_module_register # - empty outout

The same for the original node binary:

nm /Users/vyanushkevich/.asdf/installs/nodejs/14.16.1/bin/node | wc -l
72543

nm /Users/vyanushkevich/.asdf/installs/nodejs/14.16.1/bin/node | grep node_module_register
000000010007f520 T _node_module_register

I've tried renaming executable to nodejs and moving .node file next to the executable, but it did not have any effect.

Any ideas on how to overcome this?

The text was updated successfully, but these errors were encountered:

umonaca · 2021-05-01T09:27:38Z

Same here. I think the prebuilt binary for node-v14.16.1-macos-x64 provided by pkg could be broken.

umonaca · 2021-05-01T09:42:13Z

I workaround the bug by reverting pkg to v4.5.1. The old prebuilt node binary fetched-v14.4.0-macos-x64, which is inside `` ~/.pkg-cache/v2.6 works well.

rnreekez · 2021-05-03T18:12:47Z

Ran into this as well with note-fibers. Thanks for opening this issue so know I wasn't alone. Rolling back to 4.5.1 worked for me as well. As an aside, I attempted a manual re-compile with the same result just in case it was a one-off bad pre-compiled build but no luck, not sure what the resolution might be with 14.16.1

robertsLando · 2021-05-04T06:19:16Z

@erossignon any clue?

guymguym · 2021-05-09T15:27:18Z

Reproduced to me too - any idea how to resolve?

$ node -v
v14.16.0
$ pkg --version
5.1.0
$ prebuild-install --version
6.1.2
$ jq .pkg package.json
{
  "outputPath": "build",
  "targets": [
    "macos",
    "linux"
  ],
  "assets": [
    "node_modules/**/*.node",
    "build/**/*.node"
  ]
}

$ pkg . --public
> pkg@5.1.0
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=darwin)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)
prebuild-install WARN install No prebuilt binaries found (target=v14.16.1 runtime=node arch=x64 libc= platform=linux)

$ ./build/noobaa-core-macos
dyld: lazy symbol binding failed: Symbol not found: _napi_module_register
  Referenced from: /var/folders/1s/52g85bgj3wlchqh6szld3fp40000gn/T/f2e40016d01c60e8913da09524e6322533f0a40147a7871226a7f82bd016a877/node.napi.node
  Expected in: flat namespace

dyld: Symbol not found: _napi_module_register
  Referenced from: /var/folders/1s/52g85bgj3wlchqh6szld3fp40000gn/T/f2e40016d01c60e8913da09524e6322533f0a40147a7871226a7f82bd016a877/node.napi.node
  Expected in: flat namespace

Abort trap: 6

Bug: vercel/pkg#1155

justgook · 2021-05-11T07:58:15Z

MacOS 10.15
got same problem when building with 5.1.0 node-gyp example

enter folder
npm install (that builds binary file)
npx pkg@5.1.0 hello.js
got - dyld: lazy symbol binding failed: Symbol not found: _napi_module_register

with npx pkg@4.5.1 - all works as expected

jesec · 2021-05-21T00:47:09Z

This issue has been resolved in 5.2.0. Please let me know if it is still relevant.

konsumer · 2021-07-31T06:27:17Z

With pkg@5.3.1 I get same issue, with webmidi@next and similar errors with node-midi.

I make a simple script like this:

const { WebMidi } = require('webmidi')

function onEnabled () {
  console.log(WebMidi.inputs)
  console.log(WebMidi.outputs)
}

WebMidi
  .enable()
  .then(onEnabled)
  .catch(console.error)

Build runs without error:

npx pkg@latest miditest.cjs

> pkg@5.3.1
> Targets not specified. Assuming:
  node16-linux-x64, node16-macos-x64, node16-win-x64

then I run it and get this:

dyld: lazy symbol binding failed: Symbol not found: _napi_module_register
  Referenced from: /Users/konsumer/Documents/otherdev/miditest/node_modules/jazz-midi/bin/macos64/jazz.node
  Expected in: flat namespace

dyld: Symbol not found: _napi_module_register
  Referenced from: /Users/konsumer/Documents/otherdev/miditest/node_modules/jazz-midi/bin/macos64/jazz.node
  Expected in: flat namespace

[1]    12024 abort      ./dist/miditest-macos

Same issue if I put jazz.node in the same dir.

bd-joseph-luttrell · 2021-08-06T20:50:10Z

I'm still getting same issue with aws-crt lib using pkg@5.3.1

dyld: lazy symbol binding failed: Symbol not found: _napi_module_register
  Referenced from: /redacted/node_modules/aws-crt/dist/bin/darwin-x64/aws-crt-nodejs.node
  Expected in: flat namespace

dyld: Symbol not found: _napi_module_register
  Referenced from: /redacted/node_modules/aws-crt/dist/bin/darwin-x64/aws-crt-nodejs.node
  Expected in: flat namespace

woodfe · 2021-08-12T10:05:29Z

Got the same error:
dyld: lazy symbol binding failed: Symbol not found: _node_module_register
Referenced from: /Users/user/roadster/node_modules/better-sqlite3/build/Release/better_sqlite3.node
Expected in: flat namespace

giladdarshan · 2021-08-14T15:15:59Z

I got the same error using pkg@5.3.1 while building Node.js v16.4.1 from source

dyld: lazy symbol binding failed: Symbol not found: _napi_module_register
  Referenced from: /path/to/nodeFile.node
  Expected in: flat namespace

dyld: Symbol not found: _napi_module_register
  Referenced from: /path/to/nodeFile.node
  Expected in: flat namespace

The issue was caused (at least for me) by pkg enabling the Link Time Optimization flag during configuration, I've removed line 47 from pkg-fetch's build file, ran through the workflow again and was able to run the application without errors.
File location locally for testing is /usr/local/lib/node_modules/pkg/node_modules/pkg-fetch/lib-es5/build.js

man ld -export_dynamic: ``` Preserves all global symbols in main executables during LTO. Without this option, Link Time Optimization is allowed to inline and remove global functions. This option is used when a main executable may load a plug-in which requires certain symbols from the main executable. ``` Bug: vercel/pkg#1155 Signed-off-by: Jesse Chan <jc@linux.com>

borgen12 · 2021-08-30T17:32:57Z

I am also getting this error for two different targets: ["node12-macos-x64", "node14-windows-x64"], the error looks to be getting thrown from my node modules.

maka-io · 2021-09-01T01:47:00Z

I also have been getting this problem with my module using pkg@5.3.1:

dyld: lazy symbol binding failed: Symbol not found: _node_module_register
  Referenced from: /.../node_modules/fibers/bin/darwin-x64-83/fibers.node
  Expected in: flat namespace

dyld: Symbol not found: _node_module_register
  Referenced from: /.../node_modules/fibers/bin/darwin-x64-83/fibers.node
  Expected in: flat namespace

man ld -export_dynamic: ``` Preserves all global symbols in main executables during LTO. Without this option, Link Time Optimization is allowed to inline and remove global functions. This option is used when a main executable may load a plug-in which requires certain symbols from the main executable. ``` Bug: vercel/pkg#1155 Signed-off-by: Jesse Chan <jc@linux.com> PR-URL: #39839 Reviewed-By: Luigi Pinca <luigipinca@gmail.com> Reviewed-By: Anna Henningsen <anna@addaleax.net> Reviewed-By: James M Snell <jasnell@gmail.com>

jesec added a commit to vercel/pkg-fetch that referenced this issue May 10, 2021

build: don't strip global symbols of macOS binaries

09c238d

Bug: vercel/pkg#1155

jesec mentioned this issue May 10, 2021

build: don't strip global symbols of macOS binaries vercel/pkg-fetch#180

Merged

jesec added a commit to vercel/pkg-fetch that referenced this issue May 10, 2021

build: don't strip global symbols of macOS binaries

5d2bc3b

Bug: vercel/pkg#1155

jesec closed this as completed May 21, 2021

jesec mentioned this issue Aug 22, 2021

build: preserves symbols during LTO with macOS linker nodejs/node#39839

Closed

jesec added a commit to vercel/pkg-fetch that referenced this issue Aug 24, 2021

patches: apply nodejs/node#39839 for vercel/pkg#1155

19ddcec

laurentlp mentioned this issue Sep 1, 2021

fix(server): fix macos binary botpress/messaging#165

Merged

jesec mentioned this issue Sep 6, 2021

3.2.3 vercel/pkg-fetch#215

Merged

pdcastro mentioned this issue Jan 4, 2022

Update to pkg 5 balena-io/balena-cli#2436

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Symbol not found: _node_module_register - during dynamic link with better-sqlite3 #1155

Symbol not found: _node_module_register - during dynamic link with better-sqlite3 #1155

Light-Keeper commented Apr 29, 2021 •

edited

Loading

umonaca commented May 1, 2021

umonaca commented May 1, 2021 •

edited

Loading

rnreekez commented May 3, 2021 •

edited

Loading

robertsLando commented May 4, 2021

guymguym commented May 9, 2021

justgook commented May 11, 2021

jesec commented May 21, 2021

konsumer commented Jul 31, 2021 •

edited

Loading

bd-joseph-luttrell commented Aug 6, 2021

woodfe commented Aug 12, 2021

giladdarshan commented Aug 14, 2021

borgen12 commented Aug 30, 2021

maka-io commented Sep 1, 2021 •

edited

Loading

Symbol not found: _node_module_register - during dynamic link with better-sqlite3 #1155

Symbol not found: _node_module_register - during dynamic link with better-sqlite3 #1155

Comments

Light-Keeper commented Apr 29, 2021 • edited Loading

umonaca commented May 1, 2021

umonaca commented May 1, 2021 • edited Loading

rnreekez commented May 3, 2021 • edited Loading

robertsLando commented May 4, 2021

guymguym commented May 9, 2021

justgook commented May 11, 2021

jesec commented May 21, 2021

konsumer commented Jul 31, 2021 • edited Loading

bd-joseph-luttrell commented Aug 6, 2021

woodfe commented Aug 12, 2021

giladdarshan commented Aug 14, 2021

borgen12 commented Aug 30, 2021

maka-io commented Sep 1, 2021 • edited Loading

Light-Keeper commented Apr 29, 2021 •

edited

Loading

umonaca commented May 1, 2021 •

edited

Loading

rnreekez commented May 3, 2021 •

edited

Loading

konsumer commented Jul 31, 2021 •

edited

Loading

maka-io commented Sep 1, 2021 •

edited

Loading