MacOS ONNX runtime workaround libc++abi: terminating due to uncaught exception of type std::__1:system_error: mutex lock failed: Invalid argument

[coffeedome]

System Info

MacOS M1 (ARM)
Node: 23.7.0

Environment/Platform

• Website/web-app
• Browser extension
• Server-side (e.g., Node.js, Deno, Bun)
• Desktop app (e.g., Electron)
• Other (e.g., VSCode extension)

Description

This is related to microsoft/onnxruntime#24579 causing issues on Mac. I am using all-MiniLM-L6-v2 but getting "libc++abi: terminating due to uncaught exception of type std::__1:system_error: mutex lock failed: Invalid argument". Seems like an ONNX runtime 1.21.0 critical bug.

My question is what can we do as a temporary workaround?

Reproduction

From MacOS (M1) and node runtime:

import { HuggingFaceTransformersEmbeddings } from "@langchain/community/embeddings/huggingface_transformers";

const model = new HuggingFaceTransformersEmbeddings({
  model: "Xenova/all-MiniLM-L6-v2",
});

/* Embed queries */
const res = await model.embedQuery(
  "What would be a good company name for a company that makes colorful socks?"
);
console.log({ res });
/* Embed documents */
const documentRes = await model.embedDocuments(["Hello world", "Bye bye"]);
console.log({ documentRes });

when embedQuery runs it generates the embeddings but ends with the error. Looking for temporary workaround while ONNX team submits fix

[xenova]

Hi there 👋 Yes you are correct, I've also ran into this issue before: microsoft/onnxruntime#24579 (comment). I'm not familiar with any workarounds at the moment, but it seems to only happen at the end of the process (so, shouldn't impact usage too much).

[kmturley]

Getting the same error on:

• MacOS 13.7.8
• 2.9 GHz Quad-Core Intel Core i7
• Node.js 20.11.0

libc++abi: terminating due to uncaught exception of type std::__1::system_error: mutex lock failed: Invalid argument

I cleared my node_modules and reinstalled using npm install and it managed to output the prompt before erroring.

[xenova]

This issue should be closed by microsoft/onnxruntime#26204. I will add it to the V4 PR which will use that PR 👍