🐛 libc++abi: terminating with uncaught exception of type facebook::jsi::JSError: Exception in HostFunction: Javascript worklet error #1307

QSuraj · 2022-10-27T03:52:11Z

What were you trying to do?

Using custom frame processor.

Created this new issue since the old one was closed.

Package details -

"react-native": "0.69.0",
"react-native-reanimated": "2.10.0",
"react-native-vision-camera": "2.14.1",

Reproduceable Code

QFrameProcessor.js


// eslint-disable-next-line import/no-duplicates
import 'react-native-reanimated';
import { Camera, useCameraDevices, useFrameProcessor } from 'react-native-vision-camera';
// eslint-disable-next-line import/no-duplicates
import React from 'react';

const processFrame = ( frame ) => {
  'worklet';

  // eslint-disable-next-line no-undef
  return __processFrame( frame );
};

const QFrameProcessor = ( props ) => {
  const devices = useCameraDevices( 'wide-angle-camera' );
  const device = devices.back;

  const frameProcessor = useFrameProcessor( ( frame ) => {
    'worklet';

    const data = processFrame( frame );
    console.log( 'data', data );
  }, [] );

  if ( device === undefined || !frameProcessor ) {
    return null;
  }

  return (
    <Camera
      isActive
      style={props.style}
      device={device}
      frameProcessor={frameProcessor}
      frameProcessorFps={1} />
  );
};

export default React.memo( QFrameProcessor );

QFrameProcessorPlugin.m

#import <VisionCamera/FrameProcessorPlugin.h>
#import <VisionCamera/Frame.h>

@interface QFrameProcessorPlugin : NSObject
@end

@implementation QFrameProcessorPlugin

static inline id processFrame(Frame* frame, NSArray* args) {
  CMSampleBufferRef buffer = frame.buffer;
  UIImageOrientation orientation = frame.orientation;
  // code goes here
  return @[];
}

VISION_EXPORT_FRAME_PROCESSOR(processFrame)

@end

Ideally the frame processor should have started sending me an empty array to the console.log

What happened instead?

The following error was thrown in Xcode console and the app crashed.

Relevant log output

2022-10-27 09:36:48.545198+0530 quizizz_game_v3_app[11942:1108041] [native] VisionCamera.didSetProps(_:): Updating 10 prop(s)...
2022-10-27 09:36:48.545253+0530 quizizz_game_v3_app[11942:1108363] [native] VisionCamera.configureCaptureSession(): Configuring Session...
2022-10-27 09:36:48.545262+0530 quizizz_game_v3_app[11942:1108363] [native] VisionCamera.configureCaptureSession(): Initializing Camera with device com.apple.avfoundation.avcapturedevice.built-in_video:6...
2022-10-27 09:36:48.545273+0530 quizizz_game_v3_app[11942:1108363] [native] VisionCamera.configureCaptureSession(): Adding Video input...
2022-10-27 09:36:48.545556+0530 quizizz_game_v3_app[11942:1108312] FrameProcessorBindings: Setting new frame processor...
2022-10-27 09:36:48.545578+0530 quizizz_game_v3_app[11942:1108312] FrameProcessorBindings: Adapting Shareable value from function (conversion to worklet)...
2022-10-27 09:36:48.545708+0530 quizizz_game_v3_app[11942:1108312] FrameProcessorBindings: Successfully created worklet!
2022-10-27 09:36:48.545754+0530 quizizz_game_v3_app[11942:1108390] FrameProcessorBindings: Converting worklet to Objective-C callback...
2022-10-27 09:36:48.546358+0530 quizizz_game_v3_app[11942:1108390] FrameProcessorBindings: Frame processor set!
2022-10-27 09:36:48.589822+0530 quizizz_game_v3_app[11942:1108363] [native] VisionCamera.configureCaptureSession(): Adding Video Data output...
2022-10-27 09:36:48.590355+0530 quizizz_game_v3_app[11942:1108363] [native] VisionCamera.invokeOnInitialized(): Camera initialized!
2022-10-27 09:36:48.590399+0530 quizizz_game_v3_app[11942:1108363] [native] VisionCamera.configureCaptureSession(): Session successfully configured!
2022-10-27 09:36:48.590872+0530 quizizz_game_v3_app[11942:1108363] [native] VisionCamera.configureFormat(): Configuring Format...
2022-10-27 09:36:48.590877+0530 quizizz_game_v3_app[11942:1108363] [native] VisionCamera.configureDevice(): Configuring Device...
2022-10-27 09:36:48.590905+0530 quizizz_game_v3_app[11942:1108363] [native] VisionCamera.configureDevice(): Device successfully configured!
2022-10-27 09:36:48.591010+0530 quizizz_game_v3_app[11942:1108363] [native] VisionCamera.didSetProps(_:): Starting Session...
2022-10-27 09:36:48.997963+0530 quizizz_game_v3_app[11942:1108363] [native] VisionCamera.didSetProps(_:): Started Session!
libc++abi: terminating with uncaught exception of type facebook::jsi::JSError: Exception in HostFunction: Javascript worklet error

Error: Javascript worklet error
    at _f (native)

Error: Exception in HostFunction: Javascript worklet error

Error: Javascript worklet error
    at _f (native)
    at _f (native)
terminating with uncaught exception of type facebook::jsi::JSError: Exception in HostFunction: Javascript worklet error

Error: Javascript worklet error
    at _f (native)

Error: Exception in HostFunction: Javascript worklet error

Error: Javascript worklet error
    at _f (native)
    at _f (native)

Device

iPhone 14 ( iOS 16.1 )

VisionCamera Version

2.14.1

Additional information

I am using Expo
I have read the Troubleshooting Guide
I agree to follow this project's Code of Conduct
I searched for similar issues in this repository and found none.

The patch to fix Xcode 14 was already applied, this occurs even after adding that patch.
Reference to the patch - #1244 (comment)

The text was updated successfully, but these errors were encountered:

QSuraj · 2022-10-27T05:41:18Z

Finally figured out the issue.

I was using Vision Camera Plugin Builder CLI as suggested in the docs to build the custom frame processor which created the frame processor in the separate directory called QFrameProcessor and with in that QFrameProcessor.m file was added.

This should not happen.

QFrameProcessor.m file should be directly added to the root directory of the project.

All thanks vision-camera-plugin-builder I was stuck with this.

@mrousavy

mrousavy · 2022-10-27T08:29:55Z

Hey! That's a bug in the CLI then, would be awesome if you could send a PR to them and fix that :)
cc @mateusz1913

mateusz1913 · 2022-10-27T12:23:57Z

@QSuraj ~~could you submit a bug issue in vision-camera-plugin-builder repo? Please include a minimal reproduction repo with 2 vision camera plugins - one generated with CLI & one created manually in XCode~~ fixed

mateusz1913 · 2022-10-27T17:28:17Z

@QSuraj This is fixed with mateusz1913/vision-camera-plugin-builder#24 and available with vision-camera-plugin-builder v0.2.0 🚀 - if you want to check, make sure that npx didn't cache older version of CLI on your machine

QSuraj · 2022-10-28T03:14:53Z

Receiving following crash when I run npx vision-camera-plugin-builder ios

npm ERR! cb.apply is not a function

npm ERR! A complete log of this run can be found in:
npm ERR!     <directory>/.npm/_logs/2022-10-28T03_11_05_574Z-debug.log
Install for [ 'vision-camera-plugin-builder@latest' ] failed with code 1

Here is log.

0 info it worked if it ends with ok
1 verbose cli [
1 verbose cli   '<directory>/.nvm/versions/node/v14.17.5/bin/node',
1 verbose cli   '<directory>/.nvm/versions/node/v14.17.5/lib/node_modules/npx/node_modules/npm/bin/npm-cli.js',
1 verbose cli   'install',
1 verbose cli   'vision-camera-plugin-builder@latest',
1 verbose cli   '--global',
1 verbose cli   '--prefix',
1 verbose cli   '<directory>/.npm/_npx/73253',
1 verbose cli   '--loglevel',
1 verbose cli   'error',
1 verbose cli   '--json'
1 verbose cli ]
2 info using npm@5.1.0
3 info using node@v14.17.5
4 verbose npm-session e0aa96245e8dd287
5 silly install loadCurrentTree
6 silly install readGlobalPackageData
7 http fetch GET 200 https://registry.npmjs.org/vision-camera-plugin-builder 29ms (from cache)
8 silly pacote tag manifest for vision-camera-plugin-builder@latest fetched in 46ms
9 verbose stack TypeError: cb.apply is not a function
9 verbose stack     at <directory>.nvm/versions/node/v14.17.5/lib/node_modules/npx/node_modules/npm/node_modules/graceful-fs/polyfills.js:287:18
9 verbose stack     at FSReqCallback.oncomplete (fs.js:193:5)
10 verbose cwd <path-to-project>
11 verbose Darwin 21.6.0
12 verbose argv "<directory>/.nvm/versions/node/v14.17.5/bin/node" "<directory>/.nvm/versions/node/v14.17.5/lib/node_modules/npx/node_modules/npm/bin/npm-cli.js" "install" "vision-camera-plugin-builder@latest" "--global" "--prefix" "<directory>/.npm/_npx/73253" "--loglevel" "error" "--json"
13 verbose node v14.17.5
14 verbose npm  v5.1.0
15 error cb.apply is not a function
16 verbose exit [ 1, true ]

nzmsyhrl · 2022-10-28T03:22:07Z

For me, it doesn't give any error but it didn't detect the QR code

mateusz1913 · 2022-10-28T07:38:25Z

@QSuraj let's move discussion to the vision-camera-plugin-builder repo - issue 23

@mrousavy could you close and lock the issue?

lexer · 2022-10-31T05:07:59Z

@mateusz1913 @QSuraj I have the same issue.

I'm using:

   "react-native-vision-camera": "2.15.1",
   "vision-camera-code-scanner": "0.2.0"

Node version: v18.8.0

lexer · 2022-10-31T05:41:09Z

My issue got fixed with this: #1308

QSuraj · 2023-09-20T08:12:46Z

Ya, that did fix the issue for me but after Xcode 15 we can't use +(void)load for swift files. Which was the fix in #1308

Now it throws the error reported here because of the above change - #1802

@lexer

mrousavy · 2023-09-20T11:21:07Z

So Xcode 13 is static initialize, Xcode 14 is +load, and Xcode 15 is static initialize again? 🤯

mrousavy · 2023-09-20T11:21:28Z

@QSuraj does it work if you revert the change in #1308 for you on Xcode 15?

QSuraj · 2023-09-20T13:26:45Z

Yes, it does help with the build being successful but vision-camera-code-scanner crashes the moment the frameProcessor starts which is using VISION_EXPORT_SWIFT_FRAME_PROCESSOR.

libc++abi: terminating due to uncaught exception of type facebook::jsi::JSError: Exception in HostFunction: <unknown>

Error: Exception in HostFunction: <unknown>
    at _f (native)

@mrousavy

vincicat · 2023-09-20T13:31:22Z

@QSuraj does it work if you revert the change in #1308 for you on Xcode 15?

reverted, the initial app crash avoided, but later the app caught an error when the camera calling the frame processor (with https://github.com/rodgomesc/vision-camera-code-scanner , @0.2.0):

Property '__scanCodes' doesn't exist

ReferenceError: Property '__scanCodes' doesn't exist
at scanBarcodes ([PROJECT PATH]/node_modules/vision-camera-code-scanner/src/index.ts (300:7):1:52)
at scanBarcodes (native)
at _f ([PROJECT PATH]/src/components/QRCodeScanner.js [REDACTED])
at _f (native)
at _f ([PROJECT PATH]/node_modules/react-native-vision-camera/src/hooks/useFrameProcessor.ts (28:21):1:425)
at _f (native)

note: camera still running but the error appears whenever it calls the frame processor

yedi97 · 2023-09-22T03:43:43Z

@QSuraj does it work if you revert the change in #1308 for you on Xcode 15?

reverted, the initial app crash avoided, but later the app caught an error when the camera calling the frame processor (with https://github.com/rodgomesc/vision-camera-code-scanner , @0.2.0):
Property '__scanCodes' doesn't exist

ReferenceError: Property '__scanCodes' doesn't exist
at scanBarcodes ([PROJECT PATH]/node_modules/vision-camera-code-scanner/src/index.ts (300:7):1:52)
at scanBarcodes (native)
at _f ([PROJECT PATH]/src/components/QRCodeScanner.js [REDACTED])
at _f (native)
at _f ([PROJECT PATH]/node_modules/react-native-vision-camera/src/hooks/useFrameProcessor.ts (28:21):1:425)
at _f (native)
note: camera still running but the error appears whenever it calls the frame processor

Same issue

QSuraj · 2023-09-22T11:18:24Z

Finally figured out the issue. After reverting back from #1308 we need to add @interface objc_name (FrameProcessorPlugin) <FrameProcessorPluginBase> previously it was just @interface objc_name (FrameProcessorPlugin) .

#define VISION_EXPORT_SWIFT_FRAME_PROCESSOR(name, objc_name)                        \
objc_name : NSObject<FrameProcessorPluginBase>                                      \
@end                                                                                \
                                                                                    \
@interface objc_name (FrameProcessorPlugin) <FrameProcessorPluginBase>              \
@end                                                                                \
@implementation objc_name (FrameProcessorPlugin)                                    \
                                                                                    \
__attribute__((constructor)) static void VISION_CONCAT(initialize_, objc_name)()    \
{                                                                                   \
  [FrameProcessorPluginRegistry addFrameProcessorPlugin:@"__" @ #name callback:^id(Frame* frame, NSArray<id>* args) {    \
    return [objc_name callback:frame withArgs:args];                               \
  }];                                                                               \
}

@mrousavy we need to make the above change for all the frame processors based on swift to work.

joren-vos-aca · 2023-09-22T12:17:36Z

Finally figured out the issue. After reverting back from #1308 we need to add @interface objc_name (FrameProcessorPlugin) <FrameProcessorPluginBase> previously it was just @interface objc_name (FrameProcessorPlugin) .

@mrousavy we need to make the above change for all the frame processors based on swift to work.

I can confirm that this fixes the problem!

degeloper34 · 2023-09-22T12:53:00Z

Finally figured out the issue. After reverting back from #1308 we need to add @interface objc_name (FrameProcessorPlugin) <FrameProcessorPluginBase> previously it was just @interface objc_name (FrameProcessorPlugin) .

#define VISION_EXPORT_SWIFT_FRAME_PROCESSOR(name, objc_name)                        \
objc_name : NSObject<FrameProcessorPluginBase>                                      \
@end                                                                                \
                                                                                    \
@interface objc_name (FrameProcessorPlugin) <FrameProcessorPluginBase>              \
@end                                                                                \
@implementation objc_name (FrameProcessorPlugin)                                    \
                                                                                    \
__attribute__((constructor)) static void VISION_CONCAT(initialize_, objc_name)()    \
{                                                                                   \
  [FrameProcessorPluginRegistry addFrameProcessorPlugin:@"__" @ #name callback:^id(Frame* frame, NSArray<id>* args) {    \
    return [objc_name callback:frame withArgs:args];                               \
  }];                                                                               \
}

@mrousavy we need to make the above change for all the frame processors based on swift to work.

This fix solves the crash during app launch, thanks!

medonja · 2023-09-26T08:58:02Z

I hope this fix will soon be released :)

vogdev · 2023-09-29T23:59:53Z

same

shilpa12233 · 2023-10-07T02:51:01Z

My app runs fine on simulator, RN 0.68.2 but crashes in react core pod RCTCxxBridge file - at _reactInstance.reset(new Instance); when I try running on device. iOS - 17, iphone 15, xcode 15

carlgrob5171989 · 2023-10-09T14:59:42Z

@vincicat
Did you resolve it?

DarkMatter513 · 2023-10-12T20:32:06Z

when is this being released in the react-native-vision camera? this is not added to the 2.16.2 please add a commit with this patch.

QSuraj added the 🐛 bug Something isn't working label Oct 27, 2022

QSuraj closed this as completed Oct 27, 2022

mateusz1913 mentioned this issue Oct 27, 2022

Crash when generating iOS plugin mateusz1913/vision-camera-plugin-builder#23

Closed

4 tasks

QSuraj reopened this Oct 28, 2022

This was referenced Sep 20, 2023

[V2] iOS - App Crashes at Launch when built with Xcode 15 #1802

Closed

Crashes on startup on Xcode 15 rodgomesc/vision-camera-code-scanner#161

Closed

QSuraj closed this as completed Sep 22, 2023

QSuraj mentioned this issue Sep 24, 2023

Can not use react-native-vision-camera frameProcessor to scan QR codes 🐛 #1833

Closed

5 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

🐛 libc++abi: terminating with uncaught exception of type facebook::jsi::JSError: Exception in HostFunction: Javascript worklet error #1307

🐛 libc++abi: terminating with uncaught exception of type facebook::jsi::JSError: Exception in HostFunction: Javascript worklet error #1307

QSuraj commented Oct 27, 2022 •

edited

Loading

QSuraj commented Oct 27, 2022 •

edited

Loading

mrousavy commented Oct 27, 2022

mateusz1913 commented Oct 27, 2022 •

edited

Loading

mateusz1913 commented Oct 27, 2022

QSuraj commented Oct 28, 2022

nzmsyhrl commented Oct 28, 2022

mateusz1913 commented Oct 28, 2022 •

edited

Loading

lexer commented Oct 31, 2022 •

edited

Loading

lexer commented Oct 31, 2022

QSuraj commented Sep 20, 2023

mrousavy commented Sep 20, 2023

mrousavy commented Sep 20, 2023

QSuraj commented Sep 20, 2023 •

edited

Loading

vincicat commented Sep 20, 2023

yedi97 commented Sep 22, 2023

QSuraj commented Sep 22, 2023

joren-vos-aca commented Sep 22, 2023

degeloper34 commented Sep 22, 2023

medonja commented Sep 26, 2023

vogdev commented Sep 29, 2023

shilpa12233 commented Oct 7, 2023

carlgrob5171989 commented Oct 9, 2023 •

edited

Loading

DarkMatter513 commented Oct 12, 2023

🐛 libc++abi: terminating with uncaught exception of type facebook::jsi::JSError: Exception in HostFunction: Javascript worklet error #1307

🐛 libc++abi: terminating with uncaught exception of type facebook::jsi::JSError: Exception in HostFunction: Javascript worklet error #1307

Comments

QSuraj commented Oct 27, 2022 • edited Loading

What were you trying to do?

Reproduceable Code

What happened instead?

Relevant log output

Device

VisionCamera Version

Additional information

QSuraj commented Oct 27, 2022 • edited Loading

mrousavy commented Oct 27, 2022

mateusz1913 commented Oct 27, 2022 • edited Loading

mateusz1913 commented Oct 27, 2022

QSuraj commented Oct 28, 2022

nzmsyhrl commented Oct 28, 2022

mateusz1913 commented Oct 28, 2022 • edited Loading

lexer commented Oct 31, 2022 • edited Loading

lexer commented Oct 31, 2022

QSuraj commented Sep 20, 2023

mrousavy commented Sep 20, 2023

mrousavy commented Sep 20, 2023

QSuraj commented Sep 20, 2023 • edited Loading

vincicat commented Sep 20, 2023

yedi97 commented Sep 22, 2023

QSuraj commented Sep 22, 2023

joren-vos-aca commented Sep 22, 2023

degeloper34 commented Sep 22, 2023

medonja commented Sep 26, 2023

vogdev commented Sep 29, 2023

shilpa12233 commented Oct 7, 2023

carlgrob5171989 commented Oct 9, 2023 • edited Loading

DarkMatter513 commented Oct 12, 2023

QSuraj commented Oct 27, 2022 •

edited

Loading

QSuraj commented Oct 27, 2022 •

edited

Loading

mateusz1913 commented Oct 27, 2022 •

edited

Loading

mateusz1913 commented Oct 28, 2022 •

edited

Loading

lexer commented Oct 31, 2022 •

edited

Loading

QSuraj commented Sep 20, 2023 •

edited

Loading

carlgrob5171989 commented Oct 9, 2023 •

edited

Loading