Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Shopify -> BigQuery Denormalized fails with : java.util.regex.PatternSyntaxException: Stack overflow during pattern compilation near index 10 #4778

Closed
derekybainbridge opened this issue Jul 16, 2021 · 2 comments · Fixed by #5813

Comments

@derekybainbridge
Copy link

Enviroment

  • Airbyte version: example is 0.27.3-alpha
  • OS Version / Instance: , GCP e2.medium Debian 10 GNU (Buster) - as in the insructions
  • Deployment: Docker
  • Source Connector and version: Shopify
  • Destination Connector and version: BigQuery (denormalized typed struct) - couldnt find version
  • Severity: High
  • Step where error happened: Sync job

Current Behavior

Shopify orders table does not sync to bigQuery and the job hangs.

it tries to sync customers then this exception is thrown, after that orders starts but just hangs..

Expected Behavior

Shopify orders and customers table should sync to bigQuery

Logs

Uploaded logs with the stack trace, here is a bit though:

2021-07-16 02:38:17 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Starting syncing SourceShopify
2021-07-16 02:38:17 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: customers
2021-07-16 02:38:18 ERROR () LineGobbler(voidCall):85 - Exception in thread "main" java.util.regex.PatternSyntaxException: Stack overflow during pattern compilation near index 10
2021-07-16 02:38:18 ERROR () LineGobbler(voidCall):85 - [^\p{Alnum}_]
2021-07-16 02:38:18 ERROR () LineGobbler(voidCall):85 - ^
2021-07-16 02:38:18 ERROR () LineGobbler(voidCall):85 - at java.base/java.util.regex.Pattern.error(Pattern.java:2029)
2021-07-16 02:38:18 ERROR () LineGobbler(voidCall):85 - at java.base/java.util.regex.Pattern.(Pattern.java:1433)
2021-07-16 02:38:18 ERROR () LineGobbler(voidCall):85 - at java.base/java.util.regex.Pattern.compile(Pattern.java:1070)
2021-07-16 02:38:18 ERROR () LineGobbler(voidCall):85 - at java.base/java.lang.String.replaceAll(String.java:2141)
....

LOG

logs-7-0.txt
logs uploaded

Steps to Reproduce

  1. Set up a shopify Source
  2. Set up a GCP Destination (Denormalized)
  3. Select just the Orders and customers table. (Full and incremental both have the issue)
  4. start a sync job, it will hang

when I use the GCP destination (not the denormalized) the issue does not occur.

Are you willing to submit a PR?

Sure
logs-7-0.txt

@derekybainbridge derekybainbridge added the type/bug Something isn't working label Jul 16, 2021
@LuisCebrian
Copy link

I had the same issue connecting a mongo DB source to the BigQuery (denormalized typed struct) connector. In my case:

  • Airbyte version: 0.27.2-alpha
  • OS Version / Instance: , GCP e2.medium Debian 10 GNU (Buster) - as in the insructions
  • Source Connector and version: MongoDB 0.3.2
    Destination Connector and version: BigQuery (denormalized typed struct) - 0.1.0
    Severity: High
    Step where error happened: Sync job

@sherifnada sherifnada added area/connectors Connector related issues lang/java labels Aug 13, 2021
@etsybaev etsybaev self-assigned this Sep 3, 2021
@etsybaev
Copy link
Contributor

etsybaev commented Sep 3, 2021

Seems to be related to #5486
And must be fixed as part of #5813

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment