Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Source MSSQL: converter decimal and money datatype #15780

Closed
duytp opened this issue Aug 19, 2022 · 1 comment
Closed

Source MSSQL: converter decimal and money datatype #15780

duytp opened this issue Aug 19, 2022 · 1 comment
Assignees
Labels
area/connectors Connector related issues community connectors/source/mssql team/db-dw-sources Backlog for Database and Data Warehouse Sources team type/bug Something isn't working

Comments

@duytp
Copy link

duytp commented Aug 19, 2022

Environment

  • Airbyte version: example is 0.40.0-alpha
  • OS Version / Instance: Ubuntu 20.04
  • Deployment: Docker
  • Source Connector and version: airbyte/source-mssql:0.4.16
  • Destination Connector and version: airbyte/destination-s3:0.3.13
  • Step where error happened: Sync from scratch (using CDC, SNAPSHOT)

Current Behavior

Replication from MSSQL to S3 from scratch.

Caused by: org.apache.avro.AvroTypeException: Could not evaluate union, field xxx is expected to be one of these: NULL, DOUBLE. If this is a complex type, check if offending field (path: TotalAmount) adheres to schema: 0.00

Expected Behavior

Cannot init the parquet file in S3

Logs

logs-32795.txt

Steps to Reproduce

  1. Source: MSSQL
  2. Destination: S3 (parquet files)
  3. CDC & Snapshot

Are you willing to submit a PR?

Refer by this pull request: #14449
@gsmith-schlesinger also mentions this before

@duytp duytp added needs-triage type/bug Something isn't working labels Aug 19, 2022
@sajarin sajarin added area/connectors Connector related issues team/databases and removed needs-triage team/tse Technical Support Engineers autoteam labels Aug 22, 2022
@sajarin sajarin changed the title MSSQL Converter - Decimal, Money DataType Source MSSQL Converter - Decimal, Money DataType Aug 22, 2022
@grishick grishick added the team/db-dw-sources Backlog for Database and Data Warehouse Sources team label Sep 27, 2022
@marcosmarxm marcosmarxm changed the title Source MSSQL Converter - Decimal, Money DataType Source MSSQL: converter Decimal, Money DataType Nov 30, 2022
@marcosmarxm marcosmarxm changed the title Source MSSQL: converter Decimal, Money DataType Source MSSQL: converter decimal and money datatype Nov 30, 2022
@xiaohansong
Copy link
Contributor

looks like we have supported this already. From my logs:


2023-12-20 22:11:02 destination > INFO i.a.i.d.e.l.FirstNLogger(log):27 [2023-12-20T22:10:57.803Z] Types #0001: {"id":"1","money":20.07}
2023-12-20 22:11:02 destination > INFO i.a.i.d.e.l.FirstNLogger(log):27 [2023-12-20T22:10:57.803Z] Types #0002: {"id":"1","geometry":"LINESTRING(100 100, 20 180, 180 180)"}
2023-12-20 22:11:02 destination > INFO i.a.i.d.e.l.FirstNLogger(log):27 [2023-12-20T22:10:57.803Z] Types #0003: {"id":"2","geography":"LINESTRING(-122.36 47.656, -122.343 47.656)"}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues community connectors/source/mssql team/db-dw-sources Backlog for Database and Data Warehouse Sources team type/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

6 participants