Skip to content

Add support for Apache.Arrow.Types.Decimal128Type #7082

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
piyushdubey opened this issue Mar 19, 2024 · 0 comments · May be fixed by #7094
Open

Add support for Apache.Arrow.Types.Decimal128Type #7082

piyushdubey opened this issue Mar 19, 2024 · 0 comments · May be fixed by #7094
Labels
Microsoft.Data.Analysis All DataFrame related issues and PRs untriaged New issue has not been triaged

Comments

@piyushdubey
Copy link

piyushdubey commented Mar 19, 2024 •
edited
Loading

System Information (please complete the following information):

  • Window 11
  • Microsoft.Data.Analysis v0.21.1
  • .Net Framework 4.7.2

Describe the bug
I am getting the below exception

Unhandled exception. System.NotImplementedException: decimal128
at Microsoft.Data.Analysis.DataFrame.AppendDataFrameColumnFromArrowArray(Field field, IArrowArray arrowArray, DataFrame ret, String fieldNamePrefix)
at Microsoft.Data.Analysis.DataFrame.FromArrowRecordBatch(RecordBatch recordBatch)
at Program.

To Reproduce
Take a .arrow file with one column of type Apache.Arrow.Types.Decimal128Type
var dataframe = DataFrame.FromArrowRecordBatch(recordBatch);
It will throw above exception

Expected behavior
The record batch should transform to DataFrame with appropriate type to handle decimal128
@dotnet-policy-service dotnet-policy-service bot added the untriaged New issue has not been triaged label Mar 19, 2024
@piyushdubey piyushdubey changed the title Add support for Apache.Arrow.Types.Decimal128Type Add support for Apache.Arrow.Types.Decimal128 Mar 20, 2024
@piyushdubey piyushdubey changed the title Add support for Apache.Arrow.Types.Decimal128 Add support for Apache.Arrow.Types.Decimal128Type Mar 20, 2024
@piyushdubey piyushdubey linked a pull request Mar 21, 2024 that will close this issue
Open
@luisquintanilla luisquintanilla added the Microsoft.Data.Analysis All DataFrame related issues and PRs label Aug 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Microsoft.Data.Analysis All DataFrame related issues and PRs untriaged New issue has not been triaged
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add support for Apache.Arrow.Types.Decimal128Type piyushdubey/machinelearning
2 participants
@piyushdubey @luisquintanilla