Skip to content

Implement read of Arrow TimeStamp types #515

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
fb64 opened this issue Nov 24, 2023 · 0 comments
Closed

Implement read of Arrow TimeStamp types #515

fb64 opened this issue Nov 24, 2023 · 0 comments
Labels
enhancement New feature or request good first issue Good issues to pick-up for newcomers
Milestone
0.13.+

Comments

@fb64
Copy link
Contributor

fb64 commented Nov 24, 2023 •
edited
Loading

Reading TimeStamp types from Arrow format is not implemented, it could be useful to read them as a LocalDateTime.
TimeStampVector are currently not supported

Exception in thread "main" kotlin.NotImplementedError: reading from org.apache.arrow.vector.TimeStampNanoVector is not implemented
	at org.jetbrains.kotlinx.dataframe.io.ArrowReadingImplKt.readField(arrowReadingImpl.kt:207)
	at org.jetbrains.kotlinx.dataframe.io.ArrowReadingImplKt.readArrowFeatherImpl(arrowReadingImpl.kt:251)
	at org.jetbrains.kotlinx.dataframe.io.ArrowReadingKt.readArrowFeather(arrowReading.kt:62)
	at org.jetbrains.kotlinx.dataframe.io.ArrowReadingKt.readArrowFeather$default(arrowReading.kt:58)
	at org.jetbrains.kotlinx.dataframe.io.ArrowReadingKt.readArrowFeather(arrowReading.kt:126)
	at org.jetbrains.kotlinx.dataframe.io.ArrowReadingKt.readArrowFeather(arrowReading.kt:170)
	at org.jetbrains.kotlinx.dataframe.io.ArrowReadingKt.readArrowFeather$default(arrowReading.kt:164)
        ....
fb64 added a commit to fb64/dataframe that referenced this issue Nov 24, 2023
@fb64
Add read of Arrow TimeStamp without timezone as LocalDatetime Kotlin#515
7e44783
@Jolanrensen Jolanrensen added good first issue Good issues to pick-up for newcomers enhancement New feature or request labels Nov 27, 2023
@Jolanrensen Jolanrensen added this to the 0.13.0 milestone Nov 27, 2023
fb64 added a commit to fb64/dataframe that referenced this issue Nov 27, 2023
@fb64
Add read of Arrow TimeStamp without timezone as LocalDatetime Kotlin#515
cd6e5fc
fb64 added a commit to fb64/dataframe that referenced this issue Nov 30, 2023
@fb64
Add read of Arrow TimeStamp without timezone as LocalDatetime Kotlin#515
d4ddc73
fb64 added a commit to fb64/dataframe that referenced this issue Nov 30, 2023
@fb64
Add read of Arrow TimeStamp without timezone as LocalDatetime Kotlin#515
9d3e4e1
fb64 added a commit to fb64/dataframe that referenced this issue Nov 30, 2023
@fb64
Add read of Arrow TimeStamp without timezone as LocalDatetime Kotlin#515
e36b006
Jolanrensen added a commit that referenced this issue Dec 1, 2023
@Jolanrensen
Merge pull request #516 from fb64/master
63fdb46 
Add read of Arrow TimeStamp without timezone as LocalDatetime #515
@fb64 fb64 mentioned this issue Dec 1, 2023
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request good first issue Good issues to pick-up for newcomers
Projects
None yet
Milestone
0.13.+
Development

No branches or pull requests
2 participants
@fb64 @Jolanrensen