Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DuckDB plugin does not support DuckDBArray data type #4303

Open
aku opened this issue Jul 10, 2024 · 6 comments
Open

DuckDB plugin does not support DuckDBArray data type #4303

aku opened this issue Jul 10, 2024 · 6 comments
Assignees
Labels
area/plugin Plugin-related issue or feature request bug Something isn't working good first issue Great issue for new contributors

Comments

@aku
Copy link

aku commented Jul 10, 2024

Describe the issue

java.lang.IllegalArgumentException: Data of type 'class org.duckdb.DuckDBArray' for column '[REDACTED]' is not supported
	at io.kestra.plugin.jdbc.AbstractCellConverter.convert(AbstractCellConverter.java:81)
	at io.kestra.plugin.jdbc.duckdb.DuckDbCellConverter.convertCell(DuckDbCellConverter.java:49)
	at io.kestra.plugin.jdbc.AbstractJdbcQuery.convertCell(AbstractJdbcQuery.java:189)
	at io.kestra.plugin.jdbc.AbstractJdbcQuery.mapResultSetToMap(AbstractJdbcQuery.java:182)
	at io.kestra.plugin.jdbc.AbstractJdbcQuery.fetch(AbstractJdbcQuery.java:167)
	at io.kestra.plugin.jdbc.AbstractJdbcQuery.fetchToFile(AbstractJdbcQuery.java:148)
	at io.kestra.plugin.jdbc.AbstractJdbcQuery.run(AbstractJdbcQuery.java:109)
	at io.kestra.plugin.jdbc.duckdb.Query.run(Query.java:231)
	at io.kestra.plugin.jdbc.duckdb.Query.run(Query.java:32)
	at io.kestra.core.runners.WorkerTaskThread.doRun(WorkerTaskThread.java:77)
	at io.kestra.core.runners.AbstractWorkerThread.run(AbstractWorkerThread.java:56)```

### Environment

- Kestra Version: 17.8
- Operating System (OS/Docker/Kubernetes):
- Java Version (if you don't run kestra in Docker):
@aku aku added the bug Something isn't working label Jul 10, 2024
@anna-geller anna-geller added kind/pending-feedback Idea waiting for user feedback and removed bug Something isn't working labels Jul 12, 2024
@anna-geller
Copy link
Member

Could you share a reproducer (example flow that generates that error)? It's difficult to help otherwise. thx in advance!

@aku
Copy link
Author

aku commented Jul 12, 2024

@anna-geller

  - id: duckdb
    type: io.kestra.plugin.jdbc.duckdb.Query
    sql: SELECT [1, 2, 3] AS Result
    fetchOne: true

@anna-geller anna-geller added bug Something isn't working and removed kind/pending-feedback Idea waiting for user feedback labels Jul 12, 2024
@anna-geller anna-geller added the area/plugin Plugin-related issue or feature request label Aug 20, 2024
@tchiotludo tchiotludo added good first issue Great issue for new contributors and removed kind/good-first-issue labels Oct 1, 2024
@KunalKumar-1
Copy link

KunalKumar-1 commented Oct 9, 2024

hey @anna-geller,
has this issue been resolved ?
if not i could work on it .

@anna-geller
Copy link
Member

sure, go ahead and thanks in advance! 👍

@KunalKumar-1
Copy link

KunalKumar-1 commented Oct 10, 2024

@anna-geller ,
I'm having little difficulty identifying the exact location of the relevant files needed to make the change.
Could you please point out to where the io.kestra.plugin.jdbc.duckdb.Query and AbstractCellConverter.convert classes are located in the codebase?

@Ben8t
Copy link
Member

Ben8t commented Oct 10, 2024

Note: unfortunetly we have an upstream issue with DuckDB Java driver opened in DuckDB repo. It seems that array type has been introduced in 0.10 and Kestra plugin version is stuck to 0.8 due to the later issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/plugin Plugin-related issue or feature request bug Something isn't working good first issue Great issue for new contributors
Projects
Status: Backlog
Development

No branches or pull requests

5 participants