We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Describe the bug Large Utf8 not supported in DuckDB data accelerator due to the lack of support in duckdb-rs, will require upstream fix to
To Reproduce Use the folllowing spicepod.yaml config:
from: s3://spiceai-demo-datasets/taxi_trips/2024/ name: taxi_trips description: taxi trips in s3 acceleration: engine: duckdb enabled: true refresh_check_interval: 10s
Error log shown: 2024-05-22T00:06:46.964431Z WARN runtime: Unable to attach data connector s3: Unable to create dataset acceleration: Acceleration creation failed: Unable to create table: External error: Unable to create duckdb table: Invalid Input Error: column Field { name: "store_and_fwd_flag", data_type: LargeUtf8, nullable: true, dict_id: 0, dict_is_ordered: false, metadata: {} } is not supported yet, please file an issue https://github.com/wangfenjin/duckdb-rs
2024-05-22T00:06:46.964431Z WARN runtime: Unable to attach data connector s3: Unable to create dataset acceleration: Acceleration creation failed: Unable to create table: External error: Unable to create duckdb table: Invalid Input Error: column Field { name: "store_and_fwd_flag", data_type: LargeUtf8, nullable: true, dict_id: 0, dict_is_ordered: false, metadata: {} } is not supported yet, please file an issue https://github.com/wangfenjin/duckdb-rs
Expected behavior Large Utf8 is supported in duckdb-rs and spice duckdb data connector
The text was updated successfully, but these errors were encountered:
Possible fix would be spiceai/duckdb-rs#1
Issue is that we then create possible type incompatibilities. i.e. when we return it from duckdb, we have no way of figuring out if we should
Sorry, something went wrong.
Jeadie
No branches or pull requests
Describe the bug
Large Utf8 not supported in DuckDB data accelerator due to the lack of support in duckdb-rs, will require upstream fix to
To Reproduce
Use the folllowing spicepod.yaml config:
Error log shown:
2024-05-22T00:06:46.964431Z WARN runtime: Unable to attach data connector s3: Unable to create dataset acceleration: Acceleration creation failed: Unable to create table: External error: Unable to create duckdb table: Invalid Input Error: column Field { name: "store_and_fwd_flag", data_type: LargeUtf8, nullable: true, dict_id: 0, dict_is_ordered: false, metadata: {} } is not supported yet, please file an issue https://github.com/wangfenjin/duckdb-rs
Expected behavior
Large Utf8 is supported in duckdb-rs and spice duckdb data connector
The text was updated successfully, but these errors were encountered: