Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Integrate with delta lake #7974

Open
Tracked by #7592
Xuanwo opened this issue Sep 30, 2022 · 4 comments
Open
Tracked by #7592

feat: Integrate with delta lake #7974

Xuanwo opened this issue Sep 30, 2022 · 4 comments
Labels
A-integration Area: integration C-feature Category: feature

Comments

@Xuanwo
Copy link
Member

Xuanwo commented Sep 30, 2022

Summary

Delta lake is an open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs.

Allow databend read data from delta lake seems interesting. We can use delta-rs.

@BohuTANG BohuTANG added the C-feature Category: feature label Sep 30, 2022
@Xuanwo Xuanwo added the A-integration Area: integration label Sep 30, 2022
@Xuanwo Xuanwo moved this to 📋 Backlog in Xuanwo's Work Sep 30, 2022
@teckick
Copy link
Contributor

teckick commented Dec 26, 2022

Does it mean using Databend as a compute engine for Delta, just like Spark / Presto?

@Xuanwo
Copy link
Member Author

Xuanwo commented Dec 26, 2022

Does it mean using Databend as a compute engine for Delta, just like Spark / Presto?

Yes, make databend-query can query over delta lake directly. Integrate delta-rs is not suitable for us now, we need to port delta-rs to opendal first.

@davidgasquez
Copy link

Hey there! Are you planning on working on this one in 2023? Didn't saw Delta @ #9448. 😢

@sundy-li
Copy link
Member

Hey there! Are you planning on working on this one in 2023? Didn't saw Delta @ #9448. 😢

Thanks, it's added!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-integration Area: integration C-feature Category: feature
Projects
None yet
Development

No branches or pull requests

5 participants