Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Join #319

Closed
6 tasks
BohuTANG opened this issue Apr 16, 2021 · 5 comments
Closed
6 tasks

Join #319

BohuTANG opened this issue Apr 16, 2021 · 5 comments
Labels
A-query Area: databend query C-feature Category: feature prio: high High priority

Comments

@BohuTANG
Copy link
Member

BohuTANG commented Apr 16, 2021 •
edited
Loading

Summary
Initial tasks:

  • join sql parser (almost done, but need to convert to plan)
  • join plan
  • join transform(hash)
  • reshuffle mode
    • FuseQuery reshuffle: Reshuffle transform
      1. a unified reshuffle transform that can be used for group-by or others who needs reshuffle
    • FuseStorage reshuffle?
      1. push down a hash expression to storage, like join_key_a%5=3 AND join_key_b%5=3
      2. FuseQuery node do local join
      3. FuseQuery do final merge
@BohuTANG BohuTANG added C-feature Category: feature prio: high High priority A-query Area: databend query labels Apr 16, 2021
@leiysky
Copy link
Contributor

leiysky commented Apr 29, 2021

I'd like to write a RFC for join recently. Is there already any plan on this?

@BohuTANG
Copy link
Member Author

Cool, it's not started yet, welcome RFC

@leiysky leiysky mentioned this issue May 3, 2021
Merged
@leiysky
Copy link
Contributor

leiysky commented May 3, 2021

I just wrote a draft proposal #465, welcome to comment.

By the way, I found it's hard to discuss about the detailed part in this RFC. Thus I'm going to write another RFC about implementation of hash join algorithm.

@BohuTANG BohuTANG mentioned this issue May 9, 2021
Merged
@BohuTANG
Copy link
Member Author

BohuTANG commented May 9, 2021

021-05-01-join-framework-design.md moved to website/datafuse/docs/rfcs at #501
Cc @leiysky

@leiysky leiysky mentioned this issue May 16, 2021
Closed
3 tasks
@Xuanwo
Copy link
Member

Xuanwo commented Jul 2, 2022

Join has been supported, closing.

@Xuanwo Xuanwo closed this as completed Jul 2, 2022
Maricaya pushed a commit to Maricaya/databend that referenced this issue Sep 29, 2024
@everpcpc
chore(ci): publish binary to repo.databend.rs (databendlabs#319)
7cecacb
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
A-query Area: databend query C-feature Category: feature prio: high High priority
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@BohuTANG @Xuanwo @leiysky