Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support user incremental predicates on merge #160

Closed
dave-connors-3 opened this issue Aug 23, 2022 · 1 comment · Fixed by #161
Closed

support user incremental predicates on merge #160

dave-connors-3 opened this issue Aug 23, 2022 · 1 comment · Fixed by #161
Labels
enhancement New feature or request

Comments

@dave-connors-3
Copy link
Contributor

dave-connors-3 commented Aug 23, 2022 •
edited
Loading

Describe the feature

Users should be able to supply incremental models with arbitrary predicates during the merge step to prevent unnecessary table scan for massive data sets.

Describe alternatives you've considered

None

Additional context

See:

Who will this benefit?

users with extremely large datasets who want to limit the scan of their merge operations on incremental models!

Are you interested in contributing this feature?

Yes
@dave-connors-3 dave-connors-3 added the enhancement New feature or request label Aug 23, 2022
@dave-connors-3 dave-connors-3 mentioned this issue Aug 23, 2022
Merged
3 tasks
@bilalaslamseattle
Copy link
Collaborator

@ueshin @superdupershant seems like a reasonable ask since it's supported in other DWs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Feature/incremental predicates dave-connors-3/dbt-databricks
2 participants
@bilalaslamseattle @dave-connors-3