Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Downstream column lineage #2159

Merged
merged 1 commit into from
Oct 11, 2022
Merged

Conversation

pawel-big-lebowski
Copy link
Collaborator

Problem

Column lineage should be able to detect downstream edges when requested.

Closes: #2116

Solution

Extend recursive query, that returns column lineage nodes, to traverse the graph for downstream nodes.

Note: All database schema changes require discussion. Please link the issue for context.

Checklist

  • You've signed-off your work
  • Your changes are accompanied by tests (if relevant)
  • Your change contains a small diff and is self-contained
  • You've updated any relevant documentation (if relevant)
  • You've updated the CHANGELOG.md with details about your change under the "Unreleased" section (if relevant, depending on the change, this may not be necessary)
  • You've versioned your .sql database schema migration according to Flyway's naming convention (if relevant)
  • You've included a header in any source code files (if relevant)

@boring-cyborg boring-cyborg bot added api API layer changes docs labels Oct 3, 2022
@pawel-big-lebowski pawel-big-lebowski changed the base branch from main to column-lineage-dataset-resource October 3, 2022 09:49
@codecov
Copy link

codecov bot commented Oct 3, 2022

Codecov Report

Merging #2159 (6fd6416) into main (6fd6416) will not change coverage.
The diff coverage is n/a.

❗ Current head 6fd6416 differs from pull request most recent head b23be06. Consider uploading reports for the commit b23be06 to get more accurate results

@@            Coverage Diff            @@
##               main    #2159   +/-   ##
=========================================
  Coverage     76.54%   76.54%           
  Complexity     1108     1108           
=========================================
  Files           214      214           
  Lines          5180     5180           
  Branches        408      408           
=========================================
  Hits           3965     3965           
  Misses          760      760           
  Partials        455      455           

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@pawel-big-lebowski pawel-big-lebowski force-pushed the downstream-column-lineage branch from 50adb00 to ece3186 Compare October 3, 2022 09:55
@pawel-big-lebowski pawel-big-lebowski force-pushed the column-lineage-dataset-resource branch from 8b669df to d4f0890 Compare October 5, 2022 07:05
@pawel-big-lebowski pawel-big-lebowski force-pushed the downstream-column-lineage branch from ece3186 to f257af6 Compare October 5, 2022 07:12
@pawel-big-lebowski pawel-big-lebowski force-pushed the column-lineage-dataset-resource branch 2 times, most recently from 950e293 to 1ed1720 Compare October 10, 2022 12:17
@pawel-big-lebowski pawel-big-lebowski force-pushed the downstream-column-lineage branch 2 times, most recently from c880efe to 2e848b4 Compare October 10, 2022 13:33
@pawel-big-lebowski pawel-big-lebowski force-pushed the column-lineage-dataset-resource branch 2 times, most recently from 2239520 to b665ad6 Compare October 11, 2022 09:25
Base automatically changed from column-lineage-dataset-resource to main October 11, 2022 09:32
Signed-off-by: Pawel Leszczynski <leszczynski.pawel@gmail.com>
@pawel-big-lebowski pawel-big-lebowski force-pushed the downstream-column-lineage branch from 2e848b4 to b23be06 Compare October 11, 2022 09:33
@pawel-big-lebowski pawel-big-lebowski marked this pull request as ready for review October 11, 2022 09:33
@pawel-big-lebowski pawel-big-lebowski merged commit 472e88c into main Oct 11, 2022
@pawel-big-lebowski pawel-big-lebowski deleted the downstream-column-lineage branch October 11, 2022 09:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Downstream column lineage
2 participants