Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Openlineage endpoint and Spark Lineage Beta Plugin #9870

Merged
merged 11 commits into from
Mar 1, 2024
Merged

Openlineage endpoint and Spark Lineage Beta Plugin #9870

merged 11 commits into from
Mar 1, 2024

Conversation

treff7es
Copy link
Contributor

Checklist

  • The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
  • Links to related issues (if applicable)
  • Tests for the changes have been added/updated (if applicable)
  • Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
  • For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

@github-actions github-actions bot added ingestion PR or Issue related to the ingestion of metadata product PR or Issue related to the DataHub UI/UX devops PR or Issue related to DataHub backend & deployment labels Feb 16, 2024
@treff7es
Disabling patch support in openlineage converter
9452b7e 
Bumping starlette version to not fail the test
david-leifker and others added 3 commits February 28, 2024 10:17
@david-leifker
Merge remote-tracking branch 'origin/master' into dml-spark-plugin-beta
75e7c5f 
# Conflicts:
#	docker/datahub-ingestion-base/base-requirements.txt
#	entity-registry/src/main/java/com/linkedin/metadata/aspect/patch/builder/UpstreamLineagePatchBuilder.java
@david-leifker
refactor openapi code into primary module
5ef1ffc
@treff7es
Merge pull request #1 from david-leifker/dml-spark-plugin-beta
2f9244a 
Dml spark plugin beta
@david-leifker david-leifker merged commit 6eb5f80 into datahub-project:master Mar 1, 2024
41 checks passed
alexs-101 pushed a commit to alexs-101/datahub that referenced this pull request Mar 1, 2024
@treff7es @david-leifker
Openlineage endpoint and Spark Lineage Beta Plugin (datahub-project#9870
abd811b 
)

Co-authored-by: David Leifker <david.leifker@acryl.io>
@usmanovbf
Copy link

Hi! Is there roadmap or at least deadline for the spark lineage beta release? I have some intention to fork spark lineage and that's why I need to choose appropriate module to enhance: beta or not beta.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@david-leifker david-leifker david-leifker approved these changes

Assignees
No one assigned
Labels
devops PR or Issue related to DataHub backend & deployment ingestion PR or Issue related to the ingestion of metadata product PR or Issue related to the DataHub UI/UX
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@treff7es @usmanovbf @david-leifker