-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Auto Tagger Application - Preparing the Ingestion Framework #13862
Conversation
The Python checkstyle failed. Please run You can install the pre-commit hooks with |
The Python checkstyle failed. Please run You can install the pre-commit hooks with |
The Python checkstyle failed. Please run You can install the pre-commit hooks with |
openmetadata-service/src/main/java/org/openmetadata/service/apps/AbstractNativeApplication.java
Outdated
Show resolved
Hide resolved
openmetadata-service/src/main/java/org/openmetadata/service/apps/AbstractNativeApplication.java
Outdated
Show resolved
Hide resolved
openmetadata-service/src/main/java/org/openmetadata/service/apps/AbstractNativeApplication.java
Outdated
Show resolved
Hide resolved
...pec/src/main/resources/json/schema/entity/services/ingestionPipelines/ingestionPipeline.json
Show resolved
Hide resolved
openmetadata-service/src/main/java/org/openmetadata/service/apps/AbstractNativeApplication.java
Show resolved
Hide resolved
...metadata-service/src/main/java/org/openmetadata/service/apps/ExternalApplicationHandler.java
Show resolved
Hide resolved
[open-metadata-ui] Kudos, SonarCloud Quality Gate passed! |
[open-metadata-airflow-apis] SonarCloud Quality Gate failed. 0 Bugs 0.0% Coverage Catch issues before they fail your Quality Gate with our IDE extension SonarLint |
[open-metadata-ingestion] Kudos, SonarCloud Quality Gate passed! |
Describe your changes:
This is the first iteration for a more generic approach of External Apps:
ExternalApplicationHandler
in the backend that should be able to work with any external app (Data Insights will stay as-is)ExternalApplicationHandler
will create an Ingestion Pipeline of typeApplication
that translates to anApplicationWorkflow
, as a simplified ingestion workflow with a single stepmetadata app -c <path>
CLI tool to play around with apps from YAMLAutoTagger
where we are just translating the PII processor from the profiler. We will iterate on this to handle the generic tagging featureType of change:
Checklist:
Fixes <issue-number>: <short explanation>