Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Docs] - Upgrade and MWAA #13802

Merged
merged 1 commit into from
Nov 1, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -8,22 +8,24 @@ For example, for the `Metadata` workflow we'll use:
```python
import yaml

from metadata.ingestion.api.workflow import Workflow
from metadata.workflow.metadata import MetadataWorkflow

def run():
workflow_config = yaml.safe_load(CONFIG)
workflow = Workflow.create(workflow_config)
workflow = MetadataWorkflow.create(workflow_config)
workflow.execute()
workflow.raise_from_status()
workflow.print_status()
print_status(workflow)
workflow.stop()
```

The classes for each workflow type are:

- `Metadata`: `from metadata.ingestion.api.workflow import Workflow`
- `Lineage`: `from metadata.ingestion.api.workflow import Workflow`
- `Usage`: `from metadata.ingestion.api.workflow import Workflow`
- `dbt`: `from metadata.ingestion.api.workflow import Workflow`
- `Profiler`: `from metadata.profiler.api.workflow import ProfilerWorkflow`
- `Data Quality`: `from metadata.data_quality.api.workflow import TestSuiteWorkflow`
- `Metadata`: `from metadata.workflow.metadata import MetadataWorkflow`
- `Lineage`: `from metadata.workflow.metadata import MetadataWorkflow` (same as metadata)
- `Usage`: `from metadata.workflow.usage import UsageWorkflow`
- `dbt`: `from metadata.workflow.metadata import MetadataWorkflow`
- `Profiler`: `from metadata.workflow.profiler import ProfilerWorkflow`
- `Data Quality`: `from metadata.workflow.data_quality import TestSuiteWorkflow`
- `Data Insights`: `from metadata.workflow.data_insight import DataInsightWorkflow`
- `Elasticsearch Reindex`: `from metadata.workflow.metadata import MetadataWorkflow` (same as metadata)
Original file line number Diff line number Diff line change
Expand Up @@ -112,7 +112,7 @@ After the migration is finished, you can revert this changes.
### Version Upgrades

- The OpenMetadata Server is now based on **JDK 17**
- OpenMetadata now supports **Elasticsearch** up to version **8.10.2** and **Opensearch** up to version **2.7**
- OpenMetadata now **requires** **Elasticsearch** version **8.10.2** and **Opensearch** version **2.7**

There is no direct migration to bump the indexes to the new supported versions. You might see errors like:

Expand Down
Loading
Loading