OpenMetadata 1.3.0-Release
akash-jain-10
released this
06 Feb 05:51
·
14 commits
to 1.3.0
since this release
What’s New in OpenMetadata 1.3 Release
Lineage
- Revamped the lineage UI for an intuitive and comprehensive view of data flow and transformations.
- Organized nodes for better visibility with pagination support.
- Improved the display of circular dependencies.
- Nodes display the service icons, highlight dbt models, and show Data Quality results.
- Lineage can be filtered to search by Ownership, Domain, Service, Service Type, Tier, and Classification Tags.
- Supports search by Column and traces lineage even when the columns are renamed.
- Enhanced user control with collapsible sub-graphs.
- Supports editing the SQL queries for lineage edges from the UI.
- Performance improvements for faster load of large graphs.
Data Observability Alerts
- Data observability alerts have been distinguished from the other general-purpose notifications, making it easy to get to the crucial alerts quickly.
- Sends alerts for schema changes and test case failures for the data assets that you follow.
- The overall flow has been simplified to let you easily create alerts for schema changes in your data.
- You can now get Data Quality alerts for specific Test Suites.
- Users will be alerted for all the changes to the data assets that they own.
Incident Manager
- Introduced Incidents Manager to improve the data quality resolution flow.
- Incidents Manager summarizes all the test case results with information about the failure severity and resolution flow.
- Supports assigning a resolution task to the users in OpenMetadata.
- Tasks are created when a data quality test has been assigned to an Assignee or a Reviewer.
- Resolved test failure also displays the comments posted on the resolution.
- The Resolved Tab displays information on the Test case name, Execution date, Reason, Comments, and information on who Resolved the issue.
Knowledge Center
- Supports hierarchical pages to structure the articles.
- You can easily associate knowledge articles with data assets.
- The data assets page displays the related articles.
- The block editor supports callouts to add notes, warnings, tables, and task lists.
- Quicklinks are no longer separate pages; they redirect to external links.
- Data assets can be associated with Quicklinks.
- Added Search support for Knowledge articles to filter by Owner or Tags.
- Supports preview for articles and Quicklinks.
Custom Metrics for Profiler
- Supports custom metrics for the data profiler with custom SQL to keep track of your business metrics.
- Custom metrics can be created at Table and Column levels.
Profiler and Data Quality
- The Profiler has been improved to support sample data ingestion without computing other metrics.
- Admins can configure the profiler to fetch up to 10,000 rows of sample data.
- Sample data can be stored in S3 buckets.
- Refined the default time range on the test case results page, adjusting it from the Last 3 days to the Last 30 days for a more encompassing view.
Connectors
- New Google Cloud Storage for storage services.
- New Alation connector to migrate metadata into Collate.
- New Iceberg, SAS Viya, and Doris connectors.
- Introduced the Spark Lineage Agent to extract metadata and end-to-end lineage from Spark jobs.
- MSSQL and Oracle now support Stored Procedures.
- We now exclude system indices from the Elasticsearch connector by default.
- Added support for DB2 IBM I Series.
- Pipeline services now get owner information.
- Performance improvements for the Tableau Connector.
- We now support metadata tag extraction from Databricks.
- Supports the attribute Table Owner for metadata ingestion from Postgres.
- We now extract table descriptions when ingesting metadata from Salesforce.
Glossary
- Supports soft delete for the default glossaries in OpenMetadata.
- Supports the creation of tasks to request tags or a description.
- Only the Owner can edit the Glossary term.
- Version history displays the Username instead of the User ID.
Localization
- Now supports RTL UI for the Hebrew language.
- New Dutch language translation.
Settings UI
- The Settings page UI has been revamped.
Data Insights
- Cost Analysis expanded to support BigQuery & Redshift.
- Improved the Data Insights Report sent via email.
Other Changes
- Announcements can be notified over email, Slack, or Teams.
- Alerts are sent to a user when they are mentioned in a task or activity feed.
- We have improved the display of search results for column matches. When searching for columns, the matched results will be displayed and highlighted in the Preview pane.
- Table Type filter has been added in the Advanced Search, so that users can exclude the temporary or staging tables from search.
- Now it’s easy to filter the Data assets without a Owner.
- Database and Schema were added to the Explore menu to enhance data discovery.
- Custom properties are displayed on the right of the data asset details page.
- We now display the Domain on the Users page.
- Supports the sorting of data assets by popularity based on the number of followers and thumbs up as signals.
- OpenMetadata can now handle metric history for ML models.
- When configuring the Email settings, the Username and Password fields can be left blank.
- We now support a test email button on the Email SMTP page.
New Contributors
- @TomBushell made their first contribution in #13677
- @askibunou made their first contribution in #13604
- @mrkoloev made their first contribution in #13832
- @dechoma made their first contribution in #13973
- @shin1103 made their first contribution in #14118
- @chyueyi made their first contribution in #14087
- @viniciusdsmello made their first contribution in #14178
- @gaborhermann made their first contribution in #14172
- @allenkallz made their first contribution in #14029
- @FreeDevz made their first contribution in #14175
- @csy1204 made their first contribution in #14239
- @LucasGarcia07 made their first contribution in #14249
- @CKristensen made their first contribution in #14375
- @aldwyn made their first contribution in #14287
- @saurabhyadav1985 made their first contribution in #14468
- @NormanZhang-zzt made their first contribution in #13753
- @civitaspo made their first contribution in #14521
- @TrsNium made their first contribution in #14588
- @sandervanlaar made their first contribution in #14597
- @MrVinegar made their first contribution in #14415
- @vijay-ravi made their first contribution in #14740
- @IceS2 made their first contribution in #14754
- @kwgdaig made their first contribution in #14733
- @luzlab made their first contribution in #14804
- @marcorezende made their first contribution in #14884
- @FelipeArruda made their first contribution in #14960
- @soheilade made their first contribution in #15010
- @sushi30 made their first contribution in #15014
Full Changelog: 1.2.5-release...1.3.0-release