Skip to content

Conversation

sundarshankar89
Copy link
Collaborator

@sundarshankar89 sundarshankar89 commented Sep 26, 2025

Changes

This PR addresses broken tests following blueprint bug fixes by updating test configurations to include six new required boolean configuration fields. It ensures compatibility with recent blueprint changes that added new boolean configuration parameters.

Linked issues

databrickslabs/blueprint#268

Resolves #..
Resolves a Lakebridge bug which doesn't store boolean value in workspace config.yml when set to False.

Functionality

  • added relevant user documentation
  • added new CLI command
  • modified existing command: databricks labs ucx ...
  • added a new workflow
  • modified existing workflow: ...
  • added a new table
  • modified existing table: ...

Tests

  • manually tested
  • added unit tests
  • added integration tests
  • verified on staging environment (screenshot attached)

@Copilot Copilot AI review requested due to automatic review settings September 26, 2025 05:52
@sundarshankar89 sundarshankar89 requested a review from a team as a code owner September 26, 2025 05:52
Copy link

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR fixes broken tests after blueprint bug fixes by updating test configurations to include new required boolean configuration fields. The changes ensure test compatibility with blueprint changes that added new boolean configuration parameters.

  • Added six new boolean configuration fields to test fixtures
  • Updated dependency to use a patched version of databricks-labs-blueprint
  • Added configuration for direct Git references in pyproject.toml

Reviewed Changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

File Description
tests/unit/install/test_install.py Added new boolean configuration fields to test fixtures
tests/unit/hive_metastore/test_mapping.py Added 'compare_rows' field to mapping test data
pyproject.toml Updated blueprint dependency to Git reference and enabled direct references

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

Comment on lines +50 to +51
#"databricks-labs-blueprint>=0.11.0,<0.12.0",
"databricks-labs-blueprint @ git+https://github.com/databrickslabs/blueprint@patch/bool_type",
Copy link

Copilot AI Sep 26, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Using a Git branch reference instead of a versioned release creates instability and makes builds non-reproducible. Consider releasing a proper version of the blueprint library with the boolean type fixes and reverting to semantic versioning.

Suggested change
#"databricks-labs-blueprint>=0.11.0,<0.12.0",
"databricks-labs-blueprint @ git+https://github.com/databrickslabs/blueprint@patch/bool_type",
"databricks-labs-blueprint>=0.11.0,<0.12.0",

Copilot uses AI. Check for mistakes.

@sundarshankar89 sundarshankar89 added the pr/do-not-merge this pull request is not ready to merge label Sep 26, 2025
if len(groups) == 1:
return groups[0].display_name
group_names = [group.display_name for group in groups]
group_names = [group.display_name for group in groups if group.display_name is not None]
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was done for fmt fixes

Copy link

github-actions bot commented Sep 26, 2025

❌ 129/132 passed, 3 flaky, 3 failed, 11 skipped, 6h16m22s total

❌ test_table_migration_convert_manged_to_external: databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task crawl_lakeview_dashboards failed with message: Cluster DATABRICKS_CLUSTER_ID was terminated during the run (cluster state message: Termination requested by 0a330eb5-dd51-4d97-b6e4-c474356b1d5d). (9m52.669s)
databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task crawl_lakeview_dashboards failed with message: Cluster DATABRICKS_CLUSTER_ID was terminated during the run (cluster state message: Termination requested by 0a330eb5-dd51-4d97-b6e4-c474356b1d5d).
[gw3] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
06:17 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zUHq/config.yml) doesn't exist.
06:17 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
06:18 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
06:18 INFO [databricks.labs.ucx.install] Fetching installations...
06:18 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zUHq is corrupted. Skipping...
06:18 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
06:18 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:21 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:21 INFO [databricks.labs.ucx.install] Installing UCX v0.60.1+620250929062130
06:21 INFO [databricks.labs.ucx.install] Creating ucx schemas...
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
06:21 INFO [databricks.labs.ucx.install] Creating dashboards...
06:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
06:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
06:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
06:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
06:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
06:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
06:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
06:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
06:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
06:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
06:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
06:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:21 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zUHq/README for the next steps.
06:21 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
06:21 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/275347476084634
06:21 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
06:21 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/275347476084634/runs/713181117410875
06:21 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/275347476084634
06:21 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
06:17 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zUHq/config.yml) doesn't exist.
06:17 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
06:18 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
06:18 INFO [databricks.labs.ucx.install] Fetching installations...
06:18 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zUHq is corrupted. Skipping...
06:18 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
06:18 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:21 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:21 INFO [databricks.labs.ucx.install] Installing UCX v0.60.1+620250929062130
06:21 INFO [databricks.labs.ucx.install] Creating ucx schemas...
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
06:21 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
06:21 INFO [databricks.labs.ucx.install] Creating dashboards...
06:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
06:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
06:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
06:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
06:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
06:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
06:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
06:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
06:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
06:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
06:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
06:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:21 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zUHq/README for the next steps.
06:21 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
06:21 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/275347476084634
06:21 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
06:21 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/275347476084634/runs/713181117410875
06:21 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/275347476084634
06:21 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
06:27 INFO [databricks.labs.ucx.install] Deleting UCX v0.60.1+620250929062130 from https://DATABRICKS_HOST
06:27 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_shnmw
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=176971603871473, as it is no longer needed
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=427272525293224, as it is no longer needed
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=18509598197041, as it is no longer needed
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=707825205338241, as it is no longer needed
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1055881502072658, as it is no longer needed
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=99545339303812, as it is no longer needed
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=461029160660192, as it is no longer needed
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=957729133540901, as it is no longer needed
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=275347476084634, as it is no longer needed
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1031754034804479, as it is no longer needed
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=356575921507517, as it is no longer needed
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=425185030130939, as it is no longer needed
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=875274191758884, as it is no longer needed
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=167701397801044, as it is no longer needed
06:27 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=266609732422752, as it is no longer needed
06:27 INFO [databricks.labs.ucx.install] Deleting cluster policy
06:27 INFO [databricks.labs.ucx.install] Deleting secret scope
06:27 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw3] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_installation_with_dependency_upload: databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task failing_task failed with message: Workload failed, see run output for details. (1m48.897s)
databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task failing_task failed with message: Workload failed, see run output for details.
[gw4] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
06:35 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.n4mR/config.yml) doesn't exist.
06:35 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
06:35 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
06:35 INFO [databricks.labs.ucx.install] Fetching installations...
06:35 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
06:35 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:35 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:36 INFO [databricks.labs.ucx.install] Installing UCX v0.60.1+620250929063600
06:36 INFO [databricks.labs.ucx.install] Creating ucx schemas...
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
06:36 INFO [databricks.labs.ucx.install] Creating dashboards...
06:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
06:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
06:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
06:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
06:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
06:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
06:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
06:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
06:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
06:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
06:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
06:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:36 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.n4mR/README for the next steps.
06:36 DEBUG [databricks.labs.ucx.installer.workflows] starting failing job: https://DATABRICKS_HOST#job/155968561970796
06:36 INFO [databricks.labs.ucx.installer.workflows] Named parameters for failing job: None
06:36 INFO [databricks.labs.ucx.installer.workflows] Started failing job: https://DATABRICKS_HOST#job/155968561970796/runs/232498557786609
06:36 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of failing job: https://DATABRICKS_HOST#job/155968561970796/runs/232498557786609
06:36 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS --------------
06:36 WARNING [databricks.labs.ucx.installer.workflows] Cannot fetch logs as folder /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.n4mR/logs/failing does not exist
06:36 INFO [databricks.labs.ucx.installer.workflows] ---------- END REMOTE LOGS ----------
06:36 INFO [databricks.labs.ucx.installer.workflows] The status for the latest run is FAILED
06:36 DEBUG [databricks.labs.ucx.installer.workflows] Repairing failing job: https://DATABRICKS_HOST#job/155968561970796/run/232498557786609
06:36 DEBUG [databricks.labs.ucx.installer.workflows] Validating failing workflow: https://DATABRICKS_HOST#job/155968561970796
06:36 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
06:35 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.n4mR/config.yml) doesn't exist.
06:35 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
06:35 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
06:35 INFO [databricks.labs.ucx.install] Fetching installations...
06:35 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
06:35 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:35 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:36 INFO [databricks.labs.ucx.install] Installing UCX v0.60.1+620250929063600
06:36 INFO [databricks.labs.ucx.install] Creating ucx schemas...
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
06:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
06:36 INFO [databricks.labs.ucx.install] Creating dashboards...
06:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
06:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
06:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
06:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
06:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
06:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
06:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
06:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
06:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
06:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
06:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
06:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:36 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.n4mR/README for the next steps.
06:36 DEBUG [databricks.labs.ucx.installer.workflows] starting failing job: https://DATABRICKS_HOST#job/155968561970796
06:36 INFO [databricks.labs.ucx.installer.workflows] Named parameters for failing job: None
06:36 INFO [databricks.labs.ucx.installer.workflows] Started failing job: https://DATABRICKS_HOST#job/155968561970796/runs/232498557786609
06:36 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of failing job: https://DATABRICKS_HOST#job/155968561970796/runs/232498557786609
06:36 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS --------------
06:36 WARNING [databricks.labs.ucx.installer.workflows] Cannot fetch logs as folder /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.n4mR/logs/failing does not exist
06:36 INFO [databricks.labs.ucx.installer.workflows] ---------- END REMOTE LOGS ----------
06:36 INFO [databricks.labs.ucx.installer.workflows] The status for the latest run is FAILED
06:36 DEBUG [databricks.labs.ucx.installer.workflows] Repairing failing job: https://DATABRICKS_HOST#job/155968561970796/run/232498557786609
06:36 DEBUG [databricks.labs.ucx.installer.workflows] Validating failing workflow: https://DATABRICKS_HOST#job/155968561970796
06:36 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
06:37 INFO [databricks.labs.ucx.install] Deleting UCX v0.60.1+620250929063600 from https://DATABRICKS_HOST
06:37 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_spddh
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1050032031939239, as it is no longer needed
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=737039265228972, as it is no longer needed
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=832296166456305, as it is no longer needed
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=438875905363772, as it is no longer needed
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=884989953367229, as it is no longer needed
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=369552046426734, as it is no longer needed
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=67263422128283, as it is no longer needed
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=977318546886294, as it is no longer needed
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1033345637676895, as it is no longer needed
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=694406117925487, as it is no longer needed
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=155968561970796, as it is no longer needed
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=259717966438491, as it is no longer needed
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=850805489169574, as it is no longer needed
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=504153420219226, as it is no longer needed
06:37 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=685933610564931, as it is no longer needed
06:37 INFO [databricks.labs.ucx.install] Deleting cluster policy
06:37 INFO [databricks.labs.ucx.install] Deleting secret scope
06:37 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw4] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
❌ test_hiveserde_table_in_place_migration_job[migrate-external-hiveserde-tables-in-place-experimental]: AssertionError: Workflow failed: migrate-external-hiveserde-tables-in-place-experimental (27m44.999s)
AssertionError: Workflow failed: migrate-external-hiveserde-tables-in-place-experimental
assert False
 +  where False = validate_step('migrate-external-hiveserde-tables-in-place-experimental')
 +    where validate_step = <databricks.labs.ucx.installer.workflows.DeployedWorkflows object at 0x7f234239a140>.validate_step
 +      where <databricks.labs.ucx.installer.workflows.DeployedWorkflows object at 0x7f234239a140> = <tests.integration.conftest.MockInstallationContext object at 0x7f2340e90670>.deployed_workflows
[gw3] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
06:27 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.HPJR/config.yml) doesn't exist.
06:27 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
06:27 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
06:27 INFO [databricks.labs.ucx.install] Fetching installations...
06:27 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.HPJR is corrupted. Skipping...
06:27 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
06:27 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:29 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:29 INFO [databricks.labs.ucx.install] Installing UCX v0.60.1+620250929062902
06:29 INFO [databricks.labs.ucx.install] Creating ucx schemas...
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
06:29 INFO [databricks.labs.ucx.install] Creating dashboards...
06:29 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
06:29 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
06:29 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
06:29 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
06:29 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
06:29 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
06:29 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
06:29 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
06:29 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
06:29 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
06:29 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
06:29 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:29 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:29 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:29 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:29 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:29 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:29 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:29 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.HPJR/README for the next steps.
06:29 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
06:29 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/330920777646312
06:29 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
06:29 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/330920777646312/runs/55406167228217
06:29 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/330920777646312
06:29 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
06:34 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-hiveserde-tables-in-place-experimental job: https://DATABRICKS_HOST#job/1045744800751869
06:34 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-external-hiveserde-tables-in-place-experimental job: None
06:34 INFO [databricks.labs.ucx.installer.workflows] Started migrate-external-hiveserde-tables-in-place-experimental job: https://DATABRICKS_HOST#job/1045744800751869/runs/642920894039893
06:34 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-external-hiveserde-tables-in-place-experimental workflow: https://DATABRICKS_HOST#job/1045744800751869
06:34 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
06:27 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.HPJR/config.yml) doesn't exist.
06:27 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
06:27 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
06:27 INFO [databricks.labs.ucx.install] Fetching installations...
06:27 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.HPJR is corrupted. Skipping...
06:27 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
06:27 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:29 DEBUG [tests.integration.conftest] Waiting for clusters to start...
06:29 INFO [databricks.labs.ucx.install] Installing UCX v0.60.1+620250929062902
06:29 INFO [databricks.labs.ucx.install] Creating ucx schemas...
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
06:29 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
06:29 INFO [databricks.labs.ucx.install] Creating dashboards...
06:29 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
06:29 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
06:29 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
06:29 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
06:29 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
06:29 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
06:29 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
06:29 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
06:29 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
06:29 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
06:29 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
06:29 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:29 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:29 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:29 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:29 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:29 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:29 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
06:29 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.HPJR/README for the next steps.
06:29 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
06:29 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/330920777646312
06:29 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
06:29 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/330920777646312/runs/55406167228217
06:29 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/330920777646312
06:29 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
06:34 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-hiveserde-tables-in-place-experimental job: https://DATABRICKS_HOST#job/1045744800751869
06:34 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-external-hiveserde-tables-in-place-experimental job: None
06:34 INFO [databricks.labs.ucx.installer.workflows] Started migrate-external-hiveserde-tables-in-place-experimental job: https://DATABRICKS_HOST#job/1045744800751869/runs/642920894039893
06:34 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-external-hiveserde-tables-in-place-experimental workflow: https://DATABRICKS_HOST#job/1045744800751869
06:34 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
06:54 INFO [databricks.labs.ucx.install] Deleting UCX v0.60.1+620250929062902 from https://DATABRICKS_HOST
06:54 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_siyag
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=157440610561395, as it is no longer needed
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=223733412159524, as it is no longer needed
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1045744800751869, as it is no longer needed
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=325896963610947, as it is no longer needed
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=751613220097836, as it is no longer needed
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=895187445242778, as it is no longer needed
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=925611610855455, as it is no longer needed
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=985423431993510, as it is no longer needed
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=330920777646312, as it is no longer needed
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=704453508161937, as it is no longer needed
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=800311725326007, as it is no longer needed
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=657247862588799, as it is no longer needed
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=768475578020215, as it is no longer needed
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=82161013457673, as it is no longer needed
06:55 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=573089076910077, as it is no longer needed
06:55 INFO [databricks.labs.ucx.install] Deleting cluster policy
06:55 INFO [databricks.labs.ucx.install] Deleting secret scope
06:55 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw3] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

Flaky tests:

  • 🤪 test_describe_all_udfs_in_databases (47.679s)
  • 🤪 test_table_migration_job_refreshes_migration_status[regular-migrate-tables] (10m28.033s)
  • 🤪 test_running_real_migrate_groups_job (3m6.623s)

Running from acceptance #8888

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr/do-not-merge this pull request is not ready to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants