WASBS migration support fix

[FastLee]

Fixed the experimental WASBS migration workflow to support DBR16 and to default to a single user cluster.

[github-actions]

❌ 102/107 passed, 2 flaky, 5 failed, 10 skipped, 8h6m18s total

❌ test_migrate_external_tables_with_spn_CLOUD_ENV: databricks.sdk.errors.platform.ResourceDoesNotExist: Principal: ServicePrincipalName(5a11359f-ba1f-483f-8e00-0fe55ec003ed) does not exist (15.122s)

databricks.sdk.errors.platform.ResourceDoesNotExist: Principal: ServicePrincipalName(5a11359f-ba1f-483f-8e00-0fe55ec003ed) does not exist
[gw1] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
[gw1] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

❌ test_table_migration_job_refreshes_migration_status[regular-migrate-tables]: AssertionError: Workflow failed: migrate-tables (23m39.195s)

... (skipped 3133 bytes)
atabricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
14:45 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
14:45 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
14:45 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
14:45 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
14:45 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
14:45 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
14:45 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
14:45 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
14:45 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
14:45 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
14:45 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:45 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:45 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:45 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:45 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:45 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:45 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:45 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.xaF3/README for the next steps.
14:45 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
14:45 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/754712091541751
14:45 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
14:45 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/754712091541751/runs/852505938189914
14:45 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/754712091541751
14:45 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
14:47 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/543646639511405
14:47 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-tables job: None
14:47 INFO [databricks.labs.ucx.installer.workflows] Started migrate-tables job: https://DATABRICKS_HOST#job/543646639511405/runs/268330922424945
14:47 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-tables workflow: https://DATABRICKS_HOST#job/543646639511405
14:47 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
14:44 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.xaF3/config.yml) doesn't exist.
14:44 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
14:44 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
14:44 INFO [databricks.labs.ucx.install] Fetching installations...
14:44 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.xaF3 is corrupted. Skipping...
14:44 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
14:44 DEBUG [tests.integration.conftest] Waiting for clusters to start...
14:44 DEBUG [tests.integration.conftest] Waiting for clusters to start...
14:45 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+920251008144501
14:45 INFO [databricks.labs.ucx.install] Creating ucx schemas...
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
14:45 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
14:45 INFO [databricks.labs.ucx.install] Creating dashboards...
14:45 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
14:45 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
14:45 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
14:45 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
14:45 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
14:45 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
14:45 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
14:45 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
14:45 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
14:45 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
14:45 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
14:45 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:45 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:45 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:45 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:45 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:45 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:45 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
14:45 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.xaF3/README for the next steps.
14:45 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
14:45 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/754712091541751
14:45 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
14:45 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/754712091541751/runs/852505938189914
14:45 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/754712091541751
14:45 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
14:47 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/543646639511405
14:47 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-tables job: None
14:47 INFO [databricks.labs.ucx.installer.workflows] Started migrate-tables job: https://DATABRICKS_HOST#job/543646639511405/runs/268330922424945
14:47 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-tables workflow: https://DATABRICKS_HOST#job/543646639511405
14:47 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
15:07 INFO [databricks.labs.ucx.install] Deleting UCX v0.60.2+920251008144501 from https://DATABRICKS_HOST
15:07 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sm2cm
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=21718267209897, as it is no longer needed
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=754712091541751, as it is no longer needed
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=84215206505003, as it is no longer needed
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=743570218270499, as it is no longer needed
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=399570896449401, as it is no longer needed
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=983423179424737, as it is no longer needed
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=543646639511405, as it is no longer needed
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=252027098648673, as it is no longer needed
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=275360308445486, as it is no longer needed
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=228075932719785, as it is no longer needed
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=238931739316269, as it is no longer needed
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1067551221615783, as it is no longer needed
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=234397511474365, as it is no longer needed
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1032161775213373, as it is no longer needed
15:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1001781650116371, as it is no longer needed
15:08 INFO [databricks.labs.ucx.install] Deleting cluster policy
15:08 INFO [databricks.labs.ucx.install] Deleting secret scope
15:08 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw5] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

❌ test_reflect_account_groups_on_workspace: TimeoutError: Timed out after 0:02:00 (2m26.317s)

... (skipped 23304 bytes)
s] Group enumeration reflects renamed group: 2126562863923281 (renamed to ucx-temp-ucx_GzUc2-ra78b49611)
15:11 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
15:11 INFO [databricks.labs.ucx.workspace_access.groups] Found 62 WorkspaceGroup
15:11 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 2126562863923281 (renamed to ucx-temp-ucx_GzUc2-ra78b49611)
15:11 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete.
15:11 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
15:11 INFO [databricks.labs.ucx.workspace_access.groups] Found 81 account groups
15:11 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
15:11 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
15:11 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
15:11 INFO [databricks.labs.ucx.workspace_access.groups] Found 3 WorkspaceGroup
15:11 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgutv.groups] fetching groups inventory
15:11 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration...
15:11 WARNING [databricks.labs.ucx.workspace_access.groups] Skipping ucx_GzUc2-ra78b49611: group already exists in workspace
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Found 4 WorkspaceGroup
15:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgutv.groups] fetching groups inventory
15:12 WARNING [databricks.labs.ucx.workspace_access.groups] Group ucx_GdFCw-ra78b49611 defined in configuration does not exist on the groups table. Consider checking if the group exist in the workspace or re-running the assessment.
15:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgutv.groups] crawling new set of snapshot data for groups
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Found 4 WorkspaceGroup
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Found 82 account groups
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
15:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgutv.groups] found 1 new records for groups
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration...
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx_GdFCw-ra78b49611 (id=2128107704999059) -> ucx-temp-ucx_GdFCw-ra78b49611
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_GdFCw-ra78b49611 (id=2128107704999059) -> ucx-temp-ucx_GdFCw-ra78b49611
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_GdFCw-ra78b49611 (id=2128107704999059) -> ucx-temp-ucx_GdFCw-ra78b49611
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_GdFCw-ra78b49611 (id=2128107704999059) -> ucx-temp-ucx_GdFCw-ra78b49611
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_GdFCw-ra78b49611 (id=2128107704999059) -> ucx-temp-ucx_GdFCw-ra78b49611
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_GdFCw-ra78b49611 (id=2128107704999059) -> ucx-temp-ucx_GdFCw-ra78b49611
15:12 WARNING [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_GdFCw-ra78b49611 (id=2128107704999059) -> ucx-temp-ucx_GdFCw-ra78b49611
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_GdFCw-ra78b49611 (id=2128107704999059) -> ucx-temp-ucx_GdFCw-ra78b49611
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_GdFCw-ra78b49611 (id=2128107704999059) -> ucx-temp-ucx_GdFCw-ra78b49611
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_GdFCw-ra78b49611 (id=2128107704999059) -> ucx-temp-ucx_GdFCw-ra78b49611
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_GdFCw-ra78b49611 (id=2128107704999059) -> ucx-temp-ucx_GdFCw-ra78b49611
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_GdFCw-ra78b49611 (id=2128107704999059) -> ucx-temp-ucx_GdFCw-ra78b49611
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx_GdFCw-ra78b49611 (id=2128107704999059) -> ucx-temp-ucx_GdFCw-ra78b49611
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Found 63 WorkspaceGroup
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 2128107704999059 (renamed to ucx-temp-ucx_GdFCw-ra78b49611)
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Found 63 WorkspaceGroup
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 2128107704999059 (renamed to ucx-temp-ucx_GdFCw-ra78b49611)
15:12 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete.
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Found 82 account groups
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Found 4 WorkspaceGroup
15:12 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgutv.groups] fetching groups inventory
15:12 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration...
15:12 WARNING [databricks.labs.ucx.workspace_access.groups] Skipping ucx_GdFCw-ra78b49611: group already exists in workspace
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
15:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgutv.groups] fetching groups inventory
15:13 WARNING [databricks.labs.ucx.workspace_access.groups] Group ucx_GWNVM-ra78b49611 defined in configuration does not exist on the groups table. Consider checking if the group exist in the workspace or re-running the assessment.
15:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgutv.groups] crawling new set of snapshot data for groups
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
15:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgutv.groups] found 1 new records for groups
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration...
15:13 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx_GWNVM-ra78b49611 (id=2123278617935380) -> ucx-temp-ucx_GWNVM-ra78b49611
15:13 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_GWNVM-ra78b49611 (id=2123278617935380) -> ucx-temp-ucx_GWNVM-ra78b49611
15:13 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_GWNVM-ra78b49611 (id=2123278617935380) -> ucx-temp-ucx_GWNVM-ra78b49611
15:13 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_GWNVM-ra78b49611 (id=2123278617935380) -> ucx-temp-ucx_GWNVM-ra78b49611
15:13 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx_GWNVM-ra78b49611 (id=2123278617935380) -> ucx-temp-ucx_GWNVM-ra78b49611
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
15:13 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 2123278617935380 (renamed to ucx-temp-ucx_GWNVM-ra78b49611)
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
15:13 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 2123278617935380 (renamed to ucx-temp-ucx_GWNVM-ra78b49611)
15:13 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete.
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
15:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgutv.groups] fetching groups inventory
15:13 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration...
15:13 WARNING [databricks.labs.ucx.workspace_access.groups] Skipping ucx_GWNVM-ra78b49611: group already exists in workspace
[gw1] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

❌ test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-hiveserde-tables-in-place-experimental]: AssertionError: Workflow failed: migrate-external-hiveserde-tables-in-place-experimental (23m51.771s)

... (skipped 3492 bytes)
nner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
15:08 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
15:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
15:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
15:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
15:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
15:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
15:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
15:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
15:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:08 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.T0o2/README for the next steps.
15:08 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
15:08 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/17585662258055
15:08 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
15:09 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/17585662258055/runs/623652735818176
15:09 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/17585662258055
15:09 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
15:11 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-hiveserde-tables-in-place-experimental job: https://DATABRICKS_HOST#job/731115922080087
15:11 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-external-hiveserde-tables-in-place-experimental job: None
15:11 INFO [databricks.labs.ucx.installer.workflows] Started migrate-external-hiveserde-tables-in-place-experimental job: https://DATABRICKS_HOST#job/731115922080087/runs/840996527888467
15:11 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-external-hiveserde-tables-in-place-experimental workflow: https://DATABRICKS_HOST#job/731115922080087
15:11 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
15:08 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.T0o2/config.yml) doesn't exist.
15:08 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
15:08 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
15:08 INFO [databricks.labs.ucx.install] Fetching installations...
15:08 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.T0o2 is corrupted. Skipping...
15:08 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
15:08 DEBUG [tests.integration.conftest] Waiting for clusters to start...
15:08 DEBUG [tests.integration.conftest] Waiting for clusters to start...
15:08 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+920251008150840
15:08 INFO [databricks.labs.ucx.install] Creating ucx schemas...
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
15:08 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
15:08 INFO [databricks.labs.ucx.install] Creating dashboards...
15:08 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
15:08 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
15:08 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
15:08 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
15:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
15:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
15:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
15:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
15:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
15:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
15:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
15:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:08 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.T0o2/README for the next steps.
15:08 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
15:08 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/17585662258055
15:08 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
15:09 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/17585662258055/runs/623652735818176
15:09 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/17585662258055
15:09 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
15:11 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-hiveserde-tables-in-place-experimental job: https://DATABRICKS_HOST#job/731115922080087
15:11 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-external-hiveserde-tables-in-place-experimental job: None
15:11 INFO [databricks.labs.ucx.installer.workflows] Started migrate-external-hiveserde-tables-in-place-experimental job: https://DATABRICKS_HOST#job/731115922080087/runs/840996527888467
15:11 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-external-hiveserde-tables-in-place-experimental workflow: https://DATABRICKS_HOST#job/731115922080087
15:11 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
15:31 INFO [databricks.labs.ucx.install] Deleting UCX v0.60.2+920251008150840 from https://DATABRICKS_HOST
15:31 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sm74s
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=17384493784800, as it is no longer needed
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=17585662258055, as it is no longer needed
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=39799546539547, as it is no longer needed
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=513326532924471, as it is no longer needed
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=386842781991677, as it is no longer needed
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=182517902722795, as it is no longer needed
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=320268534198067, as it is no longer needed
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=736121920100905, as it is no longer needed
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=918072376889803, as it is no longer needed
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=622028606583674, as it is no longer needed
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=202403032817072, as it is no longer needed
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=731115922080087, as it is no longer needed
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=600250181590007, as it is no longer needed
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=654972863253056, as it is no longer needed
15:31 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=732924154163851, as it is no longer needed
15:31 INFO [databricks.labs.ucx.install] Deleting cluster policy
15:31 INFO [databricks.labs.ucx.install] Deleting secret scope
15:31 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw5] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

❌ test_table_migration_convert_manged_to_external: AssertionError: assert False (23m45.062s)

... (skipped 3475 bytes)
databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
15:09 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
15:09 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
15:09 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
15:09 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
15:09 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
15:09 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
15:09 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
15:09 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
15:09 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
15:09 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
15:09 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:09 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:09 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:09 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:09 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:09 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:09 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:09 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2wVm/README for the next steps.
15:09 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
15:09 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/605353463607364
15:09 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
15:09 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/605353463607364/runs/331271872768658
15:09 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/605353463607364
15:09 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
15:11 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/871487875719998
15:11 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-tables job: None
15:11 INFO [databricks.labs.ucx.installer.workflows] Started migrate-tables job: https://DATABRICKS_HOST#job/871487875719998/runs/741190154754488
15:11 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-tables workflow: https://DATABRICKS_HOST#job/871487875719998
15:11 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
15:09 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2wVm/config.yml) doesn't exist.
15:09 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
15:09 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
15:09 INFO [databricks.labs.ucx.install] Fetching installations...
15:09 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2wVm is corrupted. Skipping...
15:09 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
15:09 DEBUG [tests.integration.conftest] Waiting for clusters to start...
15:09 DEBUG [tests.integration.conftest] Waiting for clusters to start...
15:09 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+920251008150911
15:09 INFO [databricks.labs.ucx.install] Creating ucx schemas...
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
15:09 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
15:09 INFO [databricks.labs.ucx.install] Creating dashboards...
15:09 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
15:09 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
15:09 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
15:09 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
15:09 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
15:09 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
15:09 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
15:09 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
15:09 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
15:09 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
15:09 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
15:09 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:09 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:09 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:09 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:09 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:09 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:09 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
15:09 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2wVm/README for the next steps.
15:09 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
15:09 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/605353463607364
15:09 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
15:09 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/605353463607364/runs/331271872768658
15:09 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/605353463607364
15:09 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
15:11 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/871487875719998
15:11 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-tables job: None
15:11 INFO [databricks.labs.ucx.installer.workflows] Started migrate-tables job: https://DATABRICKS_HOST#job/871487875719998/runs/741190154754488
15:11 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-tables workflow: https://DATABRICKS_HOST#job/871487875719998
15:11 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
15:32 INFO [databricks.labs.ucx.install] Deleting UCX v0.60.2+920251008150911 from https://DATABRICKS_HOST
15:32 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sxy8y
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=704047664071261, as it is no longer needed
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=395667830053026, as it is no longer needed
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=562074439806377, as it is no longer needed
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=30929755716967, as it is no longer needed
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=312267408203233, as it is no longer needed
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=565019241402638, as it is no longer needed
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=852665448081833, as it is no longer needed
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=605353463607364, as it is no longer needed
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=677064300634011, as it is no longer needed
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=964903388129047, as it is no longer needed
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1109487315147101, as it is no longer needed
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=946710957176108, as it is no longer needed
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=871487875719998, as it is no longer needed
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=423897353245341, as it is no longer needed
15:32 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=207080055545400, as it is no longer needed
15:32 INFO [databricks.labs.ucx.install] Deleting cluster policy
15:32 INFO [databricks.labs.ucx.install] Deleting secret scope
15:32 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw0] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

Flaky tests:

• 🤪 test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-tables-ctas] (23m17.228s)
• 🤪 test_some_entitlements[True] (32.784s)

_{Running from acceptance #8920}

[asnare]

Are there integration tests that cover this? I can't tell at the moment, but we need coverage of this so that we at least know if (when?) it breaks again.