Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test failure: test_running_real_validate_groups_permissions_job #1261

Closed
github-actions bot opened this issue Apr 4, 2024 · 2 comments
Closed

Test failure: test_running_real_validate_groups_permissions_job #1261

github-actions bot opened this issue Apr 4, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@github-actions
Copy link

github-actions bot commented Apr 4, 2024

❌ test_running_real_validate_groups_permissions_job: AttributeError: 'WorkflowsDeployment' object has no attribute 'run_workflow' (1m32.178s) 
AttributeError: 'WorkflowsDeployment' object has no attribute 'run_workflow'
[gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
07:13 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-LIhN: https://DATABRICKS_HOST#setting/accounts/groups/416372241323208
07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-LIhN', entitlements=[], external_id=None, groups=[], id='416372241323208', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
07:13 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sqf64: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sqf64
07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sqf64', metastore_id=None, name='ucx_sqf64', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:13 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sqf64.ucx_t8asc: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sqf64/ucx_t8asc
07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sqf64.ucx_t8asc', metastore_id=None, name='ucx_t8asc', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sqf64', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sqf64/ucx_t8asc', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:13 INFO [databricks.labs.ucx.mixins.fixtures] Query Created ucx_query_QtkNM: https://DATABRICKS_HOST/sql/editor/8fd5438f-885d-4891-9a51-b0f83f280edf
07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added query fixture: Query(can_edit=None, created_at='2024-04-04T07:13:13Z', data_source_id=None, description='TEST QUERY FOR UCX', id='8fd5438f-885d-4891-9a51-b0f83f280edf', is_archived=False, is_draft=False, is_favorite=False, is_safe=True, last_modified_by=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), last_modified_by_id=None, latest_query_data_id=None, name='ucx_query_QtkNM', options=QueryOptions(moved_to_trash_at=None, parameters=[]), parent='folders/2080761702917835', permission_tier=None, query='SELECT * FROM ucx_sqf64.ucx_t8asc', query_hash=None, run_as_role=<RunAsRole.OWNER: 'owner'>, tags=[], updated_at='2024-04-04T07:13:13Z', user=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), user_id=481119220561874, visualizations=[Visualization(created_at='2024-04-04T07:13:13Z', description='', id='cc56713a-5b7d-4636-9cc8-288b4fbcd564', name='Results', options={'version': 2}, type='TABLE', updated_at='2024-04-04T07:13:13Z')])
07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added query permissions fixture: 8fd5438f-885d-4891-9a51-b0f83f280edf [user_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name sdk-LIhN CAN_EDIT]
07:13 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ArFN/config.yml) doesn't exist.
07:13 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
07:13 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
07:13 INFO [databricks.labs.ucx.install] Fetching installations...
07:13 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
07:13 INFO [databricks.labs.ucx.install] Installing UCX v0.21.1+2720240404071318
07:13 INFO [databricks.labs.ucx.install] Creating dashboards...
07:13 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX  Assessment (Estimates)...
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 01_0_group_migration.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 01_0_group_migration.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_metastore_assignment.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_metastore_assignment.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_data_modeling.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_data_modeling.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 03_0_data_migration.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 03_0_data_migration.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX  Assessment (Main)...
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 10___data_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 10___data_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 15___storage_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 15___storage_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 40___last_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 40___last_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 20___compute_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 20___compute_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00___assessment_overview.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00___assessment_overview.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 05___findings_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 05___findings_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 30_0_job_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 30_0_job_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX  Assessment (Azure)...
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX  Assessment (Interactive)...
07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_interactive.md because it's a text widget
07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_interactive.md because it's a text widget
07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_cluster_summary.md because it's a text widget
07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_cluster_summary.md because it's a text widget
07:14 DEBUG [databricks.labs.ucx.installer.workflows] Creating jobs from tasks in main
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
07:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
07:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=099-destroy-schema
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
07:14 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ArFN/README for the next steps.
07:14 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
07:14 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 1003
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES deb7e6d4-9fee-4406-8353-81175f40fc22
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 5a7a9dbb-7ecc-44dd-899a-6c607e42a701
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES fec3caf7-9422-4478-9c73-73cdb89c7254
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 5e9cc236-94be-46f9-b024-f23c6808baac
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 032e9c49-7d7f-439b-89d9-a6e4414c5b12
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 9170e676-a4fc-4054-b1e8-12c8d76900ae
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES d511ab71-7afb-4b97-9559-273e9d7b431c
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 73341447-9631-4988-9528-57faf2e7f163
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ac1b6f9b-0874-4108-8387-6ba69d3ff22f
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 8bfa3072-c5c7-4467-b0cf-a2091db4cd7c
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 87eaed0f-51cd-4797-9934-25e3bc331e38
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 0042ed56-2066-428d-ae79-cd421da55683
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES dade8f79-d936-471f-93f1-10f90290fb3e
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 42930939-4653-48d2-8032-9125d27839ae
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES d642a3c8-99cc-448e-9aa6-aec8d0500b43
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES c0a65e16-a058-455d-9bc3-d76b0c38cec3
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES f2c415e2-5b69-49bd-b815-d7e9028ba6b9
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES bc583f7d-b8ad-4d5b-9a5a-95bd6c7487fa
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ab2bb26b-53a6-4ec9-9469-1a2302cc076c
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES b78cfab1-c5af-49f0-a584-39df74a756f7
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES eea197ea-659e-4432-8854-f268b212a445
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 1a854f7a-6949-407e-8d24-6cee3f17b198
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 65beece7-5275-4e51-a00b-01e6e4ed38a3
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES c99f1780-6559-4e6d-9c44-1e95f888d72c
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 1e126be1-f265-4ad9-8fcf-c867710916a1
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 34631189-4247-4d5b-9636-66388d3df1bb
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 72352c52-0f2f-4ed3-938d-c344db0606bf
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES dc5605f2-bdb4-447e-850e-d11025522a78
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ca19b20a-7359-4865-9c4a-c050e30fb71b
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES fd818da7-e055-463e-846f-a4b407e64578
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES b5cd5cb5-f0b3-482f-8ecd-7ef586a78750
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES f00ecb39-1b0b-4d5f-8ab0-9bb4de479444
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 4d7e4ece-5e87-411b-8bdf-9c53da6e6840
07:14 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 970
07:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_Sucqg.permissions] found 970 new records for permissions
07:14 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table
07:14 INFO [databricks.labs.ucx.workspace_access.manager] Saved 970 to hive_metastore.ucx_Sucqg.permissions
07:13 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-LIhN: https://DATABRICKS_HOST#setting/accounts/groups/416372241323208
07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-LIhN', entitlements=[], external_id=None, groups=[], id='416372241323208', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
07:13 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sqf64: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sqf64
07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sqf64', metastore_id=None, name='ucx_sqf64', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:13 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sqf64.ucx_t8asc: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sqf64/ucx_t8asc
07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sqf64.ucx_t8asc', metastore_id=None, name='ucx_t8asc', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sqf64', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sqf64/ucx_t8asc', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:13 INFO [databricks.labs.ucx.mixins.fixtures] Query Created ucx_query_QtkNM: https://DATABRICKS_HOST/sql/editor/8fd5438f-885d-4891-9a51-b0f83f280edf
07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added query fixture: Query(can_edit=None, created_at='2024-04-04T07:13:13Z', data_source_id=None, description='TEST QUERY FOR UCX', id='8fd5438f-885d-4891-9a51-b0f83f280edf', is_archived=False, is_draft=False, is_favorite=False, is_safe=True, last_modified_by=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), last_modified_by_id=None, latest_query_data_id=None, name='ucx_query_QtkNM', options=QueryOptions(moved_to_trash_at=None, parameters=[]), parent='folders/2080761702917835', permission_tier=None, query='SELECT * FROM ucx_sqf64.ucx_t8asc', query_hash=None, run_as_role=<RunAsRole.OWNER: 'owner'>, tags=[], updated_at='2024-04-04T07:13:13Z', user=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), user_id=481119220561874, visualizations=[Visualization(created_at='2024-04-04T07:13:13Z', description='', id='cc56713a-5b7d-4636-9cc8-288b4fbcd564', name='Results', options={'version': 2}, type='TABLE', updated_at='2024-04-04T07:13:13Z')])
07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added query permissions fixture: 8fd5438f-885d-4891-9a51-b0f83f280edf [user_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name sdk-LIhN CAN_EDIT]
07:13 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ArFN/config.yml) doesn't exist.
07:13 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
07:13 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
07:13 INFO [databricks.labs.ucx.install] Fetching installations...
07:13 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
07:13 INFO [databricks.labs.ucx.install] Installing UCX v0.21.1+2720240404071318
07:13 INFO [databricks.labs.ucx.install] Creating dashboards...
07:13 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX  Assessment (Estimates)...
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 01_0_group_migration.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 01_0_group_migration.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_metastore_assignment.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_metastore_assignment.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_data_modeling.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_data_modeling.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 03_0_data_migration.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 03_0_data_migration.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX  Assessment (Main)...
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 10___data_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 10___data_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 15___storage_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 15___storage_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 40___last_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 40___last_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 20___compute_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 20___compute_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00___assessment_overview.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00___assessment_overview.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 05___findings_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 05___findings_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 30_0_job_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 30_0_job_summary.md because it's a text widget
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX  Assessment (Azure)...
07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX  Assessment (Interactive)...
07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_interactive.md because it's a text widget
07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_interactive.md because it's a text widget
07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_cluster_summary.md because it's a text widget
07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_cluster_summary.md because it's a text widget
07:14 DEBUG [databricks.labs.ucx.installer.workflows] Creating jobs from tasks in main
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
07:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
07:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=099-destroy-schema
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
07:14 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ArFN/README for the next steps.
07:14 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions
07:14 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 1003
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES deb7e6d4-9fee-4406-8353-81175f40fc22
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 5a7a9dbb-7ecc-44dd-899a-6c607e42a701
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES fec3caf7-9422-4478-9c73-73cdb89c7254
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 5e9cc236-94be-46f9-b024-f23c6808baac
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 032e9c49-7d7f-439b-89d9-a6e4414c5b12
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 9170e676-a4fc-4054-b1e8-12c8d76900ae
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES d511ab71-7afb-4b97-9559-273e9d7b431c
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 73341447-9631-4988-9528-57faf2e7f163
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ac1b6f9b-0874-4108-8387-6ba69d3ff22f
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 8bfa3072-c5c7-4467-b0cf-a2091db4cd7c
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 87eaed0f-51cd-4797-9934-25e3bc331e38
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 0042ed56-2066-428d-ae79-cd421da55683
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES dade8f79-d936-471f-93f1-10f90290fb3e
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 42930939-4653-48d2-8032-9125d27839ae
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES d642a3c8-99cc-448e-9aa6-aec8d0500b43
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES c0a65e16-a058-455d-9bc3-d76b0c38cec3
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES f2c415e2-5b69-49bd-b815-d7e9028ba6b9
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES bc583f7d-b8ad-4d5b-9a5a-95bd6c7487fa
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ab2bb26b-53a6-4ec9-9469-1a2302cc076c
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES b78cfab1-c5af-49f0-a584-39df74a756f7
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES eea197ea-659e-4432-8854-f268b212a445
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 1a854f7a-6949-407e-8d24-6cee3f17b198
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 65beece7-5275-4e51-a00b-01e6e4ed38a3
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES c99f1780-6559-4e6d-9c44-1e95f888d72c
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 1e126be1-f265-4ad9-8fcf-c867710916a1
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 34631189-4247-4d5b-9636-66388d3df1bb
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 72352c52-0f2f-4ed3-938d-c344db0606bf
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES dc5605f2-bdb4-447e-850e-d11025522a78
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ca19b20a-7359-4865-9c4a-c050e30fb71b
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES fd818da7-e055-463e-846f-a4b407e64578
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES b5cd5cb5-f0b3-482f-8ecd-7ef586a78750
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES f00ecb39-1b0b-4d5f-8ab0-9bb4de479444
07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 4d7e4ece-5e87-411b-8bdf-9c53da6e6840
07:14 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 970
07:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_Sucqg.permissions] found 970 new records for permissions
07:14 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table
07:14 INFO [databricks.labs.ucx.workspace_access.manager] Saved 970 to hive_metastore.ucx_Sucqg.permissions
07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 query permissions fixtures
07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing query permissions fixture: 8fd5438f-885d-4891-9a51-b0f83f280edf [user_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name sdk-LIhN CAN_EDIT]
07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 query fixtures
07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing query fixture: Query(can_edit=None, created_at='2024-04-04T07:13:13Z', data_source_id=None, description='TEST QUERY FOR UCX', id='8fd5438f-885d-4891-9a51-b0f83f280edf', is_archived=False, is_draft=False, is_favorite=False, is_safe=True, last_modified_by=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), last_modified_by_id=None, latest_query_data_id=None, name='ucx_query_QtkNM', options=QueryOptions(moved_to_trash_at=None, parameters=[]), parent='folders/2080761702917835', permission_tier=None, query='SELECT * FROM ucx_sqf64.ucx_t8asc', query_hash=None, run_as_role=<RunAsRole.OWNER: 'owner'>, tags=[], updated_at='2024-04-04T07:13:13Z', user=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), user_id=481119220561874, visualizations=[Visualization(created_at='2024-04-04T07:13:13Z', description='', id='cc56713a-5b7d-4636-9cc8-288b4fbcd564', name='Results', options={'version': 2}, type='TABLE', updated_at='2024-04-04T07:13:13Z')])
07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures
07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=<DataSourceFormat.DELTA: 'DELTA'>, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sqf64.ucx_t8asc', metastore_id=None, name='ucx_t8asc', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sqf64', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sqf64/ucx_t8asc', table_constraints=None, table_id=None, table_type=<TableType.MANAGED: 'MANAGED'>, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None)
07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures
07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sqf64', metastore_id=None, name='ucx_sqf64', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures
07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='sdk-LIhN', entitlements=[], external_id=None, groups=[], id='416372241323208', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[<GroupSchema.URN_IETF_PARAMS_SCIM_SCHEMAS_CORE_2_0_GROUP: 'urn:ietf:params:scim:schemas:core:2.0:Group'>])
07:14 INFO [databricks.labs.ucx.install] Deleting UCX v0.21.1+2720240404071437 from https://DATABRICKS_HOST
07:14 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_Sucqg
07:14 INFO [databricks.labs.ucx.install] Deleting jobs
07:14 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=572254520125435.
07:14 INFO [databricks.labs.ucx.install] Deleting assessment job_id=802233250386189.
07:14 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=1014375068723343.
07:14 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=405016109212080.
07:14 INFO [databricks.labs.ucx.install] Deleting 099-destroy-schema job_id=977666146705825.
07:14 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=431791413293262.
07:14 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=597836058225637.
07:14 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=282686432522251.
07:14 INFO [databricks.labs.ucx.install] Deleting cluster policy
07:14 INFO [databricks.labs.ucx.install] Deleting secret scope
07:14 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #14
@github-actions github-actions bot added the bug Something isn't working label Apr 4, 2024
@nfx
Copy link
Collaborator

nfx commented Apr 4, 2024

Already fixed

@nfx
Copy link
Collaborator

nfx commented Apr 4, 2024

Fixed in #1250

@nfx nfx closed this as completed Apr 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@nfx