Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CT-2636] TestVersionedModels::test_pp_versioned_models is flaky #7781

Open
Tracked by #7808
MichelleArk opened this issue Jun 5, 2023 · 6 comments · Fixed by #8150 or #8193
Open
Tracked by #7808

[CT-2636] TestVersionedModels::test_pp_versioned_models is flaky #7781

MichelleArk opened this issue Jun 5, 2023 · 6 comments · Fixed by #8150 or #8193
Labels
backport 1.5.latest flaky_test tech_debt Behind-the-scenes changes, with little direct impact on end-user functionality

Comments

@MichelleArk
Copy link
Contributor

Example failing test run: https://github.com/dbt-labs/dbt-core/actions/runs/5178505585/jobs/9330058721?pr=7768

Relevant Logs:

        # update versions schema.yml block - latest_version from 2 to 1
        write_file(
            models_versions_updated_schema_yml, project.project_root, "models", "schema.yml"
        )
>       results, log_output = run_dbt_and_capture(
            ["--partial-parse", "--log-format", "json", "run"]
        )

D:\a\dbt-core\dbt-core\tests\functional\partial_parsing\test_partial_parsing.py:341: 
        if expect_pass is not None:
>           assert res.success == expect_pass, "dbt exit state did not match expected"
E           AssertionError: dbt exit state did not match expected

d:\a\dbt-core\dbt-core\core\dbt\tests\util.py:105: AssertionError
stdout_log: {"data": {"msg": "  relation \"test16859771223328142563_test_partial_parsing.model_one_downstream\" does not exist"}, "info": {"category": "", "code": "Z029", "extra": {}, "invocation_id": "9e30ed11-b91f-4609-8dd0-a82ab93b96ba", "level": "error", "msg": "  relation \"test16859771223328142563_test_partial_parsing.model_one_downstream\" does not exist", "name": "AfterFirstRunResultError", "pid": 6128, "thread": "MainThread", "ts": "2023-06-05T14:58:50.611377Z"}}
@github-actions github-actions bot changed the title test_partial_parsing.py::TestVersionedModels::test_pp_versioned_models is flaky [CT-2636] test_partial_parsing.py::TestVersionedModels::test_pp_versioned_models is flaky Jun 5, 2023
@MichelleArk MichelleArk changed the title [CT-2636] test_partial_parsing.py::TestVersionedModels::test_pp_versioned_models is flaky [CT-2636] TestVersionedModels::test_pp_versioned_models is flaky Jun 7, 2023
@jtcohen6 jtcohen6 added the tech_debt Behind-the-scenes changes, with little direct impact on end-user functionality label Jun 12, 2023
@dbeatty10
Copy link
Contributor

@dbeatty10
Copy link
Contributor

An another example:
https://github.com/dbt-labs/dbt-core/actions/runs/5324997604/jobs/9645095748

@emmyoop
Copy link
Member

emmyoop commented Jul 12, 2023

Tested with Flaky Tester and failed 3/100 runs on Python 3.8/windows

@emmyoop emmyoop self-assigned this Jul 12, 2023
@emmyoop
Copy link
Member

emmyoop commented Jul 17, 2023

The test fails in the middle. This happens when run as part of the suite or when run by itself.

@emmyoop emmyoop removed their assignment Jul 17, 2023
@gshank gshank self-assigned this Jul 18, 2023
@gshank
Copy link
Contributor

gshank commented Jul 19, 2023

In the test run that I looked at the sequence of events is:

  • create view ...model_one_downstream__dbt_tmp
  • rename model_one_downstream to model_one_downstream__dbt_backup
  • fails with "model_one_downstream" does not exist

@MichelleArk
Copy link
Contributor Author

@MichelleArk MichelleArk reopened this Mar 19, 2024
@gshank gshank removed their assignment Mar 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 1.5.latest flaky_test tech_debt Behind-the-scenes changes, with little direct impact on end-user functionality
Projects
None yet
5 participants