Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI Failure (failed to wait until status condition) in PartitionBalancerTest.test_maintenance_mode #15790

Closed
vbotbuildovich opened this issue Dec 20, 2023 · 14 comments
Labels
area/controller auto-triaged used to know which issues have been opened from a CI job ci-failure

Comments

@vbotbuildovich
Copy link
Collaborator

vbotbuildovich commented Dec 20, 2023

https://buildkite.com/redpanda/redpanda/builds/43068

Module: rptest.tests.partition_balancer_test
Class: PartitionBalancerTest
Method: test_maintenance_mode
Arguments: {
    "kill_same_node": false
}
test_id:    PartitionBalancerTest.test_maintenance_mode
status:     FAIL
run time:   174.617 seconds

TimeoutError('failed to wait until status condition')
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 269, in run_test
    return self.test_context.function(self.test)
  File "/usr/local/lib/python3.10/dist-packages/ducktape/mark/_mark.py", line 481, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/root/tests/rptest/services/cluster.py", line 82, in wrapped
    r = f(self, *args, **kwargs)
  File "/root/tests/rptest/tests/partition_balancer_test.py", line 973, in test_maintenance_mode
    self.wait_until_ready(expected_unavailable_node=to_kill)
  File "/root/tests/rptest/tests/partition_balancer_test.py", line 202, in wait_until_ready
    return self.wait_until_status(predicate, timeout_sec=timeout_sec)
  File "/root/tests/rptest/tests/partition_balancer_test.py", line 179, in wait_until_status
    return wait_until_result(
  File "/root/tests/rptest/util.py", line 90, in wait_until_result
    wait_until(wrapped_condition, *args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/ducktape/utils/util.py", line 57, in wait_until
    raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception
ducktape.errors.TimeoutError: failed to wait until status condition

JIRA Link: CORE-1683

@vbotbuildovich vbotbuildovich added auto-triaged used to know which issues have been opened from a CI job ci-failure labels Dec 20, 2023
@dotnwat dotnwat changed the title CI Failure (key symptom) in PartitionBalancerTest.test_maintenance_mode CI Failure (failed to wait until status condition) in PartitionBalancerTest.test_maintenance_mode Dec 20, 2023
@dotnwat
Copy link
Member

dotnwat commented Dec 20, 2023

It looks like the error for the timeout is too generic and could be updated so that future errors of the same type provide more information in the error string.

@vbotbuildovich
Copy link
Collaborator Author

@vbotbuildovich
Copy link
Collaborator Author

@vbotbuildovich
Copy link
Collaborator Author

@vbotbuildovich
Copy link
Collaborator Author

@vbotbuildovich
Copy link
Collaborator Author

@vbotbuildovich
Copy link
Collaborator Author

@vbotbuildovich
Copy link
Collaborator Author

2 similar comments
@vbotbuildovich
Copy link
Collaborator Author

@vbotbuildovich
Copy link
Collaborator Author

@piyushredpanda
Copy link
Contributor

Closing older-bot-filed CI issues as we transition to a more reliable system.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/controller auto-triaged used to know which issues have been opened from a CI job ci-failure
Projects
None yet
Development

No branches or pull requests

3 participants