Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run testDeleteRowsConcurrently sequentially for better reliability #23916

Merged
merged 1 commit into from
Oct 25, 2024

Conversation

pajaks
Copy link
Member

@pajaks pajaks commented Oct 25, 2024

Description

Fixes: #21862

Currently test repetition runs in parallel which can cause query exceed 20s timeout, it's especially visible in case of Glue tests.

Analysis showed that most time is spend on:

  1. Waiting for execution to be scheduled. For some queries time between beginMerge and finishMerge can vary from 3s to 16s.
  2. Time of glueClient.updateTable, when executed in parallel and failing update throws ConcurrentModificationException, is about 10s

If query which consumed time on finishMerge also encounters ConcurrentModificationException, 20s is exceeded and test fails.

Running tests sequentially removes first problem and makes test more reliable.

Additional context and related issues

Release notes

(x) This is not user-visible or is docs only, and no release notes are required.
( ) Release notes are required. Please propose a release note for me.
( ) Release notes are required, with the following suggested text:

## Section
* Fix some things. ({issue}`issuenumber`)

@cla-bot cla-bot bot added the cla-signed label Oct 25, 2024
@github-actions github-actions bot added the iceberg Iceberg connector label Oct 25, 2024
@ebyhr
Copy link
Member

ebyhr commented Oct 25, 2024

/test-with-secrets sha=8548d1406907b2d1952c2b2eadc12d5f0f47cd3b

Copy link

The CI workflow run with tests that require additional secrets has been started: https://github.com/trinodb/trino/actions/runs/11515325100

@ebyhr ebyhr merged commit 06b6786 into trinodb:master Oct 25, 2024
33 of 41 checks passed
@github-actions github-actions bot added this to the 464 milestone Oct 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed iceberg Iceberg connector
Development

Successfully merging this pull request may close these issues.

Flaky Iceberg tests: testDeleteRowsConcurrently
2 participants