Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Decrease pre_merge_ci parallelism to 4 and reordering time-consuming tests #3455

Merged
merged 8 commits into from
Sep 13, 2021

Conversation

pxLi
Copy link
Collaborator

@pxLi pxLi commented Sep 13, 2021

Signed-off-by: Peixin Li pxli@nyu.edu

we added more test cases which made the mem usage for ci_2 in an unstable state.
Decrease it to 4 from 5, and will keep monitoring this.

Rebalance ci_1 and ci_2 to leave space for 320 UT

Also put expensive test cases to the head of xdist worker queue to avoid some cases got assigned to worker too late and increase the total time. Saved ~5-10 mins w/ lower mem usage (10-20% off)

Signed-off-by: Peixin Li <pxli@nyu.edu>
@pxLi pxLi added the test Only impacts tests label Sep 13, 2021
@pxLi
Copy link
Collaborator Author

pxLi commented Sep 13, 2021

build

@pxLi pxLi force-pushed the pre_merge_ci_2_parallel-4 branch from f8e91b9 to 140f334 Compare September 13, 2021 02:53
@pxLi
Copy link
Collaborator Author

pxLi commented Sep 13, 2021

build

@pxLi pxLi force-pushed the pre_merge_ci_2_parallel-4 branch from 5fba2d3 to 7d74179 Compare September 13, 2021 04:53
@pxLi
Copy link
Collaborator Author

pxLi commented Sep 13, 2021

build

@pxLi pxLi changed the title Decrease pre_merge_ci parallelism to 4 Decrease pre_merge_ci parallelism to 4 and reordering time-consuming tests Sep 13, 2021
@pxLi
Copy link
Collaborator Author

pxLi commented Sep 13, 2021

build

@pxLi pxLi force-pushed the pre_merge_ci_2_parallel-4 branch from 7d853db to 3f93512 Compare September 13, 2021 05:20
@pxLi
Copy link
Collaborator Author

pxLi commented Sep 13, 2021

build

@pxLi
Copy link
Collaborator Author

pxLi commented Sep 13, 2021

build

@pxLi
Copy link
Collaborator Author

pxLi commented Sep 13, 2021

build

zhanga5
zhanga5 previously approved these changes Sep 13, 2021
@pxLi pxLi merged commit 91e3d9a into NVIDIA:branch-21.10 Sep 13, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
test Only impacts tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants