Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove timeout from RayCluster CR apply; bump CB timeout to mitigate stockouts #576

Merged
merged 1 commit into from
Apr 9, 2024

Conversation

artemvmin
Copy link
Contributor

@artemvmin artemvmin commented Apr 9, 2024

RayCluster apply takes O(seconds). The actual ray worker deployment is done asynchronously by the ray operator.

Fixes #520

@artemvmin artemvmin requested a review from imreddy13 April 9, 2024 22:48
@artemvmin artemvmin changed the title Remove timeout from RayCluster CR apply Remove timeout from RayCluster CR apply; bump CB timeout to account for stockouts Apr 9, 2024
RayCluster apply takes O(seconds). The actual ray worker deployment is done asynchronously by the ray operator.
@artemvmin artemvmin force-pushed the remove-ray-cluster-timeout branch from 6d12f96 to 50bb81d Compare April 9, 2024 22:54
@artemvmin artemvmin changed the title Remove timeout from RayCluster CR apply; bump CB timeout to account for stockouts Remove timeout from RayCluster CR apply; bump CB timeout to mitigate stockouts Apr 9, 2024
@artemvmin
Copy link
Contributor Author

/gcbrun

@artemvmin artemvmin enabled auto-merge (squash) April 9, 2024 22:57
@artemvmin artemvmin merged commit 51ef4ca into main Apr 9, 2024
8 checks passed
artemvmin added a commit to artemvmin/ai-on-gke that referenced this pull request Apr 10, 2024
…stockouts (GoogleCloudPlatform#576)

Remove timeout from RayCluster CR apply

RayCluster apply takes O(seconds). The actual ray worker deployment is done asynchronously by the ray operator.
artemvmin added a commit to artemvmin/ai-on-gke that referenced this pull request Apr 10, 2024
…stockouts (GoogleCloudPlatform#576)

Remove timeout from RayCluster CR apply

RayCluster apply takes O(seconds). The actual ray worker deployment is done asynchronously by the ray operator.
kfswain pushed a commit that referenced this pull request Apr 15, 2024
…stockouts (#576)

Remove timeout from RayCluster CR apply

RayCluster apply takes O(seconds). The actual ray worker deployment is done asynchronously by the ray operator.
artemvmin added a commit that referenced this pull request Apr 16, 2024
Remove timeout from RayCluster CR apply; bump CB timeout to mitigate stockouts (#576)

RayCluster apply takes O(seconds). The actual ray worker deployment is done asynchronously by the ray operator.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

CI flakes sometimes when waiting to pull Ray images
2 participants