Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SETUP] Set max timeout when downloading nvidia dependencies #3414

Merged
merged 2 commits into from
Mar 19, 2024
Merged

Conversation

nhat-nguyen
Copy link
Collaborator

We have experienced intermittent forever hangs during triton installation, specifically when downloading the nvidia dependencies. This developer has found that request.urlopen not having a set timeout can potentially lead to this issue: mesonbuild/meson#4087
I have set the timeout to 5 minutes which should be enough to download each individual dependency while also preventing the forever hang.

@nhat-nguyen nhat-nguyen requested a review from ptillet as a code owner March 19, 2024 19:23
@nhat-nguyen nhat-nguyen changed the title Set max timeout when downloading nvidia dependencies [SETUP] Set max timeout when downloading nvidia dependencies Mar 19, 2024
Copy link
Collaborator

@jlebar jlebar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@jlebar jlebar enabled auto-merge (squash) March 19, 2024 19:27
@jlebar jlebar merged commit 124bc43 into main Mar 19, 2024
5 checks passed
@jlebar jlebar deleted the nhat/timeout branch March 19, 2024 21:17
karupayun pushed a commit to openxla/triton that referenced this pull request Apr 3, 2024
…lang#3414)

We have experienced intermittent forever hangs during triton
installation, specifically when downloading the nvidia dependencies.
This developer has found that `request.urlopen` not having a set timeout
can potentially lead to this issue:
mesonbuild/meson#4087
I have set the timeout to 5 minutes which should be enough to download
each individual dependency while also preventing the forever hang.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants