Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DOC] document databricks init script required for UCX #3768

Closed
abellina opened this issue Oct 7, 2021 · 0 comments · Fixed by #4233
Closed

[DOC] document databricks init script required for UCX #3768

abellina opened this issue Oct 7, 2021 · 0 comments · Fixed by #4233
Assignees
Labels
documentation Improvements or additions to documentation shuffle things that impact the shuffle plugin

Comments

@abellina
Copy link
Collaborator

abellina commented Oct 7, 2021

We have a databricks RapidsShuffleManager shim, and we also have been able to run with UCX in databricks, but the documentation hasn't been updated to both expose the 301db and 311db settings, and include the documentation for the init script required to install UCX in that environment.

Note this would be for the user-space parts to get the shuffle manager to work, not necessarily to run with RoCE/Infiniband (I know Azure supports that, but I do not know how common a setup that is).

@abellina abellina added documentation Improvements or additions to documentation ? - Needs Triage Need team to review and classify shuffle things that impact the shuffle plugin labels Oct 7, 2021
@Salonijain27 Salonijain27 removed the ? - Needs Triage Need team to review and classify label Oct 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation shuffle things that impact the shuffle plugin
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants