Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support column split in gpu hist updater #9384

Merged
merged 43 commits into from
Aug 31, 2023

Conversation

rongou
Copy link
Contributor

@rongou rongou commented Jul 14, 2023

No description provided.

@rongou
Copy link
Contributor Author

rongou commented Jul 14, 2023

@trivialfis I'm working on enabling column-split with the gpu hist tree method. Only added some tests here, but they seem to hang on some cuda calls. Any idea on how to debug this? Do you see anything obviously wrong?

@trivialfis
Copy link
Member

@rongou GPU doesn't support multi-target yet.

@rongou rongou marked this pull request as draft August 22, 2023 23:24
@rongou rongou marked this pull request as ready for review August 29, 2023 19:15
@rongou rongou changed the title [WIP] Support column split in gpu hist updater Support column split in gpu hist updater Aug 29, 2023
@rongou
Copy link
Contributor Author

rongou commented Aug 29, 2023

@trivialfis I think this is finally working. Please take a look. Thanks!

Copy link
Member

@trivialfis trivialfis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me!

Would you like to produce a document that briefly introduces how everything works with column split in the future?

@rongou
Copy link
Contributor Author

rongou commented Aug 30, 2023

Would you like to produce a document that briefly introduces how everything works with column split in the future?

Yes probably should create a tutorial.

@trivialfis trivialfis merged commit 9bab06c into dmlc:master Aug 31, 2023
@rongou rongou deleted the colsplit-gpu-hist branch September 25, 2023 16:40
@trivialfis
Copy link
Member

trivialfis commented Jul 3, 2024

For some reason, this PR has optimized the GPU hist with the Higgs dataset for about 20 percent improvement, tested with both RTX8000 and 4070 ti super.

@trivialfis
Copy link
Member

NVM, git bisect is incorrect.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants