Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GPU Active Messages for all buffer types #2926

Merged

Conversation

abellina
Copy link
Collaborator

This undoes this revert.

The change is pretty much the same, but I had to fix diffs as there were conflicts with the UCPListener change.

I upgrade UCX to 1.11.0-rc3 in this change also, and handle:

Once JUCX 1.11 is published with the change to setAmRecvHandler, the change would be to bring this back, and also set: UCP_AM_FLAG_PERSISTENT_DATA (for the use-after-callback pattern) and UCP_AM_FLAG_WHOLE_MSG (to prevent UCX to call us multiple times with eager fragments in the future).

I also tested #2892, and I can see that the issue is not reproducible with plain active messages (we no longer use tags).

Updating the docs for UCX 1.11.0 is tracked here: #2925. I am hoping we can fix the docs once 1.11.0 is not a release candidate.

Closes #2807.

Signed-off-by: Alessandro Bellina <abellina@nvidia.com>
@abellina abellina force-pushed the shuffle/gpu_active_messages_bring_back branch from d4625e4 to d874dcd Compare July 13, 2021 21:39
@jlowe jlowe added the shuffle things that impact the shuffle plugin label Jul 13, 2021
@jlowe
Copy link
Member

jlowe commented Jul 13, 2021

build

@abellina abellina merged commit cc556b6 into NVIDIA:branch-21.08 Jul 14, 2021
@abellina abellina deleted the shuffle/gpu_active_messages_bring_back branch July 14, 2021 17:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
shuffle things that impact the shuffle plugin
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Use UCP_AM_FLAG_WHOLE_MSG and UCP_AM_FLAG_PERSISTENT_DATA for receive handlers
2 participants