Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TL/UCP: remove memcpy in last SRA step #743

Merged
merged 1 commit into from
Aug 11, 2023

Conversation

Sergei-Lebedev
Copy link
Contributor

What

Avoid memory copy in last step of reduce scatter.

How ?

In last step of reduce scatter local reduce operation is split into strided reduce of received data and reduce of result of that operation and local data.

@vspetrov
Copy link
Collaborator

Discussed over phone with Sergey. He is to check if the change works correctly in the case when count % comm_size != 0.

@Sergei-Lebedev Sergei-Lebedev force-pushed the topic/sra_opt branch 2 times, most recently from 3775da3 to eb826bc Compare May 19, 2023 10:57
@Sergei-Lebedev
Copy link
Contributor Author

Discussed over phone with Sergey. He is to check if the change works correctly in the case when count % comm_size != 0.

@vspterov, I've changed the way offsets are calculated please have a look

@Sergei-Lebedev Sergei-Lebedev merged commit cfad103 into openucx:master Aug 11, 2023
@Sergei-Lebedev Sergei-Lebedev deleted the topic/sra_opt branch August 11, 2023 06:42
janjust pushed a commit to janjust/ucc that referenced this pull request Jan 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants