Skip to content

Unified Collective Communication, Version 1.0.0 - RC2

Pre-release
Pre-release
Compare
Choose a tag to compare
@manjugv manjugv released this 27 Jan 19:04
· 4 commits to v1.0.x since this release
v1.0.0-rc2
c5d3ee5
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

1.0.0

Features

API

  • Added Avg reduce operation
  • Added nonblocking team destroy option
  • Added user-defined datatype definitions
  • Added Bfloat16 type
  • Clarify semantics of core abstractions including teams and context
  • Added timeout option

Core

  • Added coll scoring and selection support
  • Added support for Triggered collectives
  • Added support for timeouts in collectives
  • Added support for team create without ep in post
  • Added support for multithreaded context progress
  • Added support for nonblocking team destroy

CL

  • Added support for hierarchical collectives
  • Added support for hierarchical allreduce collective operation
  • Added support for collectives based on one-sided communication routines

TL

  • Added SHARP TL

UCP

  • Added Bcast SAG algorithm for large messages
  • Added Knomial based reduce algorithm
  • Making allgather and alltoall agree with the API
  • Added SRA knomial allreduce algorithm
  • Added pairwise alltoall and alltoallv algorithms
  • Added allgather and allgatherv ring algorithms
  • Added support for collective operations based on one-sided semantics
  • Added support for alltoall with one-sided transfer semantics
  • Bug fixes

SHARP

  • Added support for switch-based hardware collectives (SHARP)

NCCL

  • Add support for NCCL allreduce, alltoall, alltoallv, barrier, reduce, reduce
    scatter, bcast, allgather and allgatherv

Tests

  • Updated tests to test the newly added algorithms and operations
Assets 2
Loading