Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[MoE] Moe apis #40895

Merged
merged 47 commits into from
Mar 29, 2022
Merged

[MoE] Moe apis #40895

merged 47 commits into from
Mar 29, 2022

Commits on Mar 23, 2022

  1. add random routing op 

    add _random_routing api in utils

add random routing ut
    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    713bdbe View commit details
    Browse the repository at this point in the history

  2. # This is a combination of 10 commits. 

    # The first commit's message is:
add expert count op

add ut for expert_count

# This is the 2nd commit message:

update UT only for cuda

# This is the 3rd commit message:

fix for rocm

# This is the 4th commit message:

update ut

# This is the 5th commit message:

add moe module

# This is the 6th commit message:

add expert count op

add ut for expert_count

# This is the 7th commit message:

update UT only for cuda

# This is the 8th commit message:

update ut

# This is the 9th commit message:

add moe module

# This is the 10th commit message:

make expert count private
    @liyagit21 @sljlp
    liyagit21 authored and sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    e5e0d3a View commit details
    Browse the repository at this point in the history

  3. add assign pos op

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    cda9c51 View commit details
    Browse the repository at this point in the history

  4. fix upper num name

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    7a782d3 View commit details
    Browse the repository at this point in the history

  5. add api _assign pos

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    db110c9 View commit details
    Browse the repository at this point in the history

  6. add ut for assign pos op

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    f310a54 View commit details
    Browse the repository at this point in the history

  7. update date

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    f3ff5f6 View commit details
    Browse the repository at this point in the history

  8. add op about moe gate 

    update utils

add limit by capacity op

add ut for limit_by_capacity

add ut for prune_gate_by_capacity

add ut for limit_by_capacity

add ut for prune_gate_by_capacity
    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    8968bf1 View commit details
    Browse the repository at this point in the history

  9. fix for win

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    40a8a50 View commit details
    Browse the repository at this point in the history

  10. fix bugs in test_limit_by_capacity_op

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    37950fa View commit details
    Browse the repository at this point in the history

  11. update ut

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    83a1361 View commit details
    Browse the repository at this point in the history

  12. update for test (timeout)

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    7f704c7 View commit details
    Browse the repository at this point in the history

  13. fix ut

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    7db0bb6 View commit details
    Browse the repository at this point in the history

  14. update

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    441ea29 View commit details
    Browse the repository at this point in the history

  15. update(fix) ut for win

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    b636217 View commit details
    Browse the repository at this point in the history

  16. moe apis in incubate

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    79be77c View commit details
    Browse the repository at this point in the history

  17. # This is a combination of 10 commits. 

    # The first commit's message is:
add expert count op

add ut for expert_count

# This is the 2nd commit message:

update UT only for cuda

# This is the 3rd commit message:

fix for rocm

# This is the 4th commit message:

update ut

# This is the 5th commit message:

add moe module

# This is the 6th commit message:

add expert count op

add ut for expert_count

# This is the 7th commit message:

update UT only for cuda

# This is the 8th commit message:

update ut

# This is the 9th commit message:

add moe module

# This is the 10th commit message:

make expert count private
    @liyagit21 @sljlp
    liyagit21 authored and sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    44f1064 View commit details
    Browse the repository at this point in the history

  18. add assign pos op

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    6f46b07 View commit details
    Browse the repository at this point in the history

  19. fix upper num name

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    a300850 View commit details
    Browse the repository at this point in the history

  20. add api _assign pos

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    f8b1852 View commit details
    Browse the repository at this point in the history

  21. add ut for assign pos op

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    c0f2701 View commit details
    Browse the repository at this point in the history

  22. update date

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    2e464c2 View commit details
    Browse the repository at this point in the history

  23. fix for win

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    bb266f8 View commit details
    Browse the repository at this point in the history

  24. update for test (timeout)

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    53e494d View commit details
    Browse the repository at this point in the history

  25. fix ut

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    3dd05d1 View commit details
    Browse the repository at this point in the history

  26. update

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    d4c0cf5 View commit details
    Browse the repository at this point in the history

  27. fix ut for number count

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    1d19ed0 View commit details
    Browse the repository at this point in the history

  28. Merge branch 'assign_pos_op' into limit_by_capacity

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    d517d5e View commit details
    Browse the repository at this point in the history

  29. Merge branch 'limit_by_capacity' into moe_apis

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    04f39ef View commit details
    Browse the repository at this point in the history

  30. Merge branch 'random_routing' into moe_apis

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    f00621b View commit details
    Browse the repository at this point in the history

  31. add apis and utils

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    00054fc View commit details
    Browse the repository at this point in the history

  32. add gate apis

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    a7d9506 View commit details
    Browse the repository at this point in the history

  33. add moe and grad clip apis

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    cfc9fc9 View commit details
    Browse the repository at this point in the history

  34. update moe apis

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    913ec54 View commit details
    Browse the repository at this point in the history

  35. add ops for moe gate

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    e95b2f7 View commit details
    Browse the repository at this point in the history

  36. fix

    @sljlp
    sljlp committed Mar 23, 2022
    Configuration menu
    Copy the full SHA
    6df2be4 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2022

  1. Merge branch 'limit_by_capacity' into moe_apis

    @sljlp
    sljlp committed Mar 24, 2022
    Configuration menu
    Copy the full SHA
    d079246 View commit details
    Browse the repository at this point in the history

  2. update for base moe layer api

    @sljlp
    sljlp committed Mar 24, 2022
    Configuration menu
    Copy the full SHA
    2945176 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2022

  1. add random routing op 

    add _random_routing api in utils

add random routing ut
    @sljlp
    sljlp committed Mar 25, 2022
    Configuration menu
    Copy the full SHA
    0e97c7c View commit details
    Browse the repository at this point in the history

  2. fix for dygraph

    @sljlp
    sljlp committed Mar 25, 2022
    Configuration menu
    Copy the full SHA
    d94fd57 View commit details
    Browse the repository at this point in the history

  3. update with ranodm routing

    @sljlp
    sljlp committed Mar 25, 2022
    Configuration menu
    Copy the full SHA
    39926a0 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'random_routing' into limit_by_capacity

    @sljlp
    sljlp committed Mar 25, 2022
    Configuration menu
    Copy the full SHA
    e56d26c View commit details
    Browse the repository at this point in the history

  5. update

    @sljlp
    sljlp committed Mar 25, 2022
    Configuration menu
    Copy the full SHA
    0e65fe8 View commit details
    Browse the repository at this point in the history

  6. fix ut for limit by capacity

    @sljlp
    sljlp committed Mar 25, 2022
    Configuration menu
    Copy the full SHA
    3bce091 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'limit_by_capacity' into moe_apis

    @sljlp
    sljlp committed Mar 25, 2022
    Configuration menu
    Copy the full SHA
    3ac3ff2 View commit details
    Browse the repository at this point in the history

  8. update

    @sljlp
    sljlp committed Mar 25, 2022
    Configuration menu
    Copy the full SHA
    7d49289 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'limit_by_capacity' into moe_apis

    @sljlp
    sljlp committed Mar 25, 2022
    Configuration menu
    Copy the full SHA
    02f777d View commit details
    Browse the repository at this point in the history