Skip to content

Releases: bwconrad/soft-moe

0.0.1

22 Aug 20:01
Compare
Choose a tag to compare

Initial release.

  • Add SoftMoEVisionTransformer class.
  • Add default ViT architectures soft_moe_vit_tiny, soft_moe_vit_small, soft_moe_vit_base, soft_moe_vit_large and soft_moe_vit_huge functions.
  • Add SoftMoELayerWrapper class.

Full Changelog: https://github.com/bwconrad/soft-moe/commits/0.0.1