Skip to content
This repository has been archived by the owner on Aug 26, 2022. It is now read-only.

v2.0.0a0
Compare
Choose a tag to compare
@hyunwoongko hyunwoongko released this 30 Jan 05:32
· 759 commits to master since this release
v2.0.0a0
b1854b3
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

New API

  • We paid homage to DeepSpeed. Now it's easier and simpler to use.
import oslo

model = oslo.initialize(model, config="oslo-config.json")

Add new models

  • Albert
  • Bert
  • Bart
  • T5
  • GPT2
  • GPTNeo
  • GPTJ
  • Electra
  • Roberta

Add document

Remove old pipeline parallelism, kernel fusion code

  • We'll refurbish them using the latest methods
    • Kernel fusion: AOTAutograd
    • Pipeline parallelism: Sagemaker PP
Assets 2
Loading