Skip to content

DeepSpeed v0.2.0
Compare
Choose a tag to compare
@jeffra jeffra released this 16 Jun 06:32
· 2444 commits to master since this release
v0.2.0
96c4daa
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

DeepSpeed 0.2.0 Release Notes

Features

  • ZeRO-1 with reduce scatter
  • ZeRO-2
  • Transformer kernels
  • Various bug fixes and usability improvements
Assets 2
Loading