DeepSpeed v0.12.0

jeffra released this 03 Nov 22:36

· 721 commits to master since this release

09834bb

New features

DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference

What's Changed

Update version.txt after 0.11.2 release by @mrwyattii in #4609
Pin transformers in nv-inference by @loadams in #4606
DeepSpeed-FastGen by @cmikeh2 in #4604
DeepSpeed-FastGen blog by @jeffra in #4607

Full Changelog: v0.11.2...v0.12.0

Contributors

jeffra, cmikeh2, and 2 other contributors

Assets 2