-
Notifications
You must be signed in to change notification settings - Fork 47
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
**Description** Add release blog for v0.3.0 **Major Revision** - Add release blog for v0.3.0 - Change version number in `msamp/__init__.py` - Add v0.3.0 in docker images
- Loading branch information
Showing
6 changed files
with
46 additions
and
7 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1 +1 @@ | ||
rules "~MD013", "~MD033", "~MD046", "~MD034" | ||
rules "~MD013", "~MD033", "~MD046", "~MD034", "~MD002" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,37 @@ | ||
--- | ||
slug: release-msamp-v0.3 | ||
title: Releasing MS-AMP v0.3 | ||
author: Yuxiang Yang | ||
author_title: MS-AMP Team | ||
author_url: https://github.com/tocean | ||
tags: [MS-AMP, announcement, release] | ||
--- | ||
|
||
We are very happy to announce that **MS-AMP 0.3.0 version** is officially released today! | ||
|
||
You can install and try MS-AMP by following [Getting Started Tutorial](https://azure.github.io/MS-AMP/docs/getting-started/installation). | ||
|
||
## MS-AMP 0.3.0 Release Notes | ||
|
||
### MS-AMP Improvements | ||
|
||
- Integrate latest Transformer Engine into MS-AMP | ||
- Integrate with latest Megatron-LM | ||
- Add a website for MS-AMP and improve documents | ||
- Add custom DistributedDataParallel which supports FP8 and computation/computation overlap | ||
- Refactor code in dist_op module | ||
- Support UT for distributed testing | ||
- Integrate with MSCCL | ||
|
||
### MS-AMP-Examples Improvements | ||
|
||
- Support pretrain GPT-3 with Megatron-LM and MS-AMP | ||
- Provide a tool to print the traffic per second of NVLINK and InfiniBand | ||
- Print tflops and throughput metrics in all the examples | ||
|
||
### Document Improvements | ||
|
||
- Add performance number in `Introduction` page | ||
- Enhance `Usage` page and `Optimization Level` page | ||
- Add `Container Images` page | ||
- Add `Developer Guide` section |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters