Skip to content

Commit

Permalink
Add release blog for v0.3.0 (#124)
Browse files Browse the repository at this point in the history
**Description**
Add release blog for v0.3.0

**Major Revision**
- Add release blog for v0.3.0
- Change version number in `msamp/__init__.py`
- Add v0.3.0 in docker images
  • Loading branch information
tocean authored Nov 6, 2023
1 parent 4e2de18 commit e3e6885
Show file tree
Hide file tree
Showing 6 changed files with 46 additions and 7 deletions.
2 changes: 1 addition & 1 deletion .mdlrc
Original file line number Diff line number Diff line change
@@ -1 +1 @@
rules "~MD013", "~MD033", "~MD046", "~MD034"
rules "~MD013", "~MD033", "~MD046", "~MD034", "~MD002"
4 changes: 3 additions & 1 deletion docs/user-tutorial/container-images.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ import TabItem from '@theme/TabItem';

MS-AMP provides a set of OCI-compliant container images, which are hosted on and [GitHub Container Registry](https://github.com/azure/MS-AMP/pkgs/container/msamp).

You can use MS-AMP image by `ghcr.io/microsoft/msamp:${tag}`, available tags are listed below for all stable versions.
You can use MS-AMP image by `ghcr.io/azure/msamp:${tag}`, available tags are listed below for all stable versions.

## Stable tagged versions

Expand All @@ -25,6 +25,8 @@ You can use MS-AMP image by `ghcr.io/microsoft/msamp:${tag}`, available tags are

| Tag | Description |
|-------------------|------------------------------------|
| v0.3.0-cuda12.1 | MS-AMP v0.3.0 with CUDA 12.1 |
| v0.3.0-cuda11.8 | MS-AMP v0.3.0 with CUDA 11.8 |
| v0.2.0-cuda12.1 | MS-AMP v0.2.0 with CUDA 12.1 |
| v0.2.0-cuda11.8 | MS-AMP v0.2.0 with CUDA 11.8 |

Expand Down
2 changes: 1 addition & 1 deletion msamp/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -94,6 +94,6 @@ def initialize(model, optimizer=None, opt_level='O1'): # noqa: C901
return cast_model, cast_optimizer


__version__ = '0.2.0'
__version__ = '0.3.0'
__author__ = 'Microsoft'
__all__ = ['clip_grad_norm_', 'initialize']
6 changes: 3 additions & 3 deletions website/blog/2023-07-20-release-0-2.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,9 +11,9 @@ We are very happy to announce that **MS-AMP 0.2.0 version** is officially releas

You can install and try MS-AMP by following [Getting Started Tutorial](https://azure.github.io/MS-AMP/docs/getting-started/installation).

# MS-AMP 0.2.0 Release Notes
## MS-AMP 0.2.0 Release Notes

## MS-AMP Improvements
### MS-AMP Improvements

- Add O3 optimization for supporting FP8 in distributed training frameworks
- Support ScalingTensor in functional.linear
Expand All @@ -24,7 +24,7 @@ You can install and try MS-AMP by following [Getting Started Tutorial](https://a
- Add performance result and TE result in homepage
- Cache TE build in pipeline

## MS-AMP-Examples Improvements
### MS-AMP-Examples Improvements

Add 3 examples using MS-AMP:

Expand Down
37 changes: 37 additions & 0 deletions website/blog/2023-11-06-release-0-3.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
---
slug: release-msamp-v0.3
title: Releasing MS-AMP v0.3
author: Yuxiang Yang
author_title: MS-AMP Team
author_url: https://github.com/tocean
tags: [MS-AMP, announcement, release]
---

We are very happy to announce that **MS-AMP 0.3.0 version** is officially released today!

You can install and try MS-AMP by following [Getting Started Tutorial](https://azure.github.io/MS-AMP/docs/getting-started/installation).

## MS-AMP 0.3.0 Release Notes

### MS-AMP Improvements

- Integrate latest Transformer Engine into MS-AMP
- Integrate with latest Megatron-LM
- Add a website for MS-AMP and improve documents
- Add custom DistributedDataParallel which supports FP8 and computation/computation overlap
- Refactor code in dist_op module
- Support UT for distributed testing
- Integrate with MSCCL

### MS-AMP-Examples Improvements

- Support pretrain GPT-3 with Megatron-LM and MS-AMP
- Provide a tool to print the traffic per second of NVLINK and InfiniBand
- Print tflops and throughput metrics in all the examples

### Document Improvements

- Add performance number in `Introduction` page
- Enhance `Usage` page and `Optimization Level` page
- Add `Container Images` page
- Add `Developer Guide` section
2 changes: 1 addition & 1 deletion website/docusaurus.config.js
Original file line number Diff line number Diff line change
Expand Up @@ -91,7 +91,7 @@ module.exports = {
announcementBar: {
id: 'supportus',
content:
'📢 <a href="https://azure.github.io/MS-AMP/blog/release-msamp-v0.2">v0.2.0</a> has been released! ' +
'📢 <a href="https://azure.github.io/MS-AMP/blog/release-msamp-v0.3">v0.3.0</a> has been released! ' +
'⭐️ If you like MS-AMP, give it a star on <a target="_blank" rel="noopener noreferrer" href="https://github.com/Azure/MS-AMP">GitHub</a>! ⭐️',
},
algolia: {
Expand Down

0 comments on commit e3e6885

Please sign in to comment.