Skip to content

Azure/MS-AMP

Folders and files

NameName
Last commit message
Last commit date

Latest commit

8de09e0 Â· Aug 23, 2024

History

98 Commits
Mar 1, 2024
Feb 22, 2024
Mar 1, 2024
Feb 7, 2024
Mar 1, 2024
Mar 1, 2024
Aug 4, 2023
Aug 23, 2024
Feb 17, 2023
Feb 17, 2023
Aug 21, 2023
Feb 17, 2023
Dec 14, 2023
Aug 4, 2023
Nov 6, 2023
Jan 30, 2023
Jan 30, 2023
Apr 7, 2023
Nov 24, 2023
Feb 26, 2024
Apr 7, 2023
Apr 7, 2023
Feb 22, 2024
Feb 23, 2023

Repository files navigation

MS-AMP: Microsoft Automatic Mixed Precision

MS-AMP is an automatic mixed precision package for deep learning developed by Microsoft.

📢 v0.4.0 has been released!

Check aka.ms/msamp/doc for more details.

Publication

FP8-LM: Training FP8 Large Language Models [bib]
@misc{fp8lm,
      title={FP8-LM: Training FP8 Large Language Models},
      author={Houwen Peng and Kan Wu and Yixuan Wei and Guoshuai Zhao and Yuxiang Yang and Ze Liu and Yifan Xiong and Ziyue Yang and Bolin Ni and Jingcheng Hu and Ruihang Li and Miaosen Zhang and Chen Li and Jia Ning and Ruizhe Wang and Zheng Zhang and Shuguang Liu and Joe Chau and Han Hu and Peng Cheng},
      year={2023},
      eprint={2310.18313},
      archivePrefix={arXiv},
      primaryClass={cs.LG}
}

Trademarks

This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.