Pinned Loading

1. microsoft/DeepSpeed microsoft/DeepSpeed Public

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 35.6k 4.1k

2. huggingface/accelerate huggingface/accelerate Public

   🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

   Python 8k 974

3. NVIDIA/nccl NVIDIA/nccl Public

   Optimized primitives for collective multi-GPU communication

   C++ 3.3k 826