Skip to content

Latest commit

 

History

History
29 lines (15 loc) · 1.05 KB

README.md

File metadata and controls

29 lines (15 loc) · 1.05 KB

Training

Subsections:

Tools:

  • printflock.py - a tiny library that makes your print calls non-interleaved in a multi-gpu environment.

  • multi-gpu-non-interleaved-print.py - a flock-based wrapper around print that prevents messages from getting interleaved when multiple processes print at the same time - which is the case with torch.distributed used with multiple-gpus.