More hints on what to do with CUDA Out of memory errors (#925)

axolotl-ai-cloud · Dec 13, 2023 · b0cf397 · b0cf397
1 parent 5f79b82
commit b0cf397
Showing 1 changed file with 4 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -1022,6 +1022,10 @@ Please reduce any below
   - `gradient_accumulation_steps`
   - `sequence_len`
 
+If it does not help, try running without deepspeed and without accelerate (replace "accelerate launch" with "python") in the command.
+
+Using adamw_bnb_8bit might also save you some memory.
+
 > `failed (exitcode: -9)`
 
 Usually means your system has run out of system memory.