Skip to content

Commit

Permalink
Update sft_trainer.mdx (#808)
Browse files Browse the repository at this point in the history
  • Loading branch information
younesbelkada authored Sep 22, 2023
1 parent 1d7e3c2 commit 7877e92
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/sft_trainer.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -356,7 +356,7 @@ pip install -U optimum
Once you have loaded your model, wrap the `trainer.train()` call under the `with torch.backends.cuda.sdp_kernel(enable_flash=True, enable_math=False, enable_mem_efficient=False):` context manager:

```diff
# ...
...

+ with torch.backends.cuda.sdp_kernel(enable_flash=True, enable_math=False, enable_mem_efficient=False):
trainer.train()
Expand Down

0 comments on commit 7877e92

Please sign in to comment.