Code

[DPO] add KTO loss#1075

Code

Merged

kashif merged 5 commits intohuggingface:mainhuggingface/trl:mainfrom kashif:KTOkashif/trl:KTOCopy head branch name to clipboardDec 11, 2023

+30-8

Commits

Commits on Dec 8, 2023

• add KTO loss

  kashif

  committed
  c06a2db

  Copy full SHA for c06a2db

• fix docs

  kashif

  committed
  17f99d3

  Copy full SHA for 17f99d3

• Update trl/trainer/dpo_trainer.py

  Show description for 8f73064
  

  kashif

  and

  lewtun

  authored
  8f73064

  Copy full SHA for 8f73064

• formatting

  kashif

  committed
  f8baf45

  Copy full SHA for f8baf45

Commits on Dec 9, 2023

• add link to papers

  kashif

  committed
  786e2cf

  Copy full SHA for 786e2cf