Code

🃏 Model card for TRL#2123

Code

Merged

qgallouedec merged 63 commits intomainhuggingface/trl:mainfrom model_cardhuggingface/trl:model_cardCopy head branch name to clipboardSep 27, 2024

+1,023-245

Commits

Commits on Sep 25, 2024

• template and util

  qgallouedec

  committed
  5a5f2c5

  Copy full SHA for 5a5f2c5

• test for online dpo

  qgallouedec

  committed
  5269a21

  Copy full SHA for 5269a21

• template in package_data

  qgallouedec

  committed
  01c2e77

  Copy full SHA for 01c2e77

• template in manifest

  qgallouedec

  committed
  ca73c40

  Copy full SHA for ca73c40

• standardize push_to_hub

  qgallouedec

  committed
  643b9bc

  Copy full SHA for 643b9bc

• wandb badge and quick start

  qgallouedec

  committed
  41fe4bb

  Copy full SHA for 41fe4bb

• Merge branch 'main' into model_card

  qgallouedec

  committed
  db50cfb

  Copy full SHA for db50cfb

Commits on Sep 26, 2024

• Merge branch 'main' into model_card

  qgallouedec

  authored
  198f4cb

  Copy full SHA for 198f4cb

• bco

  qgallouedec

  committed
  9f2ed4c

  Copy full SHA for 9f2ed4c

• xpo

  qgallouedec

  committed
  4afcd90

  Copy full SHA for 4afcd90

• simplify create_model_card

  qgallouedec

  committed
  5cf9320

  Copy full SHA for 5cf9320

• cpo

  qgallouedec

  committed
  61c912a

  Copy full SHA for 61c912a

• kto

  qgallouedec

  committed
  6d33273

  Copy full SHA for 6d33273

• dpo

  qgallouedec

  committed
  9e67eb5

  Copy full SHA for 9e67eb5

• gkd

  qgallouedec

  committed
  5c32249

  Copy full SHA for 5c32249

• Merge branch 'main' into model_card

  qgallouedec

  authored
  86480e7

  Copy full SHA for 86480e7

• orpo

  qgallouedec

  committed
  635ec60

  Copy full SHA for 635ec60

• style

  qgallouedec

  committed
  475abda

  Copy full SHA for 475abda

• nash-md

  qgallouedec

  committed
  fe399f1

  Copy full SHA for fe399f1

• alignprop

  qgallouedec

  committed
  4a40455

  Copy full SHA for 4a40455

• bco citation

  qgallouedec

  committed
  4d72f0f

  Copy full SHA for 4d72f0f

• citation template

  qgallouedec

  committed
  a0d81eb

  Copy full SHA for a0d81eb

• cpo citation

  qgallouedec

  committed
  8d37399

  Copy full SHA for 8d37399

• ddpo

  qgallouedec

  committed
  3de7b09

  Copy full SHA for 3de7b09

• fix alignprop

  qgallouedec

  committed
  6bf11cd

  Copy full SHA for 6bf11cd

• dpo

  qgallouedec

  committed
  0ec6522

  Copy full SHA for 0ec6522

• gkd citation

  qgallouedec

  committed
  f0d4c83

  Copy full SHA for f0d4c83

• kto

  qgallouedec

  committed
  22dec89

  Copy full SHA for 22dec89

• online dpo citation

  qgallouedec

  committed
  ff62e92

  Copy full SHA for ff62e92

• orpo citation

  qgallouedec

  committed
  d5aca76

  Copy full SHA for d5aca76

• citation in utils

  qgallouedec

  committed
  683f92d

  Copy full SHA for 683f92d

• optional citation

  qgallouedec

  committed
  03f475c

  Copy full SHA for 03f475c

• reward

  qgallouedec

  committed
  cf75a88

  Copy full SHA for cf75a88

• optional trainer citation

  qgallouedec

  committed
  f8c6f58

  Copy full SHA for f8c6f58

• sft

  qgallouedec

  committed
  1d293a6

  Copy full SHA for 1d293a6

• remove add_model_tags bco

  qgallouedec

  committed
  679721f

  Copy full SHA for 679721f

• Remove unnecessary code for adding model tags

  qgallouedec

  committed
  e28074f

  Copy full SHA for e28074f

• Fix model tag issue and update URL format

  qgallouedec

  committed
  714ac02

  Copy full SHA for 714ac02

• Remove unused code for adding model tags

  qgallouedec

  committed
  b5055cd

  Copy full SHA for b5055cd

• Add citation for XPOTrainer

  qgallouedec

  committed
  baf4d78

  Copy full SHA for baf4d78

• Remove unused code in SFTTrainer

  qgallouedec

  committed
  2dd9c74

  Copy full SHA for 2dd9c74

• Add model card generation in RLOOTrainer

  qgallouedec

  committed
  f035d3a

  Copy full SHA for f035d3a

• Remove unused import and method call in reward_trainer.py

  qgallouedec

  committed
  8d3ac42

  Copy full SHA for 8d3ac42

• Add model card generation

  qgallouedec

  committed
  a19beb4

  Copy full SHA for a19beb4

• Remove unused code and update error message in ORPOTrainer class

  qgallouedec

  committed
  ea8a960

  Copy full SHA for ea8a960

• Add import statements and create model card in IterativeSFTTrainer

  qgallouedec

  committed
  0958554

  Copy full SHA for 0958554

• Add dataset name to push_to_hub() call

  qgallouedec

  committed
  53d9962

  Copy full SHA for 53d9962

• Update trainer.push_to_hub() dataset names

  qgallouedec

  committed
  9a0aec0

  Copy full SHA for 9a0aec0

• Merge branch 'main' into model_card

  qgallouedec

  authored
  d83f32e

  Copy full SHA for d83f32e

• script args

  qgallouedec

  committed
  164037c

  Copy full SHA for 164037c

• test

  qgallouedec

  committed
  9de0288

  Copy full SHA for 9de0288

• better doc

  qgallouedec

  committed
  5c84760

  Copy full SHA for 5c84760

• fix tag test

  qgallouedec

  committed
  f49386a

  Copy full SHA for f49386a

• fix test tag

  qgallouedec

  committed
  d4de482

  Copy full SHA for d4de482

• Add tags parameter to create_model_card method

  qgallouedec

  committed
  254fcbc

  Copy full SHA for 254fcbc

• doc

  qgallouedec

  committed
  09d16e3

  Copy full SHA for 09d16e3

• Merge branch 'main' into model_card

  qgallouedec

  authored
  40ff943

  Copy full SHA for 40ff943

• script args

  qgallouedec

  committed
  6e71659

  Copy full SHA for 6e71659

Commits on Sep 27, 2024

• Merge branch 'main' into model_card

  qgallouedec

  authored
  5bec9c2

  Copy full SHA for 5bec9c2

• Update trl/templates/model_card.md

  Show description for d9973c0
  

  qgallouedec

  and

  lewtun

  authored
  d9973c0

  Copy full SHA for d9973c0

• unittest's assertIn instead of assert

  qgallouedec

  committed
  65af404

  Copy full SHA for 65af404

• Update trl/templates/model_card.md

  Show description for 9a08ebd
  

  qgallouedec

  and

  lewtun

  authored
  9a08ebd

  Copy full SHA for 9a08ebd

• Rename model_card to lm_model_card

  qgallouedec

  committed
  5080ff5

  Copy full SHA for 5080ff5