Code

Add WinRateCallback and Judges#1598

Code

Merged

qgallouedec merged 31 commits intomainhuggingface/trl:mainfrom add-winrate-cbhuggingface/trl:add-winrate-cbCopy head branch name to clipboardJul 18, 2024

+536-4

Commits

Commits on Apr 29, 2024

• Add WinRateCallback

  lewtun

  committed
  42e1170

  Copy full SHA for 42e1170

• Enable PairRM

  lewtun

  committed
  52ae31e

  Copy full SHA for 52ae31e

• Refactor

  lewtun

  committed
  2065c3f

  Copy full SHA for 2065c3f

• Streamline

  lewtun

  committed
  efa2e21

  Copy full SHA for efa2e21

Commits on Apr 30, 2024

• Add HF judge

  lewtun

  committed
  27be35d

  Copy full SHA for 27be35d

Commits on May 2, 2024

• Add base judge

  lewtun

  committed
  ce4dad2

  Copy full SHA for ce4dad2

• Use better prompt

  lewtun

  committed
  29c5f98

  Copy full SHA for 29c5f98

Commits on May 3, 2024

• Merge branch 'main' into add-winrate-cb

  lewtun

  committed
  b6b84ab

  Copy full SHA for b6b84ab

• Clean

  lewtun

  committed
  ea60ebb

  Copy full SHA for ea60ebb

• Add max tokens

  lewtun

  committed
  9542e73

  Copy full SHA for 9542e73

• Use logging

  lewtun

  committed
  568e7b3

  Copy full SHA for 568e7b3

• Add batched inference

  lewtun

  committed
  9362eff

  Copy full SHA for 9362eff

Commits on Jul 15, 2024

• Squashed commit of the following:

  Show description for e05e0ca
  qgallouedec

  committed
  e05e0ca

  Copy full SHA for e05e0ca

• Merge branch 'main' into add-winrate-cb

  qgallouedec

  committed
  f49a043

  Copy full SHA for f49a043

• judge refactoring and unittest

  qgallouedec

  committed
  6ae3993

  Copy full SHA for 6ae3993

• format

  qgallouedec

  committed
  a2bfe57

  Copy full SHA for a2bfe57

• init

  qgallouedec

  committed
  3e8afdd

  Copy full SHA for 3e8afdd

• doc

  qgallouedec

  committed
  faaf38f

  Copy full SHA for faaf38f

• Merge branch 'main' into add-winrate-cb

  qgallouedec

  authored
  ee0e4e9

  Copy full SHA for ee0e4e9

• format

  qgallouedec

  committed
  b1fb345

  Copy full SHA for b1fb345

• improve doc

  qgallouedec

  committed
  47624c3

  Copy full SHA for 47624c3

• basejudge

  qgallouedec

  committed
  c89fdc7

  Copy full SHA for c89fdc7

Commits on Jul 17, 2024

• improve doc and add BaseAPIJudge

  qgallouedec

  committed
  38a527f

  Copy full SHA for 38a527f

• Doc

  qgallouedec

  committed
  721cb75

  Copy full SHA for 721cb75

• style

  qgallouedec

  committed
  915147e

  Copy full SHA for 915147e

• refactor callback

  qgallouedec

  committed
  984d339

  Copy full SHA for 984d339

• remove openai and pairrm judge from test

  qgallouedec

  committed
  59b6ef3

  Copy full SHA for 59b6ef3

Commits on Jul 18, 2024

• doc

  qgallouedec

  committed
  a039f23

  Copy full SHA for a039f23

• rm dpo online example

  qgallouedec

  committed
  7ddbc28

  Copy full SHA for 7ddbc28

• new prompts and completions

  qgallouedec

  committed
  b68f2ab

  Copy full SHA for b68f2ab

• skip hf judge and add hf token

  qgallouedec

  committed
  0317393

  Copy full SHA for 0317393