Code

Adding orpo training#1210

Code

Open

Goekdeniz-Guelmez wants to merge 30 commits intoml-explore:mainml-explore/mlx-examples:mainfrom Goekdeniz-Guelmez:adding-orpo-trainingGoekdeniz-Guelmez/mlx-examples:adding-orpo-trainingCopy head branch name to clipboard

+613-52

Commits

Commits on Jan 18, 2025

• initial commit

  Goekdeniz-Guelmez

  committed
  1ff7888

  Copy full SHA for 1ff7888

• fixing reference model loading and freezing

  Goekdeniz-Guelmez

  committed
  582f979

  Copy full SHA for 582f979

• update LORA.md

  Goekdeniz-Guelmez

  committed
  1b4e196

  Copy full SHA for 1b4e196

• update lora_config.yaml

  Goekdeniz-Guelmez

  committed
  06a9f5d

  Copy full SHA for 06a9f5d

Commits on Jan 19, 2025

• update ACKNOWLEDGMENTS.md

  Goekdeniz-Guelmez

  committed
  040f7c3

  Copy full SHA for 040f7c3

• nits

  Goekdeniz-Guelmez

  committed
  51fd621

  Copy full SHA for 51fd621

• initial commit

  Goekdeniz-Guelmez

  committed
  a9b7609

  Copy full SHA for a9b7609

• remerge with dpo

  Goekdeniz-Guelmez

  committed
  7d279b5

  Copy full SHA for 7d279b5

• finish

  Goekdeniz-Guelmez

  committed
  fa80d08

  Copy full SHA for fa80d08

• nits

  Goekdeniz-Guelmez

  committed
  9ede9db

  Copy full SHA for 9ede9db

• nits

  Goekdeniz-Guelmez

  committed
  424cb85

  Copy full SHA for 424cb85

• update ACKNOWLEDGMENTS.md

  Goekdeniz-Guelmez

  committed
  2a5b315

  Copy full SHA for 2a5b315

• update

  Goekdeniz-Guelmez

  committed
  ea0d11c

  Copy full SHA for ea0d11c

• fixes

  Goekdeniz-Guelmez

  committed
  363bde6

  Copy full SHA for 363bde6

• nits

  Goekdeniz-Guelmez

  committed
  61cd253

  Copy full SHA for 61cd253

Commits on Jan 22, 2025

• Merge branch 'ml-explore:main' into adding-orpo-training

  Goekdeniz-Guelmez

  authored
  4098c3b

  Copy full SHA for 4098c3b

• niits

  Goekdeniz-Guelmez

  committed
  0bb0011

  Copy full SHA for 0bb0011

Commits on Jan 24, 2025

• removing dpo and fixing some stuff for orpo

  Goekdeniz-Guelmez

  committed
  e368829

  Copy full SHA for e368829

• updates

  Goekdeniz-Guelmez

  committed
  09ed837

  Copy full SHA for 09ed837

Commits on Jan 25, 2025

• Removed rejected_rewards handling, Updated batch unpacking to match iterator, Updated batch unpacking to match iterator, Added preference score scaling, Simplified reward calculation, Removed redun…

  Show description for d8e7834
  Goekdeniz-Guelmez

  committed
  d8e7834

  Copy full SHA for d8e7834

Commits on Jan 26, 2025

• clean up

  Goekdeniz-Guelmez

  committed
  2f2ddd4

  Copy full SHA for 2f2ddd4

• Merge branch 'main' into adding-orpo-training

  Goekdeniz-Guelmez

  authored
  294d189

  Copy full SHA for 294d189

• fix ACKNOWLEDGMENTS

  Goekdeniz-Guelmez

  committed
  649d3f8

  Copy full SHA for 649d3f8

Commits on Jan 29, 2025

• Merge branch 'ml-explore:main' into adding-orpo-training

  Goekdeniz-Guelmez

  authored
  ceccb4c

  Copy full SHA for ceccb4c

Commits on Jan 31, 2025

• cleaning up

  Goekdeniz-Guelmez

  committed
  541677a

  Copy full SHA for 541677a

Commits on Feb 3, 2025

• Merge branch 'ml-explore:main' into adding-orpo-training

  Goekdeniz-Guelmez

  authored
  2c96da5

  Copy full SHA for 2c96da5

Commits on Feb 4, 2025

• Merge branch 'ml-explore:main' into adding-orpo-training

  Goekdeniz-Guelmez

  authored
  c33c245

  Copy full SHA for c33c245

• add create_dataset

  Goekdeniz-Guelmez

  committed
  1beefd5

  Copy full SHA for 1beefd5

• fix Test

  Goekdeniz-Guelmez

  committed
  43940ec

  Copy full SHA for 43940ec

• nice metric printing in testing

  Goekdeniz-Guelmez

  committed
  5671266

  Copy full SHA for 5671266