Code

Adding dpo training#1209

Code

Open

Goekdeniz-Guelmez wants to merge 30 commits intoml-explore:mainml-explore/mlx-examples:mainfrom Goekdeniz-Guelmez:adding-dpo-trainingGoekdeniz-Guelmez/mlx-examples:adding-dpo-trainingCopy head branch name to clipboard

+671-47

Commits

Commits on Jan 18, 2025

• initial commit

  Goekdeniz-Guelmez

  committed
  1ff7888

  Copy full SHA for 1ff7888

• fixing reference model loading and freezing

  Goekdeniz-Guelmez

  committed
  582f979

  Copy full SHA for 582f979

• update LORA.md

  Goekdeniz-Guelmez

  committed
  1b4e196

  Copy full SHA for 1b4e196

• update lora_config.yaml

  Goekdeniz-Guelmez

  committed
  06a9f5d

  Copy full SHA for 06a9f5d

Commits on Jan 19, 2025

• update ACKNOWLEDGMENTS.md

  Goekdeniz-Guelmez

  committed
  040f7c3

  Copy full SHA for 040f7c3

• nits

  Goekdeniz-Guelmez

  committed
  51fd621

  Copy full SHA for 51fd621

• removing unneeded functions

  Goekdeniz-Guelmez

  committed
  477000e

  Copy full SHA for 477000e

Commits on Jan 22, 2025

• Merge branch 'ml-explore:main' into adding-dpo-training

  Goekdeniz-Guelmez

  authored
  69a8f11

  Copy full SHA for 69a8f11

• nits

  Goekdeniz-Guelmez

  committed
  b0ece88

  Copy full SHA for b0ece88

• nits

  Goekdeniz-Guelmez

  committed
  e1d549b

  Copy full SHA for e1d549b

• nits

  Goekdeniz-Guelmez

  committed
  aefe4ba

  Copy full SHA for aefe4ba

Commits on Jan 24, 2025

• update DPODataset and added in system field too

  Goekdeniz-Guelmez

  committed
  54fcd8e

  Copy full SHA for 54fcd8e

• nits

  Goekdeniz-Guelmez

  committed
  531c334

  Copy full SHA for 531c334

• nits and quality of life improvements

  Goekdeniz-Guelmez

  committed
  86b315f

  Copy full SHA for 86b315f

Commits on Jan 25, 2025

• updates

  Goekdeniz-Guelmez

  committed
  0ff1289

  Copy full SHA for 0ff1289

Commits on Jan 26, 2025

• more metrics

  Goekdeniz-Guelmez

  committed
  4d0e52f

  Copy full SHA for 4d0e52f

• removing tokenizer and updates

  Goekdeniz-Guelmez

  committed
  557649d

  Copy full SHA for 557649d

• Merge branch 'main' into adding-dpo-training

  Goekdeniz-Guelmez

  authored
  9e5482e

  Copy full SHA for 9e5482e

Commits on Jan 29, 2025

• Merge branch 'ml-explore:main' into adding-dpo-training

  Goekdeniz-Guelmez

  authored
  b3d6fc3

  Copy full SHA for b3d6fc3

Commits on Jan 30, 2025

• removing is-reference-free argument

  Goekdeniz-Guelmez

  committed
  b31d9cb

  Copy full SHA for b31d9cb

Commits on Jan 31, 2025

• small fix

  Goekdeniz-Guelmez

  committed
  b379359

  Copy full SHA for b379359

• cleaning up some namings

  Goekdeniz-Guelmez

  committed
  5998272

  Copy full SHA for 5998272

• clean up

  Goekdeniz-Guelmez

  committed
  a03d434

  Copy full SHA for a03d434

Commits on Feb 1, 2025

• small fix

  Goekdeniz-Guelmez

  committed
  fbb51f6

  Copy full SHA for fbb51f6

Commits on Feb 4, 2025

• Merge branch 'ml-explore:main' into adding-dpo-training

  Goekdeniz-Guelmez

  authored
  9b489a6

  Copy full SHA for 9b489a6

• fix testing

  Goekdeniz-Guelmez

  committed
  c2fcb67

  Copy full SHA for c2fcb67

• nits

  Goekdeniz-Guelmez

  committed
  43f2451

  Copy full SHA for 43f2451

• adding test_ppl in testing

  Goekdeniz-Guelmez

  committed
  069431b

  Copy full SHA for 069431b

• nice printing the test metrics

  Goekdeniz-Guelmez

  committed
  b1c1e13

  Copy full SHA for b1c1e13

Commits on Feb 6, 2025

• Merge branch 'ml-explore:main' into adding-dpo-training

  Goekdeniz-Guelmez

  authored
  6710671

  Copy full SHA for 6710671