Skip to content

Alowden/fine tuning techniques dpo #1900

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 15 commits into from
Jun 18, 2025
Merged

Conversation

alexl-oai
Copy link
Contributor

Summary

Adds overview of fine-tuning methods + DPO guide (which was missing).

Motivation

As above. Unifies fine-tuning guides thus far (adding DPO & helping technical folk determine which fine-tuning method to use.


For new content

When contributing new content, read through our contribution guidelines, and mark the following action items as completed:

  • I have added a new entry in registry.yaml (and, optionally, in authors.yaml) so that my content renders on the cookbook website.
  • I have conducted a self-review of my content based on the contribution guidelines:
    • Relevance: This content is related to building with OpenAI technologies and is useful to others.
    • Uniqueness: I have searched for related examples in the OpenAI Cookbook, and verified that my content offers new insights or unique information compared to existing documentation.
    • Spelling and Grammar: I have checked for spelling or grammatical mistakes.
    • Clarity: I have done a final read-through and verified that my submission is well-organized and easy to understand.
    • Correctness: The information I include is correct and all of my code executes successfully.
    • Completeness: I have explained everything fully, including all necessary references and citations.

We will rate each of these areas on a scale from 1 to 4, and will only accept contributions that score 3 or higher on all areas. Refer to our contribution guidelines for more details.

@alexl-oai alexl-oai self-assigned this Jun 13, 2025
@robtinn
Copy link
Contributor

robtinn commented Jun 18, 2025

looks good to me

@alexl-oai alexl-oai merged commit a57c80e into main Jun 18, 2025
1 check passed
@alexl-oai alexl-oai deleted the alowden/fine_tuning_techniques_dpo branch June 18, 2025 15:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants