Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add rejection sampling analysis #253

Draft
wants to merge 53 commits into
base: main
Choose a base branch
from
Draft

Add rejection sampling analysis #253

wants to merge 53 commits into from

Commits on Aug 12, 2024

  1. move rejection sampling within its own directory

    @nouhadziri
    nouhadziri committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    9035816 View commit details
    Browse the repository at this point in the history

  2. move rejection sampling within its own directory

    @nouhadziri
    nouhadziri committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    e97eb4e View commit details
    Browse the repository at this point in the history

  3. add api-based models to generating completions

    @nouhadziri
    nouhadziri committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    4bfc79b View commit details
    Browse the repository at this point in the history

  4. debug

    @nouhadziri
    nouhadziri committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    7a0abc4 View commit details
    Browse the repository at this point in the history

  5. debug

    @nouhadziri
    nouhadziri committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    034259d View commit details
    Browse the repository at this point in the history

  6. debug

    @nouhadziri
    nouhadziri committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    b5990ef View commit details
    Browse the repository at this point in the history

  7. debug

    @nouhadziri
    nouhadziri committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    d44e1cb View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2024

  1. debug

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    1c99e32 View commit details
    Browse the repository at this point in the history

  2. do not apply tokenization with chat template

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    6013160 View commit details
    Browse the repository at this point in the history

  3. change the tokenizer

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    c47a16e View commit details
    Browse the repository at this point in the history

  4. change the tokenizer

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    91fd8b8 View commit details
    Browse the repository at this point in the history

  5. fix template

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    7093b10 View commit details
    Browse the repository at this point in the history

  6. fix arg issue

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    805fcac View commit details
    Browse the repository at this point in the history

  7. add mode to arg

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    f93e738 View commit details
    Browse the repository at this point in the history

  8. add mode to arg

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    77d257b View commit details
    Browse the repository at this point in the history

  9. change the skill

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    b2a4b83 View commit details
    Browse the repository at this point in the history

  10. remove main from api_generate.py

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    b80894a View commit details
    Browse the repository at this point in the history

  11. modify template chat

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    fca6f6d View commit details
    Browse the repository at this point in the history

  12. modify template chat

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    6541c9f View commit details
    Browse the repository at this point in the history

  13. return only text

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    1630b4b View commit details
    Browse the repository at this point in the history

  14. return only text

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    ebacf9e View commit details
    Browse the repository at this point in the history

  15. return only text

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    45d14b3 View commit details
    Browse the repository at this point in the history

  16. fix dict

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    60a7a87 View commit details
    Browse the repository at this point in the history

  17. fix dict

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    33e8f8c View commit details
    Browse the repository at this point in the history

  18. fix dict

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    9d99744 View commit details
    Browse the repository at this point in the history

  19. fix dict

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    7ce7419 View commit details
    Browse the repository at this point in the history

  20. fix dict

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    f3f1466 View commit details
    Browse the repository at this point in the history

  21. Merge branch 'main' into llm-as-judge

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    97b812e View commit details
    Browse the repository at this point in the history

  22. fix dict

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    7fe90fd View commit details
    Browse the repository at this point in the history

  23. add LM as a scorer

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    fe0cfe3 View commit details
    Browse the repository at this point in the history

  24. add LM as a scorer

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    2ac539a View commit details
    Browse the repository at this point in the history

  25. add LM as a scorer

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    b54dc5e View commit details
    Browse the repository at this point in the history

  26. add LM as a scorer

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    a0ae60b View commit details
    Browse the repository at this point in the history

  27. change the name of the model

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    f7b9188 View commit details
    Browse the repository at this point in the history

  28. fix rank bug

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    28dfddf View commit details
    Browse the repository at this point in the history

  29. process score

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    e50ef23 View commit details
    Browse the repository at this point in the history

  30. process score

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    4ffdf75 View commit details
    Browse the repository at this point in the history

  31. edit the template

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    a352b69 View commit details
    Browse the repository at this point in the history

  32. extract score

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    4e89a5e View commit details
    Browse the repository at this point in the history

  33. compute scores for reference responses

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    75e7f66 View commit details
    Browse the repository at this point in the history

  34. compute scores for reference responses

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    e3d6b07 View commit details
    Browse the repository at this point in the history

  35. add tqdm

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    4abbf4f View commit details
    Browse the repository at this point in the history

  36. add tqdm

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    d2ce21a View commit details
    Browse the repository at this point in the history

  37. fix score bug

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    089726f View commit details
    Browse the repository at this point in the history

  38. fix item bug

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    fe0533d View commit details
    Browse the repository at this point in the history

  39. fix item bug

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    95213b3 View commit details
    Browse the repository at this point in the history

  40. fixed code style

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    4f7acc0 View commit details
    Browse the repository at this point in the history

  41. fixed code style

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    e436c31 View commit details
    Browse the repository at this point in the history

  42. .idea added to .gitignore

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    93c54e0 View commit details
    Browse the repository at this point in the history

  43. .idea dir removed

    @nouhadziri
    nouhadziri authored Aug 13, 2024
    Configuration menu
    Copy the full SHA
    d5b43ee View commit details
    Browse the repository at this point in the history

  44. remove unused llm_as_judge file

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    107ac32 View commit details
    Browse the repository at this point in the history

  45. Update rejection_sampling.md

    @nouhadziri
    nouhadziri committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    dacf4b3 View commit details
    Browse the repository at this point in the history

  46. Add analysis script

    @vwxyzjn
    vwxyzjn committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    ab96ef5 View commit details
    Browse the repository at this point in the history