Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add base model qlora fintuning config file and optimize deduplicate.py #128

Merged
merged 8 commits into from
Mar 23, 2024
Merged

add base model qlora fintuning config file and optimize deduplicate.py #128

merged 8 commits into from
Mar 23, 2024

Commits on Mar 23, 2024

  1. optimize deduplicate.py 

    Add time print information
save duplicate dataset as well
remove print(content)
    @chg0901
    chg0901 committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    950cab0 View commit details
    Browse the repository at this point in the history

  2. add base model qlora fintuning config file: internlm2_7b_base_qlora_e… 

    …10_M_1e4_32_64.py
    @chg0901
    chg0901 committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    252adc7 View commit details
    Browse the repository at this point in the history

  3. add full finetune code from internlm2

    @chg0901
    chg0901 committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    df81a99 View commit details
    Browse the repository at this point in the history

  4. other 2 configs for base model

    @chg0901
    chg0901 committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    0124001 View commit details
    Browse the repository at this point in the history

  5. update cli_internlm2.py 

     three methods to load model

1. download model in openxlab
2. download model in modelscope
3. offline model
    @chg0901
    chg0901 committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    a22ec59 View commit details
    Browse the repository at this point in the history

  6. create upload_modelscope.py

    @chg0901
    chg0901 committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    affd90b View commit details
    Browse the repository at this point in the history

  7. add base model and update personal contributions

    @chg0901
    chg0901 committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    6e0042a View commit details
    Browse the repository at this point in the history

  8. Create README_internlm2_7b_base_qlora.md 

    InternLM2 7B Base QLoRA 微调指南
    @chg0901
    chg0901 committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    383789e View commit details
    Browse the repository at this point in the history