Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Mistral 7b conversion script #8052

Merged
merged 8 commits into from
Jan 25, 2024
Merged

Mistral 7b conversion script #8052

merged 8 commits into from
Jan 25, 2024

Commits on Jan 18, 2024

  1. Import script for mistral-7b. 

    From mistral checkpoint not hf.
Pending: support for block-diagonal attention mask.

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
    @akoumpa
    akoumpa committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    531975b View commit details
    Browse the repository at this point in the history

  2. add window_size to nemo_config. 

    Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
    @akoumpa
    akoumpa committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    15ab972 View commit details
    Browse the repository at this point in the history

  3. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci

Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
    @pre-commit-ci @akoumpa
    pre-commit-ci[bot] authored and akoumpa committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    1f43ece View commit details
    Browse the repository at this point in the history

  4. Switch from Mistral checkpoint to HF-Mistral. 

    Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
    @akoumpa
    akoumpa committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    0c72777 View commit details
    Browse the repository at this point in the history

  5. Force lowercase when checking for normalization type. 

    Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
    @akoumpa
    akoumpa committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    f9d9641 View commit details
    Browse the repository at this point in the history

  6. NeMo-Mistral-7B to HF-Mistral-7B. 

    Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
    @akoumpa
    akoumpa committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    763fbb2 View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2024

  1. Merge branch 'main' into mistral_7b_support/akoumparouli

    @ericharper
    ericharper authored Jan 24, 2024
    Configuration menu
    Copy the full SHA
    035a228 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into mistral_7b_support/akoumparouli

    @ericharper
    ericharper authored Jan 24, 2024
    Configuration menu
    Copy the full SHA
    81372b0 View commit details
    Browse the repository at this point in the history