Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Llama more training #297

Merged
merged 5 commits into from
Aug 1, 2023
Merged

Llama more training #297

merged 5 commits into from
Aug 1, 2023

Commits on Aug 1, 2023

  1. Rework the var-builder to handle initializations.

    @LaurentMazare
    LaurentMazare committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    a543b53 View commit details
    Browse the repository at this point in the history

  2. Add some helper functions for layer creation.

    @LaurentMazare
    LaurentMazare committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    0cf5566 View commit details
    Browse the repository at this point in the history

  3. Improve the layer initializations.

    @LaurentMazare
    LaurentMazare committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    b20253b View commit details
    Browse the repository at this point in the history

  4. Get initialized variables.

    @LaurentMazare
    LaurentMazare committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    dc61d4f View commit details
    Browse the repository at this point in the history

  5. Precompute the rot embeddings when training lamas.

    @LaurentMazare
    LaurentMazare committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    6dd1b51 View commit details
    Browse the repository at this point in the history