Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for small page sizes #824

Open
wants to merge 19 commits into
base: main
Choose a base branch
from
Open

Add support for small page sizes #824

wants to merge 19 commits into from

Commits on Mar 26, 2024

  1. add print statements for debugging

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    8efeb7f View commit details
    Browse the repository at this point in the history

  2. add print statements for debugging

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    ac5e78a View commit details
    Browse the repository at this point in the history

  3. reshape gmem copy

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    14b190b View commit details
    Browse the repository at this point in the history

  4. only test trivial block size

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    409431b View commit details
    Browse the repository at this point in the history

  5. implement kv page iteration functions

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    70dd049 View commit details
    Browse the repository at this point in the history

  6. rearrange initial offset computation

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    59e76be View commit details
    Browse the repository at this point in the history

  7. tests passing for single page k

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    175369f View commit details
    Browse the repository at this point in the history

  8. paged copy refactor working for page size 256

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    3691677 View commit details
    Browse the repository at this point in the history

  9. allow small page sizes in flash api

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    c05b857 View commit details
    Browse the repository at this point in the history

  10. remove print statements

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    347a625 View commit details
    Browse the repository at this point in the history

  11. tidy flash_fwd_kernel

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    3bb71a9 View commit details
    Browse the repository at this point in the history

  12. compiles for all h but 128

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    fa13c6b View commit details
    Browse the repository at this point in the history

  13. all working except rotary embedding

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    bde5aec View commit details
    Browse the repository at this point in the history

  14. add page size 16 to tests

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    bc66858 View commit details
    Browse the repository at this point in the history

  15. reshape rotary sin/cos copy to align with paged KV copy

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    0f5a45e View commit details
    Browse the repository at this point in the history

  16. revert hardcoded rotcossin thread layout

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    802dd6a View commit details
    Browse the repository at this point in the history

  17. resolve page offsets absolutely not relatively

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    135a1da View commit details
    Browse the repository at this point in the history

  18. add test for page table overflow

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    a63157e View commit details
    Browse the repository at this point in the history

  19. allow smaller page sizes in varlen api

    @skrider
    skrider committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    7968148 View commit details
    Browse the repository at this point in the history