Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Model Cache Management Features #239

Merged
merged 72 commits into from
Jan 6, 2023
Merged

Model Cache Management Features #239

merged 72 commits into from
Jan 6, 2023

Commits on Dec 16, 2022

  1. add APIs in marqo

    @wanliAlex
    wanliAlex committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    da1fbbe View commit details
    Browse the repository at this point in the history

  2. test new model cache key

    @wanliAlex
    wanliAlex committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    03ca4dd View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2022

  1. cleaning

    @wanliAlex
    wanliAlex committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    e7e7b09 View commit details
    Browse the repository at this point in the history

  2. Add todo

    @wanliAlex
    wanliAlex committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    8ad198b View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2022

  1. add multi-gpu support

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    d8a4fdd View commit details
    Browse the repository at this point in the history

  2. add multi-gpu support

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    db30bcb View commit details
    Browse the repository at this point in the history

  3. space adding

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    f0a801b View commit details
    Browse the repository at this point in the history

  4. adding cpu usage, RAM usage api

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    e0f14a2 View commit details
    Browse the repository at this point in the history

  5. adding cpu usage, RAM usage api

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    186180a View commit details
    Browse the repository at this point in the history

  6. adding cpu usage, RAM usage api

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    2c77fa7 View commit details
    Browse the repository at this point in the history

  7. adding cpu usage, RAM usage api

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    d88b590 View commit details
    Browse the repository at this point in the history

  8. revert back model cache key

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    a95d030 View commit details
    Browse the repository at this point in the history

  9. revert back model cache key

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    ba97a44 View commit details
    Browse the repository at this point in the history

  10. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    2457920 View commit details
    Browse the repository at this point in the history

  11. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    856b5f9 View commit details
    Browse the repository at this point in the history

  12. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    3df97f0 View commit details
    Browse the repository at this point in the history

  13. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    e3d3bec View commit details
    Browse the repository at this point in the history

  14. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    b6122aa View commit details
    Browse the repository at this point in the history

  15. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    1132cc5 View commit details
    Browse the repository at this point in the history

  16. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    fd69a42 View commit details
    Browse the repository at this point in the history

  17. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    fe2f5fa View commit details
    Browse the repository at this point in the history

  18. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    4b515c2 View commit details
    Browse the repository at this point in the history

  19. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    7aa1a06 View commit details
    Browse the repository at this point in the history

  20. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    53a6a13 View commit details
    Browse the repository at this point in the history

  21. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    0d5140b View commit details
    Browse the repository at this point in the history

  22. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    05719e7 View commit details
    Browse the repository at this point in the history

  23. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    1b058af View commit details
    Browse the repository at this point in the history

  24. add test_eject_model test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    74f9238 View commit details
    Browse the repository at this point in the history

  25. add unit test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    e624322 View commit details
    Browse the repository at this point in the history

  26. add unit test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    847653a View commit details
    Browse the repository at this point in the history

  27. add unit test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    f144d3e View commit details
    Browse the repository at this point in the history

  28. add unit test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    d07d56c View commit details
    Browse the repository at this point in the history

  29. add unit test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    046761e View commit details
    Browse the repository at this point in the history

  30. add unit test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    4a8e1e4 View commit details
    Browse the repository at this point in the history

  31. add unit test

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    18e83e4 View commit details
    Browse the repository at this point in the history

  32. test cuda only when cuda is available

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    c5c014a View commit details
    Browse the repository at this point in the history

  33. format update

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    2c04048 View commit details
    Browse the repository at this point in the history

  34. format update

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    fe969e3 View commit details
    Browse the repository at this point in the history

  35. format update

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    d37c1fe View commit details
    Browse the repository at this point in the history

  36. test_edge_case_cpu fix (remove cuda memory test)

    @wanliAlex
    wanliAlex committed Dec 21, 2022
    Configuration menu
    Copy the full SHA
    2f8f087 View commit details
    Browse the repository at this point in the history

Commits on Dec 23, 2022

  1. add separators for readable information in model cache key

    @wanliAlex
    wanliAlex committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    aa3f5cb View commit details
    Browse the repository at this point in the history

  2. add separators for readable information in model cache key

    @wanliAlex
    wanliAlex committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    a514876 View commit details
    Browse the repository at this point in the history

  3. add separators for readable information in model cache key

    @wanliAlex
    wanliAlex committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    a7d3995 View commit details
    Browse the repository at this point in the history

  4. add separators for readable information in model cache key

    @wanliAlex
    wanliAlex committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    61ad7b5 View commit details
    Browse the repository at this point in the history

  5. add separators for readable information in model cache key

    @wanliAlex
    wanliAlex committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    6d15f98 View commit details
    Browse the repository at this point in the history

  6. adding test

    @wanliAlex
    wanliAlex committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    1cc4240 View commit details
    Browse the repository at this point in the history

  7. adding test

    @wanliAlex
    wanliAlex committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    43d438a View commit details
    Browse the repository at this point in the history

  8. adding test

    @wanliAlex
    wanliAlex committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    a6b164a View commit details
    Browse the repository at this point in the history

  9. adding test

    @wanliAlex
    wanliAlex committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    8072324 View commit details
    Browse the repository at this point in the history

  10. adding test

    @wanliAlex
    wanliAlex committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    315d5fc View commit details
    Browse the repository at this point in the history

  11. adding test

    @wanliAlex
    wanliAlex committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    e132d70 View commit details
    Browse the repository at this point in the history

Commits on Dec 29, 2022

  1. update id to _device_id

    @wanliAlex
    wanliAlex committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    7cb6c42 View commit details
    Browse the repository at this point in the history

  2. update id to _device_id

    @wanliAlex
    wanliAlex committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    5e00196 View commit details
    Browse the repository at this point in the history

  3. [Onnx clip]Adding the clip_onnx to our avaible models for faster infe… 

    …rence (#245)

* onnx32/openai/ViT-L/14

* onnx32/openai/ViT-L/14

* onnx32/openai/ViT-L/14

* onnx32/openai/ViT-L/14

* add a timer

* add a timer

* add a timer

* add a timer

* add a timer

* add a timer

* add a timer

* add a timer

* add a timer

* add a timer

* add a timer

* add a timer

* add a timer

* add a timer

* add a timer

* cleaning

* add test for onnx_clip

* make sure onnx-16 model still use float32 for textual inference for best accuracy.

* make sure onnx-16 model still use float32 for textual inference for best accuracy.

* we merge the hf models.

* update id to _device_id
    @wanliAlex
    wanliAlex committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    b11d30c View commit details
    Browse the repository at this point in the history

  4. mainline merge

    @wanliAlex
    wanliAlex committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    e2dab10 View commit details
    Browse the repository at this point in the history

  5. mainline merge

    @wanliAlex
    wanliAlex committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    9dea569 View commit details
    Browse the repository at this point in the history

  6. mainline merge

    @wanliAlex
    wanliAlex committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    1cad359 View commit details
    Browse the repository at this point in the history

  7. mainline merge

    @wanliAlex
    wanliAlex committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    aa00d18 View commit details
    Browse the repository at this point in the history

  8. reduce a model for testing stability

    @wanliAlex
    wanliAlex committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    7afbb88 View commit details
    Browse the repository at this point in the history

  9. reduce a model for testing stability

    @wanliAlex
    wanliAlex committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    9aa15a9 View commit details
    Browse the repository at this point in the history

  10. update

    @wanliAlex
    wanliAlex committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    bb530f2 View commit details
    Browse the repository at this point in the history

  11. update

    @wanliAlex
    wanliAlex committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    eab2a75 View commit details
    Browse the repository at this point in the history

  12. update

    @wanliAlex
    wanliAlex committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    a4f0a42 View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2023

  1. add test for generic model

    @wanliAlex
    wanliAlex committed Jan 5, 2023
    Configuration menu
    Copy the full SHA
    670fcee View commit details
    Browse the repository at this point in the history

  2. add test for generic model

    @wanliAlex
    wanliAlex committed Jan 5, 2023
    Configuration menu
    Copy the full SHA
    2f8c6f0 View commit details
    Browse the repository at this point in the history

  3. add test for generic model

    @wanliAlex
    wanliAlex committed Jan 5, 2023
    Configuration menu
    Copy the full SHA
    4026435 View commit details
    Browse the repository at this point in the history

  4. add test for generic model

    @wanliAlex
    wanliAlex committed Jan 5, 2023
    Configuration menu
    Copy the full SHA
    45c5891 View commit details
    Browse the repository at this point in the history

  5. add test for generic model

    @wanliAlex
    wanliAlex committed Jan 5, 2023
    Configuration menu
    Copy the full SHA
    a782e52 View commit details
    Browse the repository at this point in the history

  6. add test for generic model

    @wanliAlex
    wanliAlex committed Jan 5, 2023
    Configuration menu
    Copy the full SHA
    621df43 View commit details
    Browse the repository at this point in the history

  7. add test for generic model

    @wanliAlex
    wanliAlex committed Jan 5, 2023
    Configuration menu
    Copy the full SHA
    0b10d26 View commit details
    Browse the repository at this point in the history

  8. revision

    @wanliAlex
    wanliAlex committed Jan 5, 2023
    Configuration menu
    Copy the full SHA
    0cf173a View commit details
    Browse the repository at this point in the history

  9. revision

    @wanliAlex
    wanliAlex committed Jan 5, 2023
    Configuration menu
    Copy the full SHA
    ba6fb8d View commit details
    Browse the repository at this point in the history