Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat: Enhance multimodality #1070

Merged
merged 18 commits into from
Oct 20, 2024
Merged

Feat: Enhance multimodality #1070

merged 18 commits into from
Oct 20, 2024
+759 −44

Commits on Oct 11, 2024

  1. Enhance multimodality 

    - Upgrade `Image` to support all valid OpenAI and Anthropic vision mime types
- Use mime type detection rather than extensions
- Add image autodetection for ease of use
    @arcaputo3
    arcaputo3 committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    82c6846 View commit details
    Browse the repository at this point in the history

  2. Ruff and pyright

    @arcaputo3
    arcaputo3 committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    21febac View commit details
    Browse the repository at this point in the history

  3. Update multimodal.py 

    - More ruff
    @arcaputo3
    arcaputo3 committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    948f49c View commit details
    Browse the repository at this point in the history

  4. Update test_multimodal.py 

    - Fix error match
    @arcaputo3
    arcaputo3 committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    5ca6f9a View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2024

  1. Add multimodality for no response model

    @arcaputo3
    arcaputo3 committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    0615b0a View commit details
    Browse the repository at this point in the history

  2. Undo unneeded Ruff

    @arcaputo3
    arcaputo3 committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    a99b275 View commit details
    Browse the repository at this point in the history

  3. Update multimodal.py 

    - Optionally cache expensive operations
    @arcaputo3
    arcaputo3 committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    8370f03 View commit details
    Browse the repository at this point in the history

  4. Update multimodal.py 

    - Pyright and remove double media type access for Anthropic
    @arcaputo3
    arcaputo3 committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    ae5a89c View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. Merge branch 'main' into multimodel-enhancements

    @arcaputo3
    arcaputo3 authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    d7b2b00 View commit details
    Browse the repository at this point in the history

  2. Add Anthropic prompt caching support 

    - Improve LRU caching
    @arcaputo3
    arcaputo3 committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    5e5e23c View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. Add cache controls 

    - Use Anthropic `cache_control` syntax and update LRU cache to handle mapping types
- Test cache hits and enable / disable
    @arcaputo3
    arcaputo3 committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    a5c3248 View commit details
    Browse the repository at this point in the history

  2. Update multimodal.py 

    - Ruff
    @arcaputo3
    arcaputo3 committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    822a827 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into multimodel-enhancements

    @arcaputo3
    arcaputo3 authored Oct 15, 2024
    Configuration menu
    Copy the full SHA
    3c47476 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. Merge branch 'main' into multimodel-enhancements

    @arcaputo3
    arcaputo3 authored Oct 16, 2024
    Configuration menu
    Copy the full SHA
    79f878b View commit details
    Browse the repository at this point in the history

  2. Remove excess caching logic 

    - Simplify caching and prompt caching logic
- Remove cache config feature for now
    @arcaputo3
    arcaputo3 committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    a19d704 View commit details
    Browse the repository at this point in the history

  3. Handle Anthropic style messages 

    ... with no response model
    @arcaputo3
    arcaputo3 committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    b771f33 View commit details
    Browse the repository at this point in the history

  4. Update multimodal.py 

    - Remove unneeded var assignment
    @arcaputo3
    arcaputo3 committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    44b3316 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2024

  1. Merge branch 'main' into multimodel-enhancements

    @arcaputo3
    arcaputo3 authored Oct 19, 2024
    Configuration menu
    Copy the full SHA
    86cf6ba View commit details
    Browse the repository at this point in the history