Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Segment anything 2 pipeline image #185

Merged
merged 33 commits into from
Sep 4, 2024

Commits on Aug 13, 2024

  1. feat(pipeline): add SAM2 image segmentation prototype

    This commit introduces a prototype implementation of the
    [Segment Anything v2](https://github.com/facebookresearch/segment-anything-2)
    (SAM2) pipeline within the AI worker. The prototype demonstrates the basic
    functionality needed to perform segmentation on an image. Note that video
    segmentation is not yet implemented. Additionally, the dependencies were
    updated quickly, which may temporarily break other pipelines.
    rickstaa committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    067abbb View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. Configuration menu
    Copy the full SHA
    1f8fe62 View commit details
    Browse the repository at this point in the history
  2. refactor: enhance SAM2 input handling and error management

    This commit allows nested arrays to be supplied as JSON strings for SAM2
    input. It also implements robust error handling to return a 400 error with
    a descriptive message when incorrect parameters are provided.
    rickstaa committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    7ec3079 View commit details
    Browse the repository at this point in the history
  3. refactor: improve SAM2 return time

    This commit ensures that we return the masks, iou_predictions and
    low_res_masks in json format.
    rickstaa committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    2828eb9 View commit details
    Browse the repository at this point in the history
  4. Sam2 -> SegmentAnything2

    pschroedl committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    8b8a508 View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2024

  1. update go bindings

    pschroedl committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    b96a2b7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ecab548 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    b7b4cdc View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. Configuration menu
    Copy the full SHA
    b200ab6 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. Configuration menu
    Copy the full SHA
    9b5b72e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e503818 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Configuration menu
    Copy the full SHA
    36ebcce View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    51206d8 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    96a8157 View commit details
    Browse the repository at this point in the history
  4. Sam2 -> SegmentAnything2

    pschroedl authored and rickstaa committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    389bd9f View commit details
    Browse the repository at this point in the history
  5. predictions -> scores, mask -> logits

    pschroedl authored and rickstaa committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    468552c View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    5e13f60 View commit details
    Browse the repository at this point in the history
  7. feat: replace JSON.dump with str

    This commit replaces the JSON.dump method with a simple str method since
    it is highly unlikely that the string contains invalid data.
    
    Co-authored-by: Peter Schroedl <peter_schroedl@me.com>
    rickstaa and pschroedl committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    ce8acc8 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. move pipeline-specific dockerfile

    Peter Schroedl committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    57bd5cf View commit details
    Browse the repository at this point in the history
  2. update openapi yaml

    Peter Schroedl committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    02267cf View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    842466f View commit details
    Browse the repository at this point in the history
  4. add segment anything specific readme

    Peter Schroedl committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    fdd1c31 View commit details
    Browse the repository at this point in the history
  5. update go bindings

    Peter Schroedl committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    74695ab View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. refactor: move SAM2 docker

    This commit moves the SAM2 docker file inside the docker container.
    rickstaa committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    7178ddd View commit details
    Browse the repository at this point in the history
  2. refactor: add FastAPI descriptions

    This commit cleansup the codebase and adds FastAPI parameter and
    pipeline descriptions.
    rickstaa committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    118803e View commit details
    Browse the repository at this point in the history
  3. refactor: improve sam2 route function name

    This commit improves the sam2 route function name so that it is more
    pythonic and shows up nicer in the OpenAPI spec pipeline summary.
    rickstaa committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    c520b49 View commit details
    Browse the repository at this point in the history
  4. chore(worker): update golang bindings

    This commit updates the golang bindings so that the runner changes are
    reflected.
    rickstaa committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    a5b4e73 View commit details
    Browse the repository at this point in the history
  5. refactor(runner): add media_type

    This commit adds the media type content MIME type to the segment
    anything 2 pipeline.
    rickstaa committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    323a376 View commit details
    Browse the repository at this point in the history
  6. chore(worker): remove debug patch

    This commit removes the debug patch which was accidentally added to the
    code.
    rickstaa committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    acd6407 View commit details
    Browse the repository at this point in the history
  7. feat(runnner): add SAM2 model download command

    This commit adds the SAM2 model download command so that orchestrators
    can pre-download the model.
    rickstaa committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    50fcc14 View commit details
    Browse the repository at this point in the history
  8. refactor(worker): change SAM2 multipart reader param order

    This commit ensures that the parameters are in the same order as the
    pipeline parameters.
    rickstaa committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    fc8a33d View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    6cd1a4a View commit details
    Browse the repository at this point in the history
  10. fix: fix examples

    This commit fixes the example scripts.
    rickstaa committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    225dfd5 View commit details
    Browse the repository at this point in the history