Code

Stateless model auth#460

Code

Merged

pandu-k merged 60 commits intomainlinemarqo-ai/marqo:mainlinefrom pandu/model-auth-statelessmarqo-ai/marqo:pandu/model-auth-statelessCopy head branch name to clipboardMay 11, 2023

+3,595-1,224

Commits

Commits on May 3, 2023

• added model auth

  pandu-k

  committed
  9d07322

  Copy full SHA for 9d07322

Commits on May 4, 2023

• Added objects for structure

  pandu-k

  committed
  d5fe616

  Copy full SHA for d5fe616

Commits on May 5, 2023

• introducing AddDocsParams object for addDocuments calls

  Show description for 7993dee
  pandu-k

  committed
  7993dee

  Copy full SHA for 7993dee

• added pydantic plugin advice to dev guide

  pandu-k

  committed
  d28da08

  Copy full SHA for d28da08

• refactored test_add_docs to use AddDocsParams class

  pandu-k

  committed
  187439a

  Copy full SHA for 187439a

• updated tensor search docstring

  pandu-k

  committed
  5df5c4b

  Copy full SHA for 5df5c4b

• refactored tests to work with new AddDocsParams object

  pandu-k

  committed
  4c723ce

  Copy full SHA for 4c723ce

• Commit for refactoring done to test_add_documents_use_existing_tensors.py

  pandu-k

  committed
  d0f2ce1

  Copy full SHA for d0f2ce1

• refactored delete_documents to use the add_documents wrapper

  pandu-k

  committed
  be4b7c6

  Copy full SHA for be4b7c6

• added transitional add_docs wrapper

  pandu-k

  committed
  e7d0d75

  Copy full SHA for e7d0d75

• added transition add docs wrappers to add_documents calls in these test cases

  pandu-k

  committed
  91ce1b4

  Copy full SHA for 91ce1b4

• added transition add docs wrappers to add_documents calls in these test cases

  pandu-k

  committed
  efade22

  Copy full SHA for efade22

• test updated to use new add_docs param object

  pandu-k

  committed
  c37bac8

  Copy full SHA for c37bac8

• cleaning up tests with issues

  pandu-k

  committed
  79f998d

  Copy full SHA for 79f998d

Commits on May 7, 2023

• made progress integrating s3

  pandu-k

  committed
  a8aabd1

  Copy full SHA for a8aabd1

• add docs, s3 works

  pandu-k

  committed
  d9d1e1a

  Copy full SHA for d9d1e1a

• search seems to work (it at least passes through the auth info OK)

  pandu-k

  committed
  aea82b2

  Copy full SHA for aea82b2

Commits on May 8, 2023

• added boto to reqs add hf skeleton funcs

  pandu-k

  committed
  ba37d88

  Copy full SHA for ba37d88

• Merge branch 'mainline' into pandu/model-auth-stateless

  Show description for 120c60d
  pandu-k

  committed
  120c60d

  Copy full SHA for 120c60d

• added changes

  pandu-k

  committed
  c939927

  Copy full SHA for c939927

• fixed test_bulk_search_different_models_separate_vectorise_calls

  pandu-k

  committed
  d8dca7d

  Copy full SHA for d8dca7d

• created test_model_auth_s3 ()

  pandu-k

  committed
  729b189

  Copy full SHA for 729b189

• test_model_auth_s3() asserts boto3 client instantiation

  pandu-k

  committed
  68a5e76

  Copy full SHA for 68a5e76

• made assertions about the presence of the model file

  pandu-k

  committed
  7965439

  Copy full SHA for 7965439

• added hf loading tests

  pandu-k

  committed
  85a368c

  Copy full SHA for 85a368c

• added tests for hf, s3 search

  pandu-k

  committed
  926269d

  Copy full SHA for 926269d

• added test for s3/hf mismatch

  pandu-k

  committed
  5142612

  Copy full SHA for 5142612

• test refactor

  pandu-k

  committed
  a2f9f0f

  Copy full SHA for a2f9f0f

• added cuda test

  pandu-k

  committed
  5e40a76

  Copy full SHA for 5e40a76

Commits on May 9, 2023

• add_docs parses model auth str

  pandu-k

  committed
  a9a15e9

  Copy full SHA for a9a15e9

• corrected add_docs derivatives test

  pandu-k

  committed
  16d7156

  Copy full SHA for 16d7156

• removed unused vectorise params

  pandu-k

  committed
  c4aee67

  Copy full SHA for c4aee67

• fixed bug, not passing through auth in multimodal_combination

  pandu-k

  committed
  1f6c6a6

  Copy full SHA for 1f6c6a6

• added test for no creds

  pandu-k

  committed
  f026d88

  Copy full SHA for f026d88

• added test_bad_creds_error_s3

  pandu-k

  committed
  f027be9

  Copy full SHA for f027be9

• test for access to non existent hf repo

  pandu-k

  committed
  995c028

  Copy full SHA for 995c028

• Added test_after_downloading_search_doesnt_redownload

  pandu-k

  committed
  81b586e

  Copy full SHA for 81b586e

• fixed checking loaded models

  pandu-k

  committed
  98c42ad

  Copy full SHA for 98c42ad

• added from_s3 tests

  pandu-k

  committed
  f556476

  Copy full SHA for f556476

• Merge branch 'mainline' into pandu/model-auth-stateless

  Show description for 5124da1
  pandu-k

  committed
  5124da1

  Copy full SHA for 5124da1

• added from_hf tests

  pandu-k

  committed
  355ce27

  Copy full SHA for 355ce27

• added test_custom_clip_utils.py

  Show description for 4fbf9d0
  pandu-k

  committed
  4fbf9d0

  Copy full SHA for 4fbf9d0

• added call to search before add docs parallel

  pandu-k

  committed
  b0999f7

  Copy full SHA for b0999f7

• Added search call before parallel add_docs

  pandu-k

  committed
  8ecf5f5

  Copy full SHA for 8ecf5f5

Commits on May 10, 2023

• fixed casing issue in SearchQuery

  pandu-k

  committed
  79b9ccc

  Copy full SHA for 79b9ccc

• fixed tests

  pandu-k

  committed
  23ec8b6

  Copy full SHA for 23ec8b6

• completed custom clip utils test

  pandu-k

  committed
  0750c85

  Copy full SHA for 0750c85

• updated version

  pandu-k

  committed
  bc539ad

  Copy full SHA for bc539ad

• improved error msg, added bulk search tests

  pandu-k

  committed
  ac628cd

  Copy full SHA for ac628cd

• made custom clip tests stricter

  pandu-k

  committed
  920f4e3

  Copy full SHA for 920f4e3

• added device to model auth cuda setup

  pandu-k

  committed
  8a8e864

  Copy full SHA for 8a8e864

• added tests for CLIP._download_from_repo

  pandu-k

  committed
  aeb7415

  Copy full SHA for aeb7415

• added CLIP.load() tests

  pandu-k

  committed
  53f53b9

  Copy full SHA for 53f53b9

• added OPEN_CLIP.load() tests

  pandu-k

  committed
  fcdd9b7

  Copy full SHA for fcdd9b7

• fixed private model and test

  pandu-k

  committed
  41f30ef

  Copy full SHA for 41f30ef

• corrected HF auth and location inheritance

  pandu-k

  committed
  143238a

  Copy full SHA for 143238a

• removed test_put_documents_orchestrator() as put_documents is deprecated

  pandu-k

  committed
  7b13dea

  Copy full SHA for 7b13dea

Commits on May 11, 2023

• Merge branch 'mainline' into pandu/model-auth-stateless

  pandu-k

  authored
  81bbcf1

  Copy full SHA for 81bbcf1

• corrected version

  pandu-k

  committed
  fb878c9

  Copy full SHA for fb878c9

• Merge remote-tracking branch 'origin/pandu/model-auth-stateless' into pandu/model-auth-stateless

  pandu-k

  committed
  f381068

  Copy full SHA for f381068