install from source without Annoy/SentenceTransformers

[krannnn]

Hello,

in the release notes of v0.5.0 it is mentioned:

Refactored imports to allow installing from source without Annoy/SentenceTransformers (would need a custom embedding search provider to work).

@drazvan can you please help with the instructions/commands to install without Annoy/SentenceTransformers?

Thanks

[drazvan]

@krannnn: are you installing from source or the 0.5.0 version? For the latter, you would have to uninstall annoy/sentence transformers. For the former, you can remove them from requirements.txt before installing.

The second step is to register a custom embedding search provider. See the second example here: https://github.com/NVIDIA/NeMo-Guardrails/blob/develop/docs/user_guides/advanced/embedding-search-providers.md

core:
  embedding_search_provider:
    name: default
    parameters:
      embedding_engine: openai
      embedding_model: text-embedding-ada-002

knowledge_base:
  embedding_search_provider:
    name: default
    parameters:
      embedding_engine: openai
      embedding_model: text-embedding-ada-002

Let me know if this helps.

[krannnn]

@drazvan Thanks for the quick turnaround.
I run into this issue after uninstalling annoy and sentence-transformers.

[2023-12-09 15:37:51 +0000] [14] [ERROR] Exception in worker process
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/gunicorn/arbiter.py", line 609, in spawn_worker
    worker.init_process()
  File "/usr/local/lib/python3.9/site-packages/uvicorn/workers.py", line 66, in init_process
    super(UvicornWorker, self).init_process()
  File "/usr/local/lib/python3.9/site-packages/gunicorn/workers/base.py", line 134, in init_process
    self.load_wsgi()
  File "/usr/local/lib/python3.9/site-packages/gunicorn/workers/base.py", line 146, in load_wsgi
    self.wsgi = self.app.wsgi()
  File "/usr/local/lib/python3.9/site-packages/gunicorn/app/base.py", line 67, in wsgi
    self.callable = self.load()
  File "/usr/local/lib/python3.9/site-packages/gunicorn/app/wsgiapp.py", line 58, in load
    return self.load_wsgiapp()
  File "/usr/local/lib/python3.9/site-packages/gunicorn/app/wsgiapp.py", line 48, in load_wsgiapp
    return util.import_app(self.app_uri)
  File "/usr/local/lib/python3.9/site-packages/gunicorn/util.py", line 371, in import_app
    mod = importlib.import_module(module)
  File "/usr/local/lib/python3.9/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 850, in exec_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "/fastapi_app/main.py", line 3, in <module>
    from app.routers import (question_answering,
  File "/fastapi_app/app/routers/question_answering.py", line 1, in <module>
    from app.guardrails.llm_rails_singleton import LLMRailsSingleton
  File "/fastapi_app/app/guardrails/llm_rails_singleton.py", line 1, in <module>
    from nemoguardrails import LLMRails
  File "/fastapi_app/NeMo-Guardrails/nemoguardrails/__init__.py", line 18, in <module>
    from .rails import LLMRails, RailsConfig
  File "/fastapi_app/NeMo-Guardrails/nemoguardrails/rails/__init__.py", line 17, in <module>
    from .llm.llmrails import LLMRails
  File "/fastapi_app/NeMo-Guardrails/nemoguardrails/rails/llm/llmrails.py", line 27, in <module>
    from nemoguardrails.actions.llm.generation import LLMGenerationActions
  File "/fastapi_app/NeMo-Guardrails/nemoguardrails/actions/llm/generation.py", line 47, in <module>
    from nemoguardrails.kb.kb import KnowledgeBase
  File "/fastapi_app/NeMo-Guardrails/nemoguardrails/kb/kb.py", line 22, in <module>
    from annoy import AnnoyIndex
ModuleNotFoundError: No module named 'annoy'

I'm using the library in a Python 3.9 image and after installing Nemoguardrails, the size went from 2gb ((initially) to around 10gb after the installation.

[drazvan]

@krannnn: can you try #225 and see if it works?