Add support for litellm and dozens of other providers

README.md

@@ -16,10 +16,10 @@ First things first! You can install the SDK with pip as follows:
 pip install observers
 ```
 
-Or if you want to use AISuite, you can install the SDK with pip as follows:
+Or if you want to use other LLM providers through AISuite or Litellm, you can install the SDK with pip as follows:
 
 ```bash
-pip install observers[aisuite]
+pip install observers[aisuite] # or observers[litellm]
 ```
 
 ## Usage

examples/observers/litellm_example.py

@@ -0,0 +1,17 @@
+import os
+
+from litellm import completion
+from observers.observers import wrap_litellm
+
+# ensure you have both `ANTHROPIC_API_KEY` and `OPENAI_API_KEY` environment variables set
+os.environ["OPENAI_API_KEY"] = "your-api-key"
+os.environ["ANTHROPIC_API_KEY"] = "your-api-key"
+
+completion = wrap_litellm(completion)
+
+models = ["gpt-3.5-turbo", "claude-3-5-sonnet-20240620"]
+messages = [{"content": "Hello, how are you?", "role": "user"}]
+
+for model in models:
+    response = completion(model=model, messages=messages, temperature=0.75)
+    print(response.choices[0].message.content)