From 0b7cc4b41980b7771aa12f8a82c1a7a0e92c9d63 Mon Sep 17 00:00:00 2001 From: ishaan-jaff Date: Mon, 23 Oct 2023 10:31:01 -0700 Subject: [PATCH] (docs) testing gcp proxy --- docs/my-website/docs/simple_proxy.md | 13 +++++++++++++ 1 file changed, 13 insertions(+) diff --git a/docs/my-website/docs/simple_proxy.md b/docs/my-website/docs/simple_proxy.md index dcd090467516..ddd525fd0649 100644 --- a/docs/my-website/docs/simple_proxy.md +++ b/docs/my-website/docs/simple_proxy.md @@ -70,6 +70,19 @@ Looking for the CLI tool/local proxy? It's [here](./proxy_server.md) On a successfull deploy your Cloud Run Shell will have this output +## Testing your deployed proxy +```shell +curl https://litellm-7yjrj3ha2q-ue.a.run.app/v1/chat/completions \ + -H "Content-Type: application/json" \ + -H "Authorization: Bearer litellm" \ + -d '{ + "model": "gpt-3.5-turbo", + "messages": [{"role": "user", "content": "Say this is a test!"}], + "temperature": 0.7, + "api_key": your-openai-api-key + }' +``` + ### Set LLM API Keys #### Environment Variables More info [here](https://cloud.google.com/run/docs/configuring/services/environment-variables#console)