Skip to content

Latest commit

 

History

History
112 lines (84 loc) · 4.13 KB

README.md

File metadata and controls

112 lines (84 loc) · 4.13 KB
Raw

Azure Functions

Chat using ChatGPT (.NET C# v4 Isolated Function)

This sample shows how to take a ChatGPT prompt as HTTP Get or Post input, calculates the completions using OpenAI ChatGPT service, and then returns the output plus caches in a Blob state store.

Open in GitHub Codespaces

Run on your local environment

Pre-reqs

  1. .NET 7 SDK required and Visual Studio 2022 is strongly recommended
  2. Azure Functions Core Tools ``
  3. OpenAPI API key
  4. Export these secrets as Env Vars using values from Step 3.

Mac/Linux

export OPENAI_API_KEY=*Paste from step 3*

Windows

Search for Environment Variables in Settings, create new System Variables similarly to these instructions:

Variable Value
OPENAI_API_KEY Paste from step 3
  1. Add this local.settings.json file to the text_summarize folder to simplify local development and include Key from step 3
{
  "IsEncrypted": false,
  "Values": {
    "AzureWebJobsStorage": "UseDevelopmentStorage=true",
    "FUNCTIONS_WORKER_RUNTIME": "dotnet-isolated",
    "OPENAI_API_KEY": "*Paste from step 3*"
  }
}

Using Functions CLI

  1. Open a new terminal and do the following:
func start
  1. Using your favorite REST client, e.g. RestClient in VS Code, PostMan, curl, make a post. test.http has been provided to run this quickly.

Terminal:

curl -i -X POST http://localhost:7071/api/chat/ \
  -H "Content-Type: text/json" \
  --data-binary "@testdata.json"

testdata.json

{
    "prompt": "Write a poem about Azure Functions.  Include two reasons why users love them."
}

test.http

POST http://localhost:7071/api/chat HTTP/1.1
content-type: application/json

{
    "prompt": "Write a poem about Azure Functions.  Include two reasons why users love them."
}

You will see chat happen in the Terminal standard out, the HTTP response, and saved off to a Blob for state management in the samples-chatgpt-output container.

Using Visual Studio

  1. Open chatgpt.sln using Visual Studio 2022 or later.
  2. Press Run/F5 to run in the debugger
  3. Use same approach above to test using an HTTP REST client

Using Visual Studio Code

  1. Open this folder in a new terminal
  2. Open VS Code by entering code . in the terminal
  3. Press Run/Debug (F5) to run in the debugger
  4. Use same approach above to test using an HTTP REST client

Source Code

The key code that makes this work is as follows in ./chat_function.cs. C# uses an HTTP REST API wrapper function called OpenAICreateCompletion plus user defined Record types for convenience and type safety. You can customize this or learn more snippets using Examples and OpenAPI Playground. Choose CURL/HTTP as the language and set CreateDefaultCompletionRequest values accordingly.

// call OpenAI ChatGPT API here with desired chat prompt
var completion = await OpenAICreateCompletion("text-davinci-003", GeneratePrompt(prompt), 0.9m, 64, logger);

var choice = completion.choices[0];
logger.LogInformation($"Completions result: {choice}");

response = req.CreateResponse(HttpStatusCode.OK);
await response.WriteAsJsonAsync<Choice>(choice);

return response;

Deploy to Azure

The easiest way to deploy this app is using the Azure Dev CLI aka AZD. If you open this repo in GitHub CodeSpaces the AZD tooling is already preinstalled.

To provision and deploy:

azd up