.Net: Bug: HTTP 404 - POST /chat/completions

[johnholliday]

Describe the bug
Exception thrown: 'Microsoft.SemanticKernel.HttpOperationException' in mscorlib.dll
Exception thrown: 'System.AggregatException' in mscorlib.dll
HTTP 404 (invalid_request_error: unknown_url)

Unknown request URL: POST /chat/completions. Please check the URL for typos, or see the docs at https://platform.openai.com/docs/api-reference/.
HTTP 404 (invalid_request_error: unknown_url)

To Reproduce

var builder = Kernel.CreateBuilder();
builder.AddOpenAIChatCompletion("gpt-4o", OPENAI_APIKEY);
var _kernel = builder.Build();

var service = _kernel.GetRequiredService<IChatCompletionService>();

var settings = new OpenAIPromptExecutionSettings
{
    Temperature = 1.05F,
    TopP = 1F,
    MaxTokens = 4096,
    ResponseFormat = "json_object"
};

var chat = new ChatHistory();
var ct = new CancellationTokenSource();
chat.AddUserMessage("tell me something good");
var content = await service.GetChatMessageContentsAsync(chat, settings, _kernel, ct.Token);

Expected behavior
'content' variable contains the message result.

Platform

• OS: Windows 11
• IDE: Visual Studio 2022
• Language: C#
• Source: Microsoft.SemanticKernel v 1.18.2

Additional context
Was working, then suddenly started throwing this exception.

[johnholliday]

Exception:

HTTP 404 (invalid_request_error: unknown_url)

Unknown request URL: POST /chat/completions. Please check the URL for typos, or see the docs at https://platform.openai.com/docs/api-reference/.

Inner Exception StackTrace:

   at OpenAI.ClientPipelineExtensions.<ProcessMessageAsync>d__0.MoveNext()
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at OpenAI.Chat.ChatClient.<CompleteChatAsync>d__14.MoveNext()
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at OpenAI.Chat.ChatClient.<CompleteChatAsync>d__5.MoveNext()
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Microsoft.SemanticKernel.Connectors.OpenAI.ClientCore.<RunRequestAsync>d__65`1.MoveNext()
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task task)
   at Microsoft.SemanticKernel.Connectors.OpenAI.ClientCore.<GetChatMessageContentsAsync>d__15.MoveNext()

RequestUri:

[evchaki]

@dmytrostruk - can you quickly look into this. Seems like something might have changed during the last update.

[evchaki]

@johnholliday - I tried this also and did not get any errors. One thing to try locally is to hard code your model and key into AddOpenAIChatCompletion to see if there is something broken in the variables you currently have.

[daverant]

I'm seeing this in both v1.18.2 and v1.19.0.

Integration tests previously passing are now consistently failing when updating from 1.17.2.

Microsoft.SemanticKernel.HttpOperationException : HTTP 404 (invalid_request_error: unknown_url)

Unknown request URL: POST /chat/completions. Please check the URL for typos, or see the docs at https://platform.openai.com/docs/api-reference/.
  ----> System.ClientModel.ClientResultException : HTTP 404 (invalid_request_error: unknown_url)

Unknown request URL: POST /chat/completions. Please check the URL for typos, or see the docs at https://platform.openai.com/docs/api-reference/.
   at Microsoft.SemanticKernel.Connectors.OpenAI.ClientCore.RunRequestAsync[T](Func`1 request)
   at Microsoft.SemanticKernel.Connectors.OpenAI.ClientCore.GetChatMessageContentsAsync(String targetModel, ChatHistory chat, PromptExecutionSettings executionSettings, Kernel kernel, CancellationToken cancellationToken)
   at Microsoft.SemanticKernel.ChatCompletion.ChatCompletionServiceExtensions.GetChatMessageContentAsync(IChatCompletionService chatCompletionService, ChatHistory chatHistory, PromptExecutionSettings executionSettings, Kernel kernel, CancellationToken cancellationToken)
--ClientResultException
   at OpenAI.ClientPipelineExtensions.ProcessMessageAsync(ClientPipeline pipeline, PipelineMessage message, RequestOptions options)
   at OpenAI.Chat.ChatClient.CompleteChatAsync(BinaryContent content, RequestOptions options)
   at OpenAI.Chat.ChatClient.CompleteChatAsync(IEnumerable`1 messages, ChatCompletionOptions options, CancellationToken cancellationToken)
   at Microsoft.SemanticKernel.Connectors.OpenAI.ClientCore.RunRequestAsync[T](Func`1 request)

[markwallace-microsoft]

Hi @daverant, can you provide some more details on how your integration test is structured so we can troubleshoot this.

[rogerbarreto]

@daverant

The code provided does not represent a potential failure for the test, as @markwallace-microsoft suggested we need more context or the full test code.

Some extra info:

When updating to the new OpenAI SDK for our new OpenAI Connector 1.18.2 we had a limitation that was enforced from their SDK where the SDK will enforce the endpoints to end with v1/chat/completions, before endpoints that finished with chat/completions where enough.

[CesarEContreras]

I just recently started a new project and wanted to try it out. First run and got the same error.

Unknown request URL: POST /chat/completions. Please check the URL for typos, or see the docs at https://platform.openai.com/docs/api-reference/.
---> System.ClientModel.ClientResultException: HTTP 404 (invalid_request_error: unknown_url)

Unknown request URL: POST /chat/completions. Please check the URL for typos, or see the docs at https://platform.openai.com/docs/api-reference/.
    at OpenAI.ClientPipelineExtensions.ProcessMessageAsync(ClientPipeline pipeline, PipelineMessage message, RequestOptions options)
    at OpenAI.Chat.ChatClient.CompleteChatAsync(BinaryContent content, RequestOptions options)
    at OpenAI.Chat.ChatClient.CompleteChatAsync(IEnumerable 1 messages, ChatCompletionOptions options, CancellationToken cancellationToken)
    at Microsoft.SemanticKernel.Connectors.OpenAI.ClientCore.RunRequestAsync[T](Func1 request)
--- End of inner exception stack trace ---

[rogerbarreto]

Please confirm if you are using OpenAI.beta10 or OpenAI.beta11 versions.

This may happen if you are using the beta11 against 1.18.2 or 1.19.0 which is targeting OpenAI.beta10.

The URL behavior in beta11 changed, and we have a PR to update our connectors to the latest version.

Before we have this sorted in our next release, please use the OpenAI.beta10 to address your 404 error.