Azure Inference Rest Sample and README Issue

[Yionse]

Section Link:

• https://github.com/Azure/azure-sdk-for-js/tree/main/sdk/ai/ai-inference-rest#azure-inference-rest-client-library-for-javascript

Reason:

Link broken.

Section Links:

• https://github.com/Azure/azure-sdk-for-js/blob/main/sdk/ai/ai-inference-rest/samples/v1-beta/typescript/src/embeddings.ts#L34
• https://github.com/Azure/azure-sdk-for-js/blob/main/sdk/ai/ai-inference-rest/samples/v1-beta/javascript/embeddings.js#L34

Reason:

There is a return value, but an exception is thrown.

Section Links:

• https://github.com/Azure/azure-sdk-for-js/blob/main/sdk/ai/ai-inference-rest/samples/v1-beta/javascript/streamingToolCall.js#L73
• https://github.com/Azure/azure-sdk-for-js/blob/main/sdk/ai/ai-inference-rest/samples/v1-beta/javascript/telemetryWithToolCall.js#L92
• https://github.com/Azure/azure-sdk-for-js/blob/main/sdk/ai/ai-inference-rest/samples/v1-beta/javascript/toolCall.js#L73
• https://github.com/Azure/azure-sdk-for-js/blob/main/sdk/ai/ai-inference-rest/samples/v1-beta/typescript/src/streamingToolCall.ts#L89
• https://github.com/Azure/azure-sdk-for-js/blob/main/sdk/ai/ai-inference-rest/samples/v1-beta/typescript/src/telemetryWithToolCall.ts#L90
• https://github.com/Azure/azure-sdk-for-js/blob/main/sdk/ai/ai-inference-rest/samples/v1-beta/typescript/src/toolCall.ts#L73

Reason:

JSON string conversion failed.

@joheredi for notification.

[howieleung]

I can't reproduce issue #2. There is no exception. Here is my output:

I am using node v18.18.2. Could you try to use this node version or tell me what version you are using along with why there is exception?

[howieleung]

1. I can't reproduce the broken link. I went to https://github.com/Azure/azure-sdk-for-js/tree/main/sdk/ai/ai-inference-rest#azure-inference-rest-client-library-for-javascript
   Then I click API reference documentation taken me to
   https://learn.microsoft.com/javascript/api/@azure-rest/ai-inference/

This link works. Please let me know if I miss something.

[howieleung]

Regarding to #3, I also can't reproduce the issue func.arguments.

Anyway, but problem liked this should be end point issue since it fails to return arguments. Anyway, please try again. Maybe downstream has a recent fix. 

[Yionse]

Regarding to #3, I also can't reproduce the issue func.arguments.

Anyway, but problem liked this should be end point issue since it fails to return arguments. Anyway, please try again. Maybe downstream has a recent fix. 

@howieleung Regarding #1 and #2, they do no longer exist. But for #3, it still exists. Can you tell me what your model name is? I tested it based on GPT-35-Turbo.

[howieleung]

I use gpt-4o. The complain on JSON.parse. So let's identify what is being parsed. Can you print func.arguments

[Yionse]

@howieleung If I use GPT-4o, there is no error. But with GPT-35-Turbo, the following error occurs. Does this need to be solved? But they all support /chat/completions.

[howieleung]

It is hard to say whether GPT-35-Turbo supported or not. Because according to

https://openai.com/index/function-calling-and-other-api-updates/

It said, "Developers can now describe functions to gpt-4-0613 and gpt-3.5-turbo-0613"

That imply early version of 35 turbo doesn't support it.

[Yionse]

@howieleung, After testing, it is indeed supported for 0613. Can you consider prompting users to use 0613 version in the sample, since the default version is 0301 now?