Feat/azure inference support

[b4s36t4]

Title:

• Added support to communicate with azure inference API

Related Issues: (optional)

• [Provider] Azure Model Inference API  #492

[narengogi]

LGTM, only adding provider field is required

[b4s36t4]

Stream:

curl --request POST \
  --url <gateway_url>/v1/chat/completions \
  --header 'Authorization: API_KEY' \
  --header 'content-type: application/json' \
  --header 'x-portkey-azure-api-version: 2024-05-01-preview' \
  --header 'x-portkey-azure-deployment-name: Llama-2-7b-chat-cgnkg' \
  --header 'x-portkey-azure-deployment-type: serverless' \
  --header 'x-portkey-azure-region: eastus' \
  --header 'x-portkey-provider: azure-ai' \
  --data '{
  "messages": [
    {
      "role": "system",
      "content": "You are a helpful assistant"
    },
    {
      "role": "user",
      "content": "Hello?"
    }
  ],
  "stream": true
}'

Non-Stream

curl --request POST \
  --url <gateway_url>/v1/chat/completions \
  --header 'Authorization: API_KEY' \
  --header 'content-type: application/json' \
  --header 'x-portkey-azure-api-version: 2024-05-01-preview' \
  --header 'x-portkey-azure-deployment-name: Llama-2-7b-chat-cgnkg' \
  --header 'x-portkey-azure-deployment-type: serverless' \
  --header 'x-portkey-azure-region: eastus' \
  --header 'x-portkey-provider: azure-ai' \
  --data '{
  "messages": [
    {
      "role": "system",
      "content": "You are a helpful assistant"
    },
    {
      "role": "user",
      "content": "Hello?"
    }
  ]
}'

[b4s36t4]

https://github.com/Azure/azure-sdk-for-python/blob/31688d9ab355f96384dc3b2bdaee84a3b5c7f021/sdk/ml/azure-ai-ml/azure/ai/ml/operations/_local_endpoint_helper.py#L88-L89

[VisargD]

Can we also add fields in requstValidator schema