Problems with fallback configuration

[rodrigoSantosZup]

What Happened?

When it's instantiated a client for portkey, and invoked the chat.completions.create function, we found some possible problems when we configure the fallback process.

1. No matter if i overload the custom_host field inside config payload. The custom host never changes when we trigger the endpoint to use other deployments.
   

2. i've already passed the azure api_version when the client was instantiated, but if i do not pass again on fallback config, the result will be a 404 not found because portkey tries to hit the model endpoint with undefined apiVersion.
   

3. With this configuration, i got the fallback, but it always happen, no matter the configuration to trigger only when receive a 429 status code.
   

What Should Have Happened?

No response

Relevant Code Snippet

No response

Your Twitter/LinkedIn

https://www.linkedin.com/in/rodrigo-costa-59203632/