Azure OpenAI models only work when connected to a VPN

[qimageonzon]

What happened?

I can only get a response from Azure OpenAI models when connected to a VPN. Otherwise, I get

warn: [OpenAIClient.chatCompletion][stream] API error

which is then followed by

error: [handleAbortError] AI response error; aborting request: Connection error.

Steps to Reproduce

1. Chat with GPT 4o or GPT 4o mini without VPN
2. Connect to a VPN
3. Chat with GPT 4o or GPT 4o mini

What browsers are you seeing the problem on?

Chrome, Microsoft Edge

Relevant log output

Without VPN

LibreChat         | 2024-12-02 07:32:36 warn: [OpenAIClient.chatCompletion][stream] API error
LibreChat         | 2024-12-02 07:32:36 error: [handleAbortError] AI response error; aborting request: Connection error.
chat-meilisearch  | 2024-12-02T07:32:36.790423Z  INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/messages/documents query_parameters= user_agent=node status_code=202}: meilisearch: close time.busy=5.58ms time.idle=13.9ms
chat-meilisearch  | 2024-12-02T07:32:36.821743Z  INFO index_scheduler::batch: document indexing done indexing_result=DocumentAdditionResult { indexed_documents: 1, number_of_documents: 14 }
chat-meilisearch  | 2024-12-02T07:32:36.845219Z  INFO index_scheduler: A batch of tasks was successfully completed with 1 successful tasks and 0 failed tasks.
LibreChat         | 2024-12-02 07:32:37 error: [/assistants] Error listing assistants Connection error.

The logs after connecting VPN and sending the same prompt

chat-mongodb      | {"t":{"$date":"2024-12-02T07:33:02.791+00:00"},"s":"I",  "c":"WTCHKPT",  "id":22430,   "ctx":"Checkpointer","msg":"WiredTiger message","attr":{"message":{"ts_sec":1733124782,"ts_usec":791053,"thread":"1:0x7f8d6dbde6c0","session_name":"WT_SESSION.checkpoint","category":"WT_VERB_CHECKPOINT_PROGRESS","category_id":7,"verbose_level":"DEBUG_1","verbose_level_id":1,"msg":"saving checkpoint snapshot min: 585, snapshot max: 585 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0) base write gen: 1"}}}
chat-meilisearch  | 2024-12-02T07:33:58.793713Z  INFO HTTP request{method=GET host="meilisearch:7700" route=/indexes/convos/documents/004487f3-b92a-40e8-8d03-f10cc83d1121 query_parameters= user_agent=node status_code=200}: meilisearch: close time.busy=164µs time.idle=381µs
chat-meilisearch  | 2024-12-02T07:33:58.811512Z  INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/messages/documents query_parameters= user_agent=node status_code=202}: meilisearch: close time.busy=4.12ms time.idle=19.1ms
chat-meilisearch  | 2024-12-02T07:33:58.850697Z  INFO index_scheduler::batch: document indexing done indexing_result=DocumentAdditionResult { indexed_documents: 1, number_of_documents: 15 }
chat-meilisearch  | 2024-12-02T07:33:58.873893Z  INFO index_scheduler: A batch of tasks was successfully completed with 1 successful tasks and 0 failed tasks.
chat-mongodb      | {"t":{"$date":"2024-12-02T07:34:02.890+00:00"},"s":"I",  "c":"WTCHKPT",  "id":22430,   "ctx":"Checkpointer","msg":"WiredTiger message","attr":{"message":{"ts_sec":1733124842,"ts_usec":890078,"thread":"1:0x7f8d6dbde6c0","session_name":"WT_SESSION.checkpoint","category":"WT_VERB_CHECKPOINT_PROGRESS","category_id":7,"verbose_level":"DEBUG_1","verbose_level_id":1,"msg":"saving checkpoint snapshot min: 595, snapshot max: 595 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0) base write gen: 1"}}}
chat-meilisearch  | 2024-12-02T07:34:03.750209Z  INFO HTTP request{method=GET host="meilisearch:7700" route=/indexes/convos/documents/004487f3-b92a-40e8-8d03-f10cc83d1121 query_parameters= user_agent=node status_code=200}: meilisearch: close time.busy=198µs time.idle=692µs
chat-meilisearch  | 2024-12-02T07:34:03.764500Z  INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/messages/documents query_parameters= user_agent=node status_code=202}: meilisearch: close time.busy=5.64ms time.idle=15.6ms
chat-meilisearch  | 2024-12-02T07:34:03.779515Z  INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/messages/documents query_parameters= user_agent=node status_code=202}: meilisearch: close time.busy=5.74ms time.idle=15.1ms
chat-meilisearch  | 2024-12-02T07:34:03.792785Z  INFO HTTP request{method=POST host="meilisearch:7700" route=/indexes/messages/documents query_parameters= user_agent=node status_code=202}: meilisearch: close time.busy=6.31ms time.idle=18.7ms
chat-meilisearch  | 2024-12-02T07:34:03.802541Z  INFO index_scheduler::batch: document indexing done indexing_result=DocumentAdditionResult { indexed_documents: 1, number_of_documents: 16 }
chat-meilisearch  | 2024-12-02T07:34:03.829699Z  INFO index_scheduler: A batch of tasks was successfully completed with 1 successful tasks and 0 failed tasks.
chat-meilisearch  | 2024-12-02T07:34:03.873404Z  INFO index_scheduler::batch: document indexing done indexing_result=DocumentAdditionResult { indexed_documents: 2, number_of_documents: 16 }
chat-meilisearch  | 2024-12-02T07:34:03.882194Z  INFO index_scheduler: A batch of tasks was successfully completed with 2 successful tasks and 0 failed

Screenshots

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

This is not the case for everyone. Not sure why your IP/network would block it.

[qimageonzon]

Okay thanks for that information.

I have encountered another issue just a while ago, and I believe this discussion thread is the right place to ask as a follow up. We have two identical LibreChat setups on two different servers for work. I was told that the two servers are identical since one is just a clone of the other. Mistral models are present for both servers. In one server, I can chat with Mistral Nemo. In the other server, I get error 422. I am using Edge for this. I get the same error whether I am connected to a VPN or not.

What I find odd is that when connecting to the server that produces error 422 but now using Chrome, I can chat with the model just fine. It works with VPN connected and with VPN not connected. Any idea as to why this is happening?