[Bug]: <title>graphrag can't index using mistral large 123B with exllamav2

[xxll88]

Do you need to file an issue?

• I have searched the existing issues and this bug is not already filed.
• My model is hosted on OpenAI or Azure. If not, please look at the "model providers" issue and don't file a new one here.
• I believe this is a legitimate bug, not just a question. If this is a question, please use the Discussions area.

Describe the bug

graphrag concurrent_requests: 25 , timeout:180
after 180s, only 5 chat complete , there are too many chat timeout like :
ERROR: Chat completion 2a725977bfa24ff5ad768d0f0cf563d7 cancelled by user.
ERROR: Chat completion b1854e0f70b14a6c906310c3e5a7a7c6 cancelled by user.
ERROR: Chat completion 9aa757db07ba407dab480a61dcd1f44a cancelled by user.
ERROR: Chat completion faab131c61564578b653c5cda80494fe cancelled by user.
ERROR: Chat completion ce1e6fe36f1a4166935bbe211188cbf1 cancelled by user

Steps to reproduce

No response

Expected Behavior

No response

GraphRAG Config Used

# Paste your config here

Logs and screenshots

No response

Additional Information

• GraphRAG Version:
• Operating System:
• Python Version:
• Related Issues:

[AlonsoGuevara]

Hi!
We are consolidating alternate model issues here: #657