What approach does router end up using?

[Mushoz]

Is there a way to find out what approach ended up being used when using the router? I am not seeing in the logs what approach the router ended up selecting:

2024-11-20 10:03:04,490 - INFO - Received request to /v1/chat/completions
2024-11-20 10:03:04,506 - INFO - Using approach(es) ['router'], operation SINGLE, with model Qwen2.5-Coder-32B-Instruct-Q4_K_S

[codelion]

It is printed right after this line (https://github.com/codelion/optillm/blob/main/optillm/plugins/router_plugin.py#L102): it is not logged via logger right now so may be you missed it.

2024-11-19 13:57:22,687 - INFO - Using approach(es) ['router'], operation SINGLE, with model gemini/gemini-1.5-pro-002
Router predicted approach: z3

[Mushoz]

Apparently when applications log to different channels, docker compose logs (I am running OptiLLM as part of my local LLM docker compose stack) might not output the lines in chronological order, causing me to miss them. Running the application directly allows me to see the proper log messages.