Logging LLM provider request ids as gen_ai attributes

[dinmukhamedm]

It would be very useful for debugging purposes (e.g. with OpenAI support) to have a unique identifier to an LLM call span. Has OpenLLMetry considered adding something like gen_ai.request.id attribute?

The biggest challenge I see with this is that they are not unified, and formatted differently across providers and even across endpoints of a single provider (e.g. completions vs assistant). Generally, there is a request-wide unique ID though, and if there is none, the attribute can obviously remain optional.

[dinmukhamedm]

Also, saw this comment in the code of semantic conventions from 6 months ago. Looks like this was planned but never executed?

[nirga]

Do you mean to log an ID returned by the provider? Or our own random ID?

[nirga]

Yes definitely something we need to add!

[codefromthecrypt]

ok, so this is gen_ai.response.id.. or something different?

[dinmukhamedm]

Yes, that. I've not seen it implemented in OpenLLMetry libraries though

[nirga]

@dinmukhamedm we need to add it! I'm converting this to an issue

[dinmukhamedm]

@nirga thanks! Closing this discussion, and I will respond on the issue if I find time to contribute at least partially

[dinmukhamedm]

Closing in favor of #2236