How to get logprobs from openai? #7550
Unanswered
ewvikienkr
asked this question in
Questions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
input
Output
{'replies': ['Hello! How can I assist you today?'], 'meta': [{'model': 'gpt-3.5-turbo-0125', 'index': 0, 'finish_reason': 'stop', 'usage': {'completion_tokens': 9, 'prompt_tokens': 9, 'total_tokens': 18}}]}
As you can see logprobs nor top_logprobs are included even though they are supported parameters https://platform.openai.com/docs/api-reference/chat/create?lang=python.
Am I doing something wrong or is this actually not supported?
Beta Was this translation helpful? Give feedback.
All reactions