What's the proper way to use ChatCompletion in stream mode? #464
Unanswered
DEAN-Cherry
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
According to the doc, it says you should use
CreateCompletionAsStream
to have streaming. However, there is a boolean property inChatCompletionCreateRequest
. I got confused that what is the proper way to use stream mode. There are 4 kinds of combination to use it, likeCreateCompletion
+Stream=true
andCreateCompletionAsStream
+Stream=ture
And I found that when uses
CreateCompletionAsStream
bothDelta.Content
andMessage.Content
are available. What's the different? And which should be used in stream mode?support content
The definition of
ChatCompletionCreateRequest
I also find this definition in
ChatChoiceResponse
. So dose it mean we can use whateverDelta
orMessage
in code?Beta Was this translation helpful? Give feedback.
All reactions