-
Notifications
You must be signed in to change notification settings - Fork 8.2k
Closed
Labels
documentationImprovements or additions to documentationImprovements or additions to documentation
Description
openai introduces a new param in chat completion api:
- seed: This feature is in Beta. If specified, our system will make a best effort to
sample deterministically, such that repeated requests with the same seed and
parameters should return the same result. Determinism is not guaranteed, and you
should refer to the system_fingerprint response parameter to monitor changes
in the backend.
"Determinism is not guaranteed" - that's a reason to keep the seed in autogen, but rename it to cache_seed. Then, we'll be able to support both openai seed and autogen seed.
### Tasks
- [x] seed -> cache_seed in code + doc
- [x] add this change to migration guide
- [ ] seed -> cache_seed in notebooks & blogposts for retrieve chat, teachable agent, mathchat
Metadata
Metadata
Assignees
Labels
documentationImprovements or additions to documentationImprovements or additions to documentation