Semantic Caching lab #27
vieiraae
announced in
Announcements
Replies: 1 comment
-
|
Not sure this is the right place to ask this. Pls redirect me in case. I know currently azure-openai-semantic-cache-lookup and azure-openai-semantic-cache-store are in preview stage, but do anyone knows how this will behavor for streaming responses ? For nonstream is easy to store and retrive but any one tried or tested the stream responses ? How it behavous with the caches ? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Semantic Caching lab
Playground to try the sementic caching policy.
Get started
Proceed by opening the Jupyter notebook, and follow the steps provided.
Add questions or share feedback bellow
Beta Was this translation helpful? Give feedback.
All reactions