Support all features for ChatGLM3 (system prompt / function call / code interpreter) #197
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Run
chatglm3_demo.py
for all ChatGLM3 features.API changes:
Pipeline.chat
now accepts a list ofChatMessage
with role/content info instead of a list of plain text, and returns aChatMessage
(sync generate) or multipleDeltaMessage
s (stream generate)tokenizer.encode_history
totokenizer.encode_messages