Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

token size max #186

Closed
jkf87 opened this issue Oct 10, 2023 · 3 comments
Closed

token size max #186

jkf87 opened this issue Oct 10, 2023 · 3 comments
Labels
duplicate This issue or pull request already exists long context handling Compression to handle long context

Comments

@jkf87
Copy link

jkf87 commented Oct 10, 2023

I'm running the example code (notebook/agentchat_teaching.ipynb) and it keeps getting stuck at token size max.
@sonichi
Copy link
Contributor

sonichi commented Oct 10, 2023

At which step does it get stuck? Is GPT-4-32K used?

@erthman18
Copy link

At which step does it get stuck? Is GPT-4-32K used?

At which step does it get stuck? Is GPT-4-32K used?

I have the same problem. Is there any other method besides 32k? For example, does it support sliding windows?

@sonichi
Copy link
Contributor

sonichi commented Oct 12, 2023

#195 #131 are two methods
And there is a roadmap #156

@sonichi sonichi added duplicate This issue or pull request already exists long context handling Compression to handle long context labels Oct 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
duplicate This issue or pull request already exists long context handling Compression to handle long context
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@sonichi @jkf87 @yiranwu0 @erthman18