Skip to content

context : do not reserve scheduler for warmups#18867

Merged
ggerganov merged 1 commit intomasterfrom
gg/context-no-reserve-on-warmup
Jan 15, 2026
Merged

context : do not reserve scheduler for warmups#18867
ggerganov merged 1 commit intomasterfrom
gg/context-no-reserve-on-warmup

Conversation

@ggerganov
Copy link
Member

cont #18547

Fixes an increased compute buffer after the changes in #18547. No need to reserve for warmup runs as they typically use a small batch that should fit in the original buffers without causing reallocations.

@ggerganov ggerganov merged commit be8e3d9 into master Jan 15, 2026
70 of 73 checks passed
@ggerganov ggerganov deleted the gg/context-no-reserve-on-warmup branch January 15, 2026 17:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Comments