Skip to content

Pull requests: huggingface/text-generation-inference

New pull request New
16 Open 1,448 Closed
16 Open 1,448 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Prepare for release 3.1.0
#2972 opened Jan 30, 2025 by Narsil • Draft
5 tasks
1
feat: add initial qwen2.5-vl model and test
#2971 opened Jan 30, 2025 by drbh • Draft
9 of 13 tasks
Improve Transformers support
#2970 opened Jan 30, 2025 by Cyrilvallez • Draft
[WIP] Kvrouter that will increase the kv-cache hits in case of multiple routing strategy
#2965 opened Jan 29, 2025 by Narsil Loading…
5 tasks
misc(gha): expose action cache url and runtime as secrets
#2964 opened Jan 29, 2025 by mfuntowicz Loading…
3
General fixes for tool calling
#2954 opened Jan 24, 2025 by Trofleb Loading…
2 of 4 tasks
2
Fix tool call response to adhere to OpenAI spec
#2949 opened Jan 24, 2025 by Datta0 Loading…
@drbh
add local file read path for image which could work with dataset like…
#2948 opened Jan 24, 2025 by sywangyi Loading…
5 tasks
2
Improve qwen vl impl
#2943 opened Jan 22, 2025 by drbh Loading…
5 tasks done
16
llava next image encoder to allow un-aligned patch / image sizes
#2936 opened Jan 22, 2025 by jimexist Loading…
5 tasks
3
Update Dockerfile to use devel image for compatibility
#2848 opened Dec 16, 2024 by YaserJaradeh Loading…
2 of 5 tasks
10
Enable qwen2vl video
#2756 opened Nov 18, 2024 by drbh Loading…
9 tasks done
24
Add llama.cpp backend
#2723 opened Nov 4, 2024 by mfuntowicz Loading…
13
Get opentelemetry trace id from request headers instead of creating a new trace
#2648 opened Oct 15, 2024 by kozistr Loading…
3 of 5 tasks
1
3
[WIP] Add gfx1100 support to AMD pytorch build
#2642 opened Oct 13, 2024 by cazlo • Draft
1 of 5 tasks
1
2
Add model_load_time metric
#2311 opened Jul 26, 2024 by Edwinhr716 Loading…
2 of 5 tasks
2
ProTip! Follow long discussions with comments:>50.