Skip to content

Pull requests: openvinotoolkit/openvino.genai

New pull request New
33 Open 1,118 Closed
33 Open 1,118 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add parametrization for the detokenization/decoding category: GenAI C++ API Changes in GenAI C++ public headers category: GHA CI based on Github actions category: LLM LLM pipeline (stateful, static) category: Python API Python API for GenAI category: tokenizers Tokenizer class or submodule update enhancement New feature or request no-match-files
#1246 opened Nov 21, 2024 by pavel-esir Loading… 2025.0
[Prompt lookup] category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers no-match-files
#1245 opened Nov 21, 2024 by iefode • Draft
Fix wrong token latency when batch size is greater than 1 bug Something isn't working category: llm_bench Label for tool/llm_bench folder port to LTS PR needs to be ported to LTS
#1244 opened Nov 21, 2024 by wgzintel • Queued 2025.0
@eaidova
Update requirements.txt and add requirements_2024.5.txt category: llm_bench Label for tool/llm_bench folder category: sampling Sampling / Decoding algorithms
#1242 opened Nov 21, 2024 by wgzintel Loading…
@eaidova @andrei-kochin
6
Static llm pipeline dynamic shape model category: LLM LLM pipeline (stateful, static) category: samples GenAI samples
#1240 opened Nov 20, 2024 by AsyaPronina • Draft
[WWB]: Added ability to compare results for previously collected outputs w/o models provided category: WWB PR changes WWB
#1238 opened Nov 20, 2024 by AlexKoff88 Loading… 2025.0
@AlexKoff88
1
Parallel sampling category: cmake / build Cmake scripts category: continuous batching Continuous batching category: sampling Sampling / Decoding algorithms no-match-files
#1233 opened Nov 19, 2024 by mzegla • Draft
2
Add LongBench validation category: continuous batching Continuous batching
#1220 opened Nov 18, 2024 by l-bat • Draft
Move beam search in case of chat scenario to sampler.cpp category: continuous batching Continuous batching category: LLM LLM pipeline (stateful, static) category: visual language Visual language pipeline no-match-files
#1215 opened Nov 14, 2024 by sbalandi Loading… 2025.0
@ilya-lavrenov @Wovchena
34
Added chat template to CLI. category: WWB PR changes WWB
#1208 opened Nov 13, 2024 by andreyanufr • Draft
[CPU] Change kvcache default type of PagedAttention to u8 for CPU plugin category: continuous batching Continuous batching category: GHA CI based on Github actions
#1206 opened Nov 13, 2024 by luo-cheng2021 • Draft 2025.0
3
Test master logits category: LLM LLM pipeline (stateful, static) category: samples GenAI samples category: sampling Sampling / Decoding algorithms do_not_merge do_not_review
#1201 opened Nov 12, 2024 by Wovchena • Draft
StaticLLMPipeline: Optimize kvcache copy category: LLM LLM pipeline (stateful, static) category: NPU
#1199 opened Nov 12, 2024 by yviansu Loading…
13
[JS] Add GenAI Node.js bindings category: cmake / build Cmake scripts category: samples GenAI samples category: tokenizers Tokenizer class or submodule update do_not_merge no-match-files
#1193 opened Nov 11, 2024 by vishniakov-nikolai • Draft
3 tasks
ONNX <= 1.17.0
#1183 opened Nov 11, 2024 by ilya-lavrenov Loading… 2025.0
@Wovchena
Added basic git based code checks #663 category: GHA CI based on Github actions
#1181 opened Nov 9, 2024 by rishik-ashili Loading…
2
[Speculative decoding] Alignment Speculative decoding vs Continuous batching results with many requests category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding
#1171 opened Nov 7, 2024 by iefode Loading… 2025.0
@ilya-lavrenov
2
Preserve default config for LLM samples category: samples GenAI samples category: sampling Sampling / Decoding algorithms
#1152 opened Nov 6, 2024 by Wovchena Loading…
2
Add GPU FP16 overflow fix category: WWB PR changes WWB do_not_merge
#1120 opened Nov 1, 2024 by AlexKoff88 • Draft
@ilya-lavrenov
4
Verify chatglm3 6b category: GHA CI based on Github actions category: sampling Sampling / Decoding algorithms category: tokenizers Tokenizer class or submodule update
#1119 opened Oct 31, 2024 by Aniruddha521 Loading…
1
20
StaticLLMPipeline: Enable chat test
#1117 opened Oct 31, 2024 by TolyaTalamanov Loading… 2025.0
@Wovchena
6
StaticLLMPipeline: Use set_tensor for kvcache model category: LLM LLM pipeline (stateful, static)
#1106 opened Oct 30, 2024 by TolyaTalamanov • Draft
@dmatveev
4
Corrected performance data when batch size is greater than 1 category: sampling Sampling / Decoding algorithms do_not_merge
#1100 opened Oct 29, 2024 by wgzintel • Draft
@pavel-esir @Wovchena
6
[CB] Speculative decoding benchmarking category: LLM LLM pipeline (stateful, static) category: samples GenAI samples category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding
#1037 opened Oct 21, 2024 by iefode • Draft
Grouped source files in GenAI src folder category: cmake / build Cmake scripts category: continuous batching Continuous batching category: GHA CI based on Github actions category: Python API Python API for GenAI category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding category: text to image Text 2 image pipeline category: visual language Visual language pipeline category: whisper Whisper pipeline
#1016 opened Oct 18, 2024 by ilya-lavrenov Loading…
@Wovchena
6
ProTip! Add no:assignee to see everything that’s not assigned.