Skip to content

Pull requests: triton-inference-server/server

New pull request New
65 Open 3,867 Closed
65 Open 3,867 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: update ov runtime to 2025.0
#8011 opened Feb 12, 2025 by dtrawins Loading…
6 of 22 tasks
test: Add test for ORCA
#8009 opened Feb 12, 2025 by indrajit96 Loading…
8 of 20 tasks
14
fix: enable deployment on OpenShift
#8005 opened Feb 11, 2025 by solacelost Loading…
9 of 22 tasks
1
6
ci: Fix flaky L0_batch related tests PR: ci Changes to our CI configuration files and scripts
#7999 opened Feb 10, 2025 by yinggeh Loading…
6 of 11 tasks
@yinggeh
3
fix: build-secret flag not being set breaking build.py
#7993 opened Feb 6, 2025 by BenjaminBraunDev Loading…
3
docs: Remove copies of openai documentation
#7985 opened Feb 3, 2025 by statiraju Loading…
2
draft: feat: Add graceful shutdown timer to GRPC frontend enhancement New feature or request grpc Related to the GRPC server
#7969 opened Jan 27, 2025 by mattwittwer • Draft
5 of 20 tasks
@mattwittwer
2
Separate model generation for backends on blackwell clusters
#7966 opened Jan 24, 2025 by pvijayakrish Loading…
3 of 20 tasks
@pvijayakrish
2
docs: update to fix autoscaling example command
#7883 opened Dec 16, 2024 by mattwittwer • Draft
20 tasks
refactor: Update the response queue in the server to reuse response slots
#7879 opened Dec 13, 2024 by pskiran1 Loading…
5 of 20 tasks
12
build: enabled build behind proxy
#7842 opened Nov 28, 2024 by dtrawins Loading…
6 of 22 tasks
3
feat: ORCA Format KV Cache Utilization in Inference Response Header
#7839 opened Nov 27, 2024 by BenjaminBraunDev Loading…
12 of 22 tasks
86
refactor: Refactor of L0_backend_python and the env subtest PR: ci Changes to our CI configuration files and scripts PR: refactor A code change that neither fixes a bug nor adds a feature
#7838 opened Nov 27, 2024 by nv-kmcgill53 • Draft
5 of 20 tasks
ci: Enables testing for pull requests
#7828 opened Nov 23, 2024 by pranavm-nvidia Loading…
3 of 20 tasks
@rmccorm4
1
test: Updates L0 Python API tests to run all test files
#7827 opened Nov 23, 2024 by pranavm-nvidia Loading…
4 of 20 tasks
fix: Default max tokens to None for OpenAI frontend.
#7819 opened Nov 20, 2024 by thealmightygrant Loading…
4 of 22 tasks
feat: Adding RestrictedFeatures Support to the Python Frontend Bindings
#7775 opened Nov 8, 2024 by KrishnanPrash Loading…
@KrishnanPrash
46
docs: Add clarification for label_filename in classification docs
#7766 opened Nov 5, 2024 by trevoryao Loading…
7 of 22 tasks
Build: Fixing model generation
#7763 opened Nov 4, 2024 by pvijayakrish Loading…
3 of 20 tasks
1
docs: Simplify PR templates PR: docs Documentation only changes
#7753 opened Oct 29, 2024 by yinggeh Loading…
6 of 11 tasks
@yinggeh
10
[Do not merge!] Build: Remove TRT model generation for V100
#7712 opened Oct 16, 2024 by pvijayakrish • Draft
3 of 20 tasks
2
fix:Split L0_nomodel_perf into 2 test to ensure better debug-ability and resource util for PA
#7705 opened Oct 15, 2024 by indrajit96 • Draft
6 of 19 tasks
test: TC for Metric P0 nv_load_time per model
#7697 opened Oct 14, 2024 by indrajit96 Loading…
8 of 20 tasks
21
Build: Update TRT release branch referenced in model gen file
#7693 opened Oct 11, 2024 by pvijayakrish Loading…
3 of 20 tasks
2
Build: Update README and versions for 24.10
#7686 opened Oct 8, 2024 by pvijayakrish Loading…
3 of 20 tasks
1
ProTip! Exclude everything labeled bug with -label:bug.