Skip to content

Pull requests: triton-inference-server/server

New pull request New
69 Open 3,881 Closed
69 Open 3,881 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: Configurable grpc infer thread count
#8061 opened Mar 10, 2025 by yinggeh Loading…
1 of 11 tasks
@yinggeh
feat: Add OpenAI frontend multi-LoRA model listing PR: feat A new feature
#8052 opened Mar 4, 2025 by kthui Loading…
9 of 20 tasks
@kthui
11
Build: Build using the PA binaries and whl if available.
#8043 opened Feb 27, 2025 by pvijayakrish Loading…
8 of 20 tasks
4
test: Add OpenAI frontend testing for LLM API backend PR: test Adding missing tests or correcting existing test
#8040 opened Feb 27, 2025 by krishung5 • Draft
3 of 20 tasks
12
feat: Add multi-LoRA support to OpenAI frontend PR: feat A new feature
#8038 opened Feb 26, 2025 by kthui Loading…
9 of 20 tasks
@kthui
13
build: Removed workaround to install libboost-dev. Back to apt-get install build Issues pertaining to builds
#8037 opened Feb 26, 2025 by dmitry-tokarev-nv Loading…
4 of 20 tasks
2
Adding multiple tokenizers specification for open ai frontend
#8027 opened Feb 21, 2025 by oandreeva-nv • Draft
22 tasks
Commit for Draft Changes
#8018 opened Feb 18, 2025 by indrajit96 • Draft
test: Add test for ORCA
#8009 opened Feb 12, 2025 by indrajit96 Loading…
8 of 20 tasks
14
ci: Fix L0_batch related flaky tests PR: ci Changes to our CI configuration files and scripts
#7999 opened Feb 10, 2025 by yinggeh Loading…
6 of 11 tasks
@yinggeh
3
docs: Remove copies of openai documentation
#7985 opened Feb 3, 2025 by statiraju Loading…
3
feat: Add graceful shutdown timer to GRPC frontend enhancement New feature or request grpc Related to the GRPC server
#7969 opened Jan 27, 2025 by mattwittwer Loading…
8 of 20 tasks
@mattwittwer
8
Separate model generation for backends on blackwell clusters
#7966 opened Jan 24, 2025 by pvijayakrish Loading…
3 of 20 tasks
@pvijayakrish
2
docs: update to fix autoscaling example command
#7883 opened Dec 16, 2024 by mattwittwer • Draft
20 tasks
build: enabled build behind proxy
#7842 opened Nov 28, 2024 by dtrawins Loading…
6 of 22 tasks
3
feat: ORCA Format KV Cache Utilization in Inference Response Header
#7839 opened Nov 27, 2024 by BenjaminBraunDev Loading…
12 of 22 tasks
90
refactor: Refactor of L0_backend_python and the env subtest PR: ci Changes to our CI configuration files and scripts PR: refactor A code change that neither fixes a bug nor adds a feature
#7838 opened Nov 27, 2024 by nv-kmcgill53 • Draft
5 of 20 tasks
ci: Enables testing for pull requests
#7828 opened Nov 23, 2024 by pranavm-nvidia Loading…
3 of 20 tasks
@rmccorm4
1
test: Updates L0 Python API tests to run all test files
#7827 opened Nov 23, 2024 by pranavm-nvidia Loading…
4 of 20 tasks
fix: Default max tokens to None for OpenAI frontend.
#7819 opened Nov 20, 2024 by thealmightygrant Loading…
4 of 22 tasks
2
feat: Adding RestrictedFeatures Support to the Python Frontend Bindings
#7775 opened Nov 8, 2024 by KrishnanPrash Loading…
@KrishnanPrash
46
docs: Add clarification for label_filename in classification docs
#7766 opened Nov 5, 2024 by trevoryao Loading…
7 of 22 tasks
Build: Fixing model generation
#7763 opened Nov 4, 2024 by pvijayakrish Loading…
3 of 20 tasks
1
docs: Simplify PR templates PR: docs Documentation only changes
#7753 opened Oct 29, 2024 by yinggeh Loading…
6 of 11 tasks
@yinggeh
10
[Do not merge!] Build: Remove TRT model generation for V100
#7712 opened Oct 16, 2024 by pvijayakrish • Draft
3 of 20 tasks
2
ProTip! Follow long discussions with comments:>50.