Skip to content

Pull requests: pytorch/TensorRT

New pull request New
26 Open 1,597 Closed
26 Open 1,597 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: Fix additional mem copy of the model during re-export cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime component: tests Issues re: Tests
#3302 opened Nov 22, 2024 by peri044 Loading…
7 tasks
Feat: Initial implementation for automatic plugin cla signed component: api [Python] Issues re: Python API component: build system Issues re: Build system component: conversion Issues re: Conversion stage component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths
#3301 opened Nov 22, 2024 by bowang007 Loading…
7 tasks
1
fix: attribute error caused by trt.BuilderFlag.STRICT_TYPES cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths
#3300 opened Nov 20, 2024 by jiwoong-choi Loading…
7 tasks done
Torch TRT ngc container changes cla signed component: core Issues re: The core compiler component: tests Issues re: Tests
#3299 opened Nov 19, 2024 by apbose • Draft
1
Get decompositions only for CIA ops cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: lowering Issues re: The lowering / preprocessing passes
#3297 opened Nov 18, 2024 by HolyWu Loading…
2 of 7 tasks
1
Replace scaled_dot_product_attention lowering pass with decomposition cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: lowering Issues re: The lowering / preprocessing passes component: tests Issues re: Tests
#3296 opened Nov 17, 2024 by HolyWu Loading…
4 of 7 tasks
6
full_like to full decomposition moving to decomposition.py for dynami… cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: lowering Issues re: The lowering / preprocessing passes component: tests Issues re: Tests
#3289 opened Nov 11, 2024 by apbose Loading…
6
upgrade tensorrt dependency to >=10.3.0,<=10.6.0 build-release-artifacts Build the release artifacts cla signed component: build system Issues re: Build system
#3286 opened Nov 9, 2024 by lanluo-nvidia Loading…
7 tasks
@zewenli98
3
allow null arg_inputs if kwarg_inputs is set cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths
#3282 opened Nov 6, 2024 by technillogue Loading…
5 of 7 tasks
1
feat: Runtime output buffer optimization cla signed component: api [Python] Issues re: Python API component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime
#3276 opened Nov 4, 2024 by keehyuna Loading…
3 of 7 tasks
1
@keehyuna
5
Use INormalizationLayer for GroupNorm cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: tests Issues re: Tests
#3273 opened Nov 4, 2024 by HolyWu Loading…
4 of 7 tasks
16
Fix LayerNorm fp16 precision cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: tests Issues re: Tests
#3272 opened Nov 3, 2024 by HolyWu Loading…
3 of 7 tasks
2
Wrapper module around TRT + pytorch subgraphs cla signed component: api [Python] Issues re: Python API component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime component: tests Issues re: Tests
#3270 opened Oct 31, 2024 by keehyuna Loading…
7 tasks
1
@keehyuna
21
fix: cumsum add_constant bug fix (add dtype for np zeros) cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths
#3258 opened Oct 22, 2024 by chohk88 Loading…
6 of 7 tasks
1
@chohk88
5
using nccl ops from TRT-LLM namespace cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: lowering Issues re: The lowering / preprocessing passes component: torch_compile
#3250 opened Oct 19, 2024 by apbose Loading…
22
chore: adding additional logging to the converter registry system cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths
#3199 opened Oct 1, 2024 by narendasan Loading…
7 tasks done
2
chore: example fixes cla signed component: api [Python] Issues re: Python API component: build system Issues re: Build system component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: lowering Issues re: The lowering / preprocessing passes component: torch_compile
#3176 opened Sep 24, 2024 by peri044 Loading…
7 tasks
1
feat: Support weight-stripped engine and REFIT_IDENTICAL flag cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime component: tests Issues re: Tests component: torch_compile
#3167 opened Sep 19, 2024 by zewenli98 Loading…
7 tasks
1
@zewenli98
55
scatter reduce lowering with include_self=False cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: lowering Issues re: The lowering / preprocessing passes component: tests Issues re: Tests
#3153 opened Sep 11, 2024 by apbose Loading…
3
chore: bug fixes cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: tests Issues re: Tests
#3065 opened Aug 6, 2024 by peri044 Loading…
7 tasks
11
Enabled python runtime saving cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime
#2999 opened Jul 11, 2024 by cehongwang Loading…
7 tasks
5
example: add example of Phi 3 vision model using torch.compile backend cla signed
#2906 opened Jun 11, 2024 by zewenli98 Loading…
7 tasks
@zewenli98
feat: support aten._local_scalar_dense converter Blocked Issue cannot be resolved until a change in a dependency cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: tests Issues re: Tests
#2752 opened Apr 16, 2024 by chohk88 Loading…
5 of 7 tasks
1
@chohk88
8
chore: enabling torchscript core testing in GHA cla signed
#2303 opened Sep 8, 2023 by narendasan Loading…
4
feat: Add toggle for fallback to Inductor cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: torch_compile
#2301 opened Sep 7, 2023 by gs-olive • Draft
7 tasks
1
2
ProTip! Adding no:label will show everything without a label.