examples: Add example usage scripts for `torch_tensorrt.dynamo.compile` path [1.1 / x] #1966

gs-olive · 2023-05-31T22:22:04Z

Description

Add sample scripts covering resnet18, transformers, and custom examples showcasing the torch_tensorrt.dynamo.compile path, which can compile models with data-dependent control flow and other such restrictions which can make other compilation methods more difficult
Cover different customizable features allowed in the new backend
Upgrade Torch version across the stack
Update Dynamo sample with advanced usage to indicate usage of new options argument in torch.compile
Enable options argument in torch.compile including improved input handling in the default torch_tensorrt backend

Fixes #1887

Type of change

Code samples

Checklist:

[ x ] My code follows the style guidelines of this project (You can use the linters)
[ x ] I have performed a self-review of my own code
[ x ] I have commented my code, particularly in hard-to-understand areas and hacks
[ x ] I have made corresponding changes to the documentation
[ x ] I have added tests to verify my fix or my feature
[ x ] New and existing unit tests pass locally with my changes
[ x ] I have added the relevant labels to my PR in so that relevant reviewers are notified

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to Python style guidelines

github-actions

Code conforms to Python style guidelines

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to Python style guidelines

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to Python style guidelines

github-actions

Code conforms to Python style guidelines

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to Python style guidelines

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to Python style guidelines

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to Python style guidelines

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to Python style guidelines

examples/dynamo/dynamo_compile_transformers_example.py

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to Python style guidelines

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to Python style guidelines

examples/dynamo/dynamo_compile_resnet_example.py

github-actions

Code conforms to Python style guidelines

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to Python style guidelines

github-actions

Code conforms to Python style guidelines

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to Python style guidelines

- Add sample scripts covering resnet18, transformers, and custom examples showcasing the `torch_tensorrt.dynamo.compile` path, which can compile models with data-dependent control flow and other such restrictions which can make other compilation methods more difficult - Cover different customizeable features allowed in the new backend - Make scripts Sphinx-Gallery compatible Python files fix: Update `index.rst` - Show individual links in sidebar chore: Add note about Cuda Driver Error - Update arguments to Dynamo compile call in line with new schema updates fix: Update function calls to address API changes fix: Update file and reference naming for new API

Signed-off-by: Naren Dasan <naren@narendasan.com> Signed-off-by: Naren Dasan <narens@nvidia.com>

github-actions

Code conforms to C++ style guidelines

github-actions

Code conforms to Python style guidelines

gs-olive added component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths Story: Dynamo Compile Improvements Issues relating to improvement of the Dynamo compile path labels May 31, 2023

gs-olive requested a review from narendasan May 31, 2023 22:22

gs-olive assigned narendasan and gs-olive May 31, 2023

facebook-github-bot added the cla signed label May 31, 2023

github-actions bot added the documentation Improvements or additions to documentation label May 31, 2023

github-actions bot approved these changes May 31, 2023

View reviewed changes

This was referenced May 31, 2023

examples: Add example usage scripts for torch_tensorrt.dynamo.compile path #1890

Closed

feat: Prototype Module-Acceleration in Dynamo #1921

Closed

github-actions bot approved these changes Jun 1, 2023

View reviewed changes

gs-olive force-pushed the dynamo_torch_compile_examples branch from fea6a92 to 12b5525 Compare June 2, 2023 03:00

github-actions bot added component: api [Python] Issues re: Python API component: build system Issues re: Build system labels Jun 2, 2023

github-actions bot approved these changes Jun 2, 2023

View reviewed changes

gs-olive force-pushed the dynamo_torch_compile_examples branch from 12b5525 to d695d8d Compare June 2, 2023 03:26

github-actions bot approved these changes Jun 2, 2023

View reviewed changes

gs-olive force-pushed the dynamo_torch_compile_examples branch from d695d8d to 36b7b59 Compare June 2, 2023 03:55

github-actions bot approved these changes Jun 2, 2023

View reviewed changes

gs-olive force-pushed the dynamo_torch_compile_examples branch from 36b7b59 to 73007c3 Compare June 2, 2023 04:34

github-actions bot approved these changes Jun 2, 2023

View reviewed changes

gs-olive force-pushed the dynamo_torch_compile_examples branch from 73007c3 to c10c4ec Compare June 2, 2023 19:41

gs-olive force-pushed the dynamo_torch_compile_examples branch from 1410206 to 94a7942 Compare July 12, 2023 17:21

github-actions bot approved these changes Jul 12, 2023

View reviewed changes

gs-olive force-pushed the dynamo_torch_compile_examples branch from 94a7942 to 7e5f96c Compare July 12, 2023 17:29

github-actions bot approved these changes Jul 12, 2023

View reviewed changes

gs-olive commented Jul 12, 2023

View reviewed changes

examples/dynamo/dynamo_compile_transformers_example.py Show resolved Hide resolved

gs-olive force-pushed the dynamo_torch_compile_examples branch from 407c299 to c64566a Compare July 21, 2023 21:40

github-actions bot approved these changes Jul 21, 2023

View reviewed changes

gs-olive commented Jul 25, 2023

View reviewed changes

examples/dynamo/dynamo_compile_resnet_example.py Outdated Show resolved Hide resolved

github-actions bot approved these changes Jul 25, 2023

View reviewed changes

gs-olive force-pushed the dynamo_torch_compile_examples branch from 36823e8 to 4141601 Compare July 25, 2023 22:24

github-actions bot approved these changes Jul 25, 2023

View reviewed changes

gs-olive force-pushed the dynamo_torch_compile_examples branch from 4141601 to 0fb56e8 Compare August 1, 2023 16:47

github-actions bot approved these changes Aug 1, 2023

View reviewed changes

gs-olive and others added 2 commits August 1, 2023 19:56

Reorg docs and fix css for sphix-gallery examples (#1967)

968aca4

Signed-off-by: Naren Dasan <naren@narendasan.com> Signed-off-by: Naren Dasan <narens@nvidia.com>

gs-olive force-pushed the dynamo_torch_compile_examples branch from 0fb56e8 to 968aca4 Compare August 2, 2023 02:56

github-actions bot approved these changes Aug 2, 2023

View reviewed changes

gs-olive merged commit 28fd11a into main Aug 2, 2023

gs-olive deleted the dynamo_torch_compile_examples branch August 2, 2023 16:25

examples: Add example usage scripts for torch_tensorrt.dynamo.compile path [1.1 / x] #1966

examples: Add example usage scripts for torch_tensorrt.dynamo.compile path [1.1 / x] #1966

Uh oh!

Conversation

gs-olive commented May 31, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Type of change

Checklist:

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

examples: Add example usage scripts for `torch_tensorrt.dynamo.compile` path [1.1 / x] #1966

examples: Add example usage scripts for `torch_tensorrt.dynamo.compile` path [1.1 / x] #1966

gs-olive commented May 31, 2023 •

edited

Loading