Skip to content

Commit 4c5e506

Browse files
MMelQinSimoneBendazzoli93
authored andcommitted
Support remote inference on Triton Inference Server with ease of use (Project-MONAI#536)
* Adding requirements for Triton client impl Signed-off-by: M Q <mingmelvinq@nvidia.com> * Updated/added core classes to support Triton remote inference, and added a new example Signed-off-by: M Q <mingmelvinq@nvidia.com> * GitHub build server complains about conflicts for tritonclient[]>=2.54 for no specific reasons Signed-off-by: M Q <mingmelvinq@nvidia.com> * Fix flake8 complaints Signed-off-by: M Q <mingmelvinq@nvidia.com> * Fix pytype complaints by simplifying code Signed-off-by: M Q <mingmelvinq@nvidia.com> * Remove now unused imports Signed-off-by: M Q <mingmelvinq@nvidia.com> * Addressed all pytype and mypy complaint in new code in the dev env Signed-off-by: M Q <mingmelvinq@nvidia.com> * No complaint in local dev env, but on GitHub Signed-off-by: M Q <mingmelvinq@nvidia.com> * Add model confgi.pbtxt and example env settings Signed-off-by: M Q <mingmelvinq@nvidia.com> * Doc update Signed-off-by: M Q <mingmelvinq@nvidia.com> * update license dates Signed-off-by: M Q <mingmelvinq@nvidia.com> * Updated the copyright year of new files Signed-off-by: M Q <mingmelvinq@nvidia.com> --------- Signed-off-by: M Q <mingmelvinq@nvidia.com> Signed-off-by: Simone Bendazzoli <simben@kth.se>
1 parent 5724bbe commit 4c5e506

File tree

2 files changed

+3
-3
lines changed

2 files changed

+3
-3
lines changed

docs/source/getting_started/examples.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -14,3 +14,4 @@
1414
- dicom_series_to_image_app
1515
- breast_density_classifer_app
1616
- cchmc_ped_abd_ct_seg_app
17+
- ai_remote_infer_app

requirements.txt

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,5 @@
1-
holoscan~=3.0
2-
holoscan-cli~=3.0
1+
holoscan~=2.0
32
numpy>=1.21.6
43
colorama>=0.4.1
5-
tritonclient[all]>=2.53.0
4+
tritonclient[all]
65
typeguard>=3.0.0

0 commit comments

Comments
 (0)