Bump onnxruntime from 1.16.1 to 1.17.0 in /llm-server

[dependabot]

Bumps onnxruntime from 1.16.1 to 1.17.0.

Release notes

Sourced from onnxruntime's releases.

ONNX Runtime v1.17.0

Announcements

In the next release, we will totally drop support for Windows ARM32.

General

• Added support for new ONNX 1.15 opsets: IsInf-20, IsNaN-20, DFT-20, ReduceMax-20, ReduceMin-20, AffineGrid-20, GridSample, ConstantOfShape-20, RegexFullMatch, StringConcat, StringSplit, and ai.onnx.ml.LabelEncoder-4.
• Updated C/C++ libraries: abseil, date, nsync, googletest, wil, mp11, cpuinfo, safeint, and onnx.

Build System and Packages

• Dropped CentOS 7 support. All Linux binaries now require glibc version >=2.28, but users can still build the source code for a lower glibc version.
• Added CUDA 12 packages for Python and Nuget.
• Added Python 3.12 packages for ONNX Runtime Inference. ONNX Runtime Training Python 3.12 packages cannot be provided at this time since training packages depend on PyTorch, which does not support Python 3.12 yet.
• Linux binaries (except those in AMD GPU packages) are built in a more secure way that is compliant with BinSkim's default policy (e.g., the binaries no longer have an executable stack).
• Added support for Windows ARM64X for users who build ONNX Runtime from source. No prebuilt package provided yet.
• Removed Windows ARM32 binaries from official packages. Users who still need these binaries can build them from source.
• Added AMD GPU package with ROCm and MiGraphX (Python + Linux only).
• Split ONNX Runtime GPU Nuget package into two packages.
• When building the source code for Linux ARM64 or Android, the C/C++ compiler must support BFloat16. Support for Android NDK 24.x has been removed. Please use NDK 25.x or 26.x instead.
• Link time code generation (LTCG or LTO) is now disabled by default when building from source. To re-enable it, users can add "--enable_lto" to the build command. All prebuilt binaries are still built with LTO.

Core

• Optimized graph inlining.
• Allow custom op to invoke internal thread-pool for parallelism.
• Added support for supplying a custom logger at the session level.
• Added new logging and tracing of session and execution provider options.
• Added new dynamic ETW provider that can trace/diagnose ONNX internals while maintaining great performance.

Performance

• Added 4bit quant support on NVIDIA GPU and ARM64.

EPs

TensorRT EP

• Added support for direct load of precompiled TensorRT engines and customizable engine prefix.
• Added Python support for TensorRT plugins via ORT custom ops.
• Fixed concurrent Session::Run bugs.
• Updated calls to deprecated TensorRT APIs (e.g., enqueue_v2 → enqueue_v3).
• Fixed various memory leak bugs.

QNN EP

• Added support for QNN SDK 2.18.
• Added context binary caching and model initialization optimizations.
• Added mixed precision (8/16 bit) quantization support.
• Add device-level session options (soc_model, htp_arch, device_id), extreme_power_saver for htp_performance_mode, and vtcm_mb settings.
• Fixed multi-threaded inference bug.
• Fixed various other bugs and added performance improvements.
• QNN profiling of the NPU can be enabled dynamically with ETW or write out to CSV.

OpenVINO EP

• Added support for OpenVINO 2023.2.
• Added AppendExecutionProvider_OpenVINO_V2 API for supporting new OpenVINO EP options.

... (truncated)

Commits

• 5f0b62c [ORT 1.17.0 Release] Cherry-pick Final Round (#19327)
• 3fd94a8 [ORT 1.17.0 Release] Cherry pick 1st round (#19243)
• daafe63 cherry pick qnn sdk 2.18 updates into release branch (#19197)
• a63b71e Cherry-pick "Fix buildJava from Zip-Nuget-Java-Nodejs Packaging Pipeline (#19...
• 80f274c Fix SkipLayerNormalization shape inference (#18724)
• e2e488d Revert "iOS packaging pipeline stability" (#19135)
• c92f72e Merge Linux Nuget GPU pipeline with zip-nuget (#19120)
• 8d4369b Update DirectML nuget version to 1.13.1 (#19122)
• 1bab989 [WebNN EP] Fixed bug in int8 data type processing (#19134)
• 9dee543 fix gemm beta for fp16 (#19153)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)