Onnxruntime capture artifacts; dry run #14
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adds two commits.
First, adds ability to set a cache dir and a bundles dir. Each runtime can report a cache dir and, if set, will be mounted into the container. Similarly, it can report a bundles dir, which also will be mounted.
These are particularly useful for onnxruntime, where it creates a bundle from onnx, and then runs the bundle. Compiling the onnx to the bundle is by far the majority of time to get running (sometimes >90%). Those artifacts are cached in a given directory, but if it is ephemeral inside the container, it is lost. That means each run after the first takes up to ten times as long as it should be until it can start inference.
Second, for simplicity sake, adds a
nekko run --dry-runoption, so it can print out what it will run indocker runand then exit.