Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Runtime Patch] Add AbortSignal to fetchWithCache in ArtifactCacheTemplate interface #17233

Merged
merged 1 commit into from
Aug 2, 2024

Conversation

Neet-Nestor
Copy link
Contributor

This is a patch for a missing change in #17227, where we updated the function parameters of the fetchWithCache function implementations but not the interface.

This tiny patch updated the function signature in the interface as well to make it consistent with the implementation and also to expose it to clients.

@Neet-Nestor
Copy link
Contributor Author

Neet-Nestor commented Aug 1, 2024

@tqchen Sorry for pinging you again for this patch :(

@tqchen tqchen merged commit 219ae85 into apache:main Aug 2, 2024
15 checks passed
CharlieFRuan added a commit to mlc-ai/web-llm that referenced this pull request Aug 8, 2024
No breaking changes. The only diff is the following PR:

- #525
- This PR updates the engine reload() and unload() methods to allow
users to abort an uncompleted reload() by either:
    - call unload() any time before reload() completed
    - call reload() again before the previous reload() completed
- Besides, it fixes the previous issue where `device lost error` is
raised unexpectedly when user simply switches a model

### TVMjs
- To support the above PR, TVMjs is updated and compiled at
apache/tvm@1fcb620
- Difference:
  - Device error lost fix: apache/tvm#17250
  - Add AbortSignal to fetching APIs:
    - apache/tvm#17208
    - apache/tvm#17227
    - apache/tvm#17233
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants