Embeddings Example?

[ggaabe]

Hi, I was wondering if there's any chance there could be an embeddings example made with this project?

Someone had asked about it before here:
#270

And the example that's linked doesn't seem to actually use this project package at all.

[CharlieFRuan]

Thanks for the question! Embedding models were supported in MLC-LLM a month ago (mlc-ai/mlc-llm#2249) and hence there is no technical blocker to support in WebLLM with WebGPU acceleration but only a matter of time. Will be a TODO from us, hopefully within a few weeks

[ggaabe]

any chance this might happen soonish?

[Bert0324]

any updates

[CharlieFRuan]

Hi @ggaabe @Bert0324, npm 0.2.60 has initial support for embedding and RAG, check out usage here: https://github.com/mlc-ai/web-llm/tree/main/examples/embeddings

Currently only snowflake-arctic-embedding is supported.

Closing for now, feel free to open new issues.