Update to latest candle version?

[vrdn-23]

Hey,
First off, Thanks for the amazing project.

I have a question relating to dependency management for the service. Apologies if this may seem silly, but is there a particular reason why this library is using the Cargo packages of candle from forks of the official repo?

The newest candle library has access to some new models like deberta-v2 (see huggingface/candle#2743) which is a highly requested model from this library (see #354 #281, #199, #238), so I was curious if there is any particular reason that prevents us from following the official release cycle of candle?

cc @OlivierDehaene @Narsil @alvarobartt

[vrdn-23]

Bumping this in the hopes for a maintainer response
cc @Narsil @McPatate @regisss @alvarobartt @OlivierDehaene

[alvarobartt]

Hey @vrdn-23 thanks for flagging, upgrading to the latest candle version was not so straight forward, but @Narsil managed to do it and is now on main as per

text-embeddings-inference/Cargo.toml

Lines 51 to 54 in 7d4d9ec

	candle = { version = "0.8", package = "candle-core" }
	candle-nn = { version = "0.8", package = "candle-nn" }
	candle-transformers = { version = "0.8", package = "candle-transformers" }
	candle-flash-attn = { version = "0.8", package = "candle-flash-attn" }

, hope that works! 🤗