Skip to content

Conversation

@zackangelo
Copy link

Still WIP, new cudarc version makes it difficult to deal with optional tensors and device pointers, need to fix and clean up that logic in candle-layernorm.

@vrdn-23
Copy link

vrdn-23 commented Nov 7, 2025

Thanks for raising this @zackangelo. Is this something that you're still actively working on? I am trying to do some work on the TEI repo to keep the dependencies up-to-date and getting the candle-extensions in line with the latest cudarc and candle would be really helpful

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants