Skip to content

Local II Update

Pre-release
Pre-release
Compare
Choose a tag to compare
@KillianLucas KillianLucas released this 09 Nov 16:52
· 2204 commits to main since this release
  • Local mode is now powered by LM Studio. Running --local will tell you how to setup LM Studio + connect to it automatically.
  • It's way smaller. Removed the MASSIVE local embedding model, chromadb, oobabooga, a bunch of other packages we didn't really need. Semgrep is now optional.
  • The system message is tighter, so it's cheaper + faster on any LLM.

Several crashes have also been resolved, temperature is now properly set to 0 (which should increase performance on OpenAI models), Powershell on Linux support, an ugly print statement was removed, we're now enforcing a consistent code style (black, isort), and much more:

What's Changed

New Contributors

Full Changelog: v0.1.10...v0.1.11

Great work everyone!