Release v0.4.0

Welcome to the latest release of Kit! We've added some exciting new features and improvements.

New Features

dev Command Now Available on Windows and Linux

You can now test your LLM applications locally on Windows and Linux using the kit dev command, which was previously available only on macOS.

We've integrated the llamafile project to implement the dev command, enhancing cross-platform compatibility.

Packaging Changes

To keep kit easy to use in automation pipelines, llamafile is no longer included by default in Kit packages. Instead, it is downloaded when the dev command is invoked. For users who need to work offline, we provide packages that include llamafile, marked as "offline".

📖 Learn more: See the kit dev documentation for additional details.

New --filter Option for kit info Command

We've made scripting with Kitfile values easier. The kit info command now supports a new --filter flag that allows you to select specific values from your Kitfile.

Example

Suppose you have the following Kitfile:

manifestVersion: 1.0.0
package:
  # ...
model:
  name: llama3.2-1b-1B-instruct-f16
  path: ./llama3.2-1b-1B-instruct-f16.gguf
  license: LLAMA 3.2 COMMUNITY LICENSE AGREEMENT
  description: Llama 3.2 1B instruct model
# ...

To get the path value of the model, run:

kit info model:tag --filter model.path

This command returns:

 `./llama3.2-1b-1B-instruct-f16.gguf`

What's Changed

• Bump the actions-minor group with 3 updates by @dependabot in #576
• docs: update CLI documentation for v0.3.4 by @github-actions in #575
• Fixed TAG_NAME environment variable assignment by @brett-hodges in #577
• Updates to why and use cases by @bmicklea in #580
• Docs for containerizing and Kubernetes deployment by @bmicklea in #579
• fix trailing spaces by @bmicklea in #581
• feat: add back to top button by @SagarSharma101 in #561
• Node selection capability by @srikary12 in #541
• Update deploy.md by @javisperez in #582
• Make release container job depend on release job in actions by @amisevsk in #578
• Changes to the homepage by @javisperez in #585
• Update README with Deploy and Dagger by @bmicklea in #588
• Add Dagger to docs by @bmicklea in #586
• Switch dev Command to Use llamafile by @gorkem in #559
• add deploy & dagger to README by @bmicklea in #593

New Contributors

• @SagarSharma101 made their first contribution in #561

Full Changelog: v0.3.4...v0.4.0