Allow customizing context length in config.toml

[wsxiaoys]

Please describe the feature you want

Tabby currently uses a default value of 1536 for code completion context, which is not configurable. We should expose the configuration in config.toml.

Code location:

tabby/crates/tabby/src/services/completion.rs

Line 269 in 7474711

.max_input_length(1024 + 512)

tabby/crates/tabby-common/src/config.rs

Line 184 in 7474711

pub struct ModelConfigGroup {

tabby/crates/llama-cpp-server/src/supervisor.rs

Line 56 in 7474711

.arg(env::var("LLAMA_CPP_N_CONTEXT_SIZE").unwrap_or("4096".into()))

Additional context
Add any other context or screenshots about the feature request here.

---

Please reply with a 👍 if you want this feature.

[Sma1lboy]

Would it be alright if I take this one? I am interested in contributing to this repository both now and in the future.

[wsxiaoys]

Wei has started working on this at #2649 - I'll open more good first issues this week.