Skip to content

b1445

  • b1445
  • 6e08281

  • Verified

    This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
    GPG key ID: 4AEE18F83AFDEB23
    Expired
    Verified
    Learn about vigilant mode
  • Compare
    Choose a tag to compare
b1445: Extend llama_kv_cache_seq_rm to allow matching any sequence (#3843)
  • b1445
  • 6e08281
  • Compare
    Choose a tag to compare

  • Verified

    This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
    GPG key ID: 4AEE18F83AFDEB23
    Expired
    Verified
    Learn about vigilant mode
@KerfuffleV2 KerfuffleV2 tagged this 29 Oct 17:31 
* Extend llama_kv_cache_seq_rm to allow matichng any sequence

* Replace llama_kv_cache_tokens_rm with llama_kv_cache_clear

Use llama_kv_cache_clear for cache clearing

Change calls to llama_kv_cache_tokens_rm that want to delete by position to use llama_kv_cache_seq_rm functionality
Assets 2
Loading