We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 89a0315 commit ff8c400Copy full SHA for ff8c400
docs/source/design/v1/prefix_caching.md
@@ -86,7 +86,7 @@ To improve privacy in shared environments, vLLM supports isolating prefix cache
86
{"role": "user", "content": "Here is a document with details about the world series: ..."},
87
{"role": "user", "content": "Who won the world series in 2020?"}
88
],
89
- "cache_salt": "Z3V2bmV3aGxza3ZubGFoZ3Zud3V3ZWZ2bmd0b3V2bnZmc2xpZ3RoZ2x2aQ=="
+ "cache_salt": "your-cache-salt"
90
}
91
```
92
0 commit comments