Skip to content

Commit 6d8384f

Browse files
authored
release notes 0.16.0 (#1372)
1 parent 1f35d7c commit 6d8384f

File tree

4 files changed

+26
-1
lines changed

4 files changed

+26
-1
lines changed

docs/project.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
{ "name": "nemo-guardrails-toolkit", "version": "0.15.0" }
1+
{ "name": "nemo-guardrails-toolkit", "version": "0.16.0" }

docs/release-notes.md

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,25 @@ The following sections summarize and highlight the changes for each release.
1212
For a complete record of changes in a release, refer to the
1313
[CHANGELOG.md](https://github.com/NVIDIA/NeMo-Guardrails/blob/develop/CHANGELOG.md) in the GitHub repository.
1414

15+
(v0-16-0)=
16+
17+
## 0.16.0
18+
19+
(v0-16-0-features)=
20+
21+
### Key Features
22+
23+
- Enhanced tracing system with [OpenTelemetry semantic conventions](https://opentelemetry.io/docs/specs/semconv/gen-ai/). To learn more, refer to [](tracing). For usage examples, refer to the following notebooks
24+
- [Tracing Guardrails Quickstart](https://github.com/NVIDIA/NeMo-Guardrails/tree/develop/docs/getting-started/8-tracing/1_tracing_quickstart.ipynb)
25+
- [Tracing Guardrails with Jaeger](https://github.com/NVIDIA/NeMo-Guardrails/tree/develop/docs/getting-started/8-tracing/2_tracing_with_jaeger.ipynb)
26+
- Community integration with [GuardrailsAI](https://www.guardrailsai.com/) and [Pangea AI Guard](https://pangea.cloud/services/ai-guard).
27+
28+
(v0-16-0-other-changes)=
29+
30+
### Other Changes
31+
32+
- Added documentation about using KV cache reuse for LLM-based NemoGuard NIMs. By using KV cache reuse, you can improve the performance of LLM-based NemoGuard NIMs where the system prompt is the same for all calls up to the point where user query and LLM response are injected. To learn more, refer to [](kv-cache-reuse).
33+
1534
(v0-15-0)=
1635

1736
## 0.15.0

docs/user-guides/advanced/kv-cache-reuse.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,5 @@
1+
(kv-cache-reuse)=
2+
13
# KV Cache Reuse for NemoGuard NIM
24

35
When you configure NeMo Guardrails to call NemoGuard NIMs in response to a client request, every NIM call interjecting the input and response adds to the inference latency.

docs/versions1.json

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,10 @@
11
[
22
{
33
"preferred": true,
4+
"version": "0.16.0",
5+
"url": "../0.16.0/"
6+
},
7+
{
48
"version": "0.15.0",
59
"url": "../0.15.0/"
610
},

0 commit comments

Comments
 (0)