-
Notifications
You must be signed in to change notification settings - Fork 547
docs(tracing): Update tracing notebooks with VDR feedback #1376
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Documentation preview |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## develop #1376 +/- ##
========================================
Coverage 71.62% 71.62%
========================================
Files 171 171
Lines 17021 17021
========================================
Hits 12192 12192
Misses 4829 4829
Flags with carried forward coverage won't be shown. Click here to find out more. 🚀 New features to boost your workflow:
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you Tim, it looks good 👍🏻
Regarding the reqs installation command:
pip install nemoguardrails
would it be better to use nemoguardrails >= 0.16.0
?
something we must tell VDR to be aware of if they are going to re-run the notebooks as we have not released it yet.
Also something very minor:
in 2_tracing_with_jaeger.ipynb
notebook I see in cell 10:
CONFIG_MODELS: Dict[str, str]
but should be List[Dict[str, str]]
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is a nice improvement, thanks Tim. I'm approving, but we should figure out what's causing the bad output from Llama 3.1 8B. Stop token maybe?
* Updated notebook 1 with VDR feedback * Updated notebook 2 (Jaeger) with VDR comments * Replace Llama 3.1 8B with Llama 4 scout as main model * Correct type in cell 10 notebook 2
* Updated notebook 1 with VDR feedback * Updated notebook 2 (Jaeger) with VDR comments * Replace Llama 3.1 8B with Llama 4 scout as main model * Correct type in cell 10 notebook 2
* Updated notebook 1 with VDR feedback * Updated notebook 2 (Jaeger) with VDR comments * Replace Llama 3.1 8B with Llama 4 scout as main model * Correct type in cell 10 notebook 2
Description
Related Issue(s)
Checklist