- 
                Notifications
    
You must be signed in to change notification settings  - Fork 557
 
feat:AutoAlign guardrail updates #867
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat:AutoAlign guardrail updates #867
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you @KimiJL, what do you think about adding a warning in the community section that there are backward incompatible changes in v0.12.0 version of the toolkit. As the flow names and config params have changed?
I'm going to take a closer look next week.
Please use
[PLACEHOLDER]{warning}
THE WARNING TEXT
[PLACEHOLDER]
change the [PLACEHOLDER] to ```
| 
           @Pouyanpi Thanks for the suggestion, it makes sense to me. I have added the warning under the updated guardrails, please let me know if that is the expected format.  | 
    
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me, thanks 👍🏻
Description
API Changes: Alignment Configuration Name Change
Added new config + flow for AutoAlign factchecker
A new fact check guardrail that takes the user message and bot message to generate a score from AutoAlign service, and depending on user set threshold from .co file (default to 0.5), a warning log will be produced with the score if below set threshold.
Previous factcheck/groundedness check has been fully renamed to groundedness check, and the same knowledge base factual scoring remains
Added multi_language parameter support
A new optional parameter that enables support for languages beyond English
Related Issue(s)
N/A
Checklist