You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your report related to a problem? Please describe.
There are a few things that are glossed over the evaluation documentation (Evaluation and Writing an Evaluator Plugin)
Evaluator:
How to pass auth to the eval:flow command.
The format of the input.json file for eval:flow.
Writing an Evaluator Plugin:
Add more context to code snippets (eg: it is unclear if regexMatchScore and fillScores are provided in Genkit or if the user should implement)
Provide a simple explanation of the nature of EvaluatorFn.
Is your report related to a problem? Please describe.
There are a few things that are glossed over the evaluation documentation (Evaluation and Writing an Evaluator Plugin)
Evaluator:
auth
to theeval:flow
command.input.json
file foreval:flow
.Writing an Evaluator Plugin:
regexMatchScore
andfillScores
are provided in Genkit or if the user should implement)EvaluatorFn
.Additional context
https://discord.com/channels/1255578482214305893/1309828408141807657
Some Genkit imports were missing / not updated to
0.9
. This was addressed in this PR by @DenisVCode: #1388The text was updated successfully, but these errors were encountered: