You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
At the moment, users need to run 2 pipelines to get evaluation metrics: the pipeline that iterates over the documents to get retrieved contexts and predicted answers, and a second pipeline to get the evaluation metrics. All the metrics in the library have individual, as well as aggregated scores. It would be great if there could be a simple way to visualise the trace for the specific RAG query alongside the evaluation pipeline trace for that query.
Describe the solution you'd like
So for example, I would like to have the trace for a specific RAG query together with the trace for the ExactAnswerMatch evaluator run on the same query/answer.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
At the moment, users need to run 2 pipelines to get evaluation metrics: the pipeline that iterates over the documents to get retrieved contexts and predicted answers, and a second pipeline to get the evaluation metrics. All the metrics in the library have individual, as well as aggregated scores. It would be great if there could be a simple way to visualise the trace for the specific RAG query alongside the evaluation pipeline trace for that query.
Describe the solution you'd like
So for example, I would like to have the trace for a specific RAG query together with the trace for the ExactAnswerMatch evaluator run on the same query/answer.
The text was updated successfully, but these errors were encountered: