Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update dial-rag-eval.md #132

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Update dial-rag-eval.md #132

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/video demos/demos-for-developers/dial-rag-eval.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,4 +2,4 @@

[Watch the video](https://youtu.be/HYg_L2dxu6U)

The RAG evaluation toolkit consists of three distinct tools: our DIAL Log Parser (https://gitlab.deltixhub.com/Deltix/openai-apps/dial-log-parser), our RAG evaluation library (https://gitlab.deltixhub.com/Deltix/openai-apps/dial-rag-eval), and our RAG evaluation UI. It is used to validate the quality of the retrieval of any RAG-based application.
The RAG evaluation toolkit consists of three distinct tools: our DIAL Log Parser, our RAG evaluation library, and our RAG evaluation UI. The parser converts DIAL logs into usable .parquet files containing all relevant information about prompts, responses, and user feedback. The evaluation library allows you to compare responses and retrieval algorithms with the expected ground truth facts. The UI allows you to visualize and analyze this data. It is used to validate the quality of the retrieval of any RAG-based application.