Skip to content

Conversation

@sanjeed5
Copy link
Contributor

@sanjeed5 sanjeed5 commented Oct 30, 2025

Problem Description:

Documentation structure was outdated and didn't reflect the current library focus on experiments and custom metrics. The library has evolved to emphasize systematic experimentation and custom metrics for evaluating any AI application.

Changes Made

  • Home page (docs/index.md): Added "Why Ragas?" section explaining value proposition and key features. Updated to reflect experiments-first approach, custom metrics, and broader AI application evaluation. Removed FAQ section and improved card descriptions to be more actionable.

  • Get Started (docs/getstarted/index.md): Reorganized to reflect experiments quickstart as the main entry point. Removed links to outdated RAG-focused tutorials (evals.md, rag_eval.md, rag_testset_generation.md). Added Discord community link and organized tutorials into clearer sections.

  • Core Concepts (docs/concepts/index.md): Reordered sections to prioritize Experimentation and Datasets at the top with separate cards. Updated metrics description to reflect both available metrics library and creating custom metrics. Removed Feedback Intelligence card. Moved Components to the end.

  • Navigation (mkdocs.yml): Updated navigation structure to match current library organization. Removed outdated tutorials from Get Started navigation. Flattened Experiments section (Experimentation and Datasets as direct children). Removed Feedback Intelligence from navigation. Reorganized to reflect experiments-first paradigm.

Testing

How to Test

  • Automated tests added/updated: N/A (documentation changes only)
  • Manual testing steps:
    1. Build docs locally: make serve-docs
    2. Navigate through home page and verify "Why Ragas?" section appears
    3. Check Get Started section - experiments quickstart should be prominent
    4. Verify Core Concepts has Experimentation and Datasets at the top
    5. Confirm outdated RAG tutorials are no longer in navigation
    6. Test all internal links work correctly
    7. Verify navigation structure matches current library organization

References

  • Related issues:
  • Documentation: Updated to reflect current library capabilities and focus
  • External references: N/A

Screenshots/Examples (if applicable)

@sanjeed5 sanjeed5 marked this pull request as ready for review October 30, 2025 14:47
@dosubot dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Oct 30, 2025
@sanjeed5 sanjeed5 requested a review from shahules786 October 30, 2025 14:47
… messaging

- Add 'Why Ragas?' section explaining value proposition
- Update key features to emphasize experiments-first approach and custom metrics
- Remove FAQ section (moved to how-to guides)
- Improve card descriptions to be more actionable
- Update Get Started link to point to experiments quickstart
- Move experiments quickstart to prominent Quickstart section
- Remove links to old RAG-focused tutorials (evals.md, rag_eval.md, rag_testset_generation.md)
- Organize tutorials into separate section with clearer descriptions
- Add Discord community link
- Update structure to emphasize experiments-first approach
- Move Experimentation and Datasets to the top with separate cards
- Update metrics description to mention both available and custom metrics
- Remove Feedback Intelligence card from index
- Move Components to the end
- Reorder to match new experiments-first paradigm
- Remove old RAG-focused tutorials from Get Started navigation
- Flatten Experiments section: Experimentation and Datasets as direct children
- Remove Feedback Intelligence from Core Concepts navigation
- Move Components section to after Test Data Generation
- Reorganize Get Started to prioritize experiments quickstart
- Update structure to match new documentation organization
@sanjeed5 sanjeed5 force-pushed the docs/restructure-for-experiments branch from 99c74be to f054514 Compare October 30, 2025 17:27
@sanjeed5 sanjeed5 requested a review from anistark October 30, 2025 17:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:L This PR changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants