Skip to content

Issues: explodinggradients/ragas

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

320 Open 740 Closed
320 Open 740 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Trouble using Faithfulness Metric with HHEM-2.1-Open bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#2027 opened May 3, 2025 by awlevin
1
want to see integration with crewAI or autogen
#2025 opened Apr 29, 2025 by aggarwaln1
How can we integrate Ragas with WebdriverIO question Further information is requested
#2024 opened Apr 25, 2025 by hameeda2
[ERROR] Prompt xxx failed to parse output:The output parser failed to parse the output including retries. bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#2022 opened Apr 22, 2025 by 674717172
@jjmachan
1
Context Precision score heavily influenced by position of relevant contexts in array bug Something isn't working module-metrics this is part of metrics module
#2013 opened Apr 15, 2025 by mshobana1990
4
Seperate Evaluation for Retrieval and Generation both question Further information is requested
#2010 opened Apr 14, 2025 by PrashantDixit0
3
ragas evaluator function is taking LLM model as none even it is passed in evaluator's function call bug Something isn't working module-metrics this is part of metrics module
#2006 opened Apr 13, 2025 by manaligc
1
Multi-Modal Testset Generation enhancement New feature or request module-testsetgen Module testset generation
#2002 opened Apr 9, 2025 by wabeg
1
How do I put ragas outputs into a clean JSON, like the JSON that I can get from the dashboard? question Further information is requested
#2001 opened Apr 9, 2025 by AmirPoursaberi
1
Nvidia Accuracy calculation code is not consistent with the docs bug Something isn't working module-metrics this is part of metrics module
#2000 opened Apr 8, 2025 by vitorsabbagh
1
3
Error code 500 Internal Server Error bug Something isn't working
#1998 opened Apr 8, 2025 by VishalSharma2103
Exception raised in Job[2]: RagasOutputParserException(The output parser failed to parse the output including retries.) bug Something isn't working question Further information is requested
#1997 opened Apr 7, 2025 by shanchao0906
5
Llama4 as Evaluator enhancement New feature or request
#1996 opened Apr 7, 2025 by PrashantDixit0
1
UnicodeEncodeError in the third get_started tutorial bug Something isn't working
#1992 opened Apr 3, 2025 by ker2xu
AttributeError when I try to use ContextRelevance, LLMContextPrecisionWithoutReference to evaluate the test dataset bug Something isn't working module-metrics this is part of metrics module
#1990 opened Apr 2, 2025 by Haoyuxiaohan
1
3
FactualCorrectness() failed to fix bad intermediate output bug Something isn't working
#1989 opened Apr 1, 2025 by Nyoko74
2
ValueError: No nodes that satisfied the given filter. Try changing the filter. occurs because the generate_personas_from_kg function in the ragas library is unable to find any nodes in the knowledge graph (KG) that match the specified filter criteria. bug Something isn't working module-testsetgen Module testset generation
#1988 opened Apr 1, 2025 by gshravendra
3
Origin of Persona-Based Synthetic Test Dataset Generation question Further information is requested
#1985 opened Mar 28, 2025 by xXFiEsTaDeAmOnXx
@shahules786
Misleading documentation for "LLM Based Context Precision without reference" bug Something isn't working documentation Improvements or additions to documentation
#1981 opened Mar 26, 2025 by muhammadyaseen
1
Turning on cache renders generate_multiple useless bug Something isn't working
#1980 opened Mar 24, 2025 by Nicba1010
Ensure question variedness when using ResponseRelevancy bug Something isn't working module-metrics this is part of metrics module
#1979 opened Mar 24, 2025 by aabanic
1 task done
BaseRagasLLM overriding temperature results in PydanticPrompt.generate generating identical responses due to temperature being mapped to effectively 0 when n is 1 bug Something isn't working module-metrics this is part of metrics module
#1976 opened Mar 23, 2025 by aabanic
1 task done
Questions About Metrics Changes from Ragas v0.1 to v0.2 module-metrics this is part of metrics module question Further information is requested
#1975 opened Mar 22, 2025 by TWGraceChen
Error: Attribute error:'float' object has no attribute 'response' bug Something isn't working module-metrics this is part of metrics module question Further information is requested
#1972 opened Mar 19, 2025 by haritha789665
Non-English QA generation is not working bug Something isn't working module-testsetgen Module testset generation question Further information is requested
#1970 opened Mar 18, 2025 by whisper-bye
ProTip! no:milestone will show everything without a milestone.