v0.0.3

v0.0.3 is a major design change

We have added 3 new metrics that help you answer how factually correct is your generated answers, how relevant are the answers to the question and how relevant are the contexts returned form the retriever to the questions. This gives you a sense of the performance of both you generation and retrieval steps. We also have a "ragas_score" which is unified score to give a single metric about your pipelines.

checkout the quickstart to see how it works: https://github.com/explodinggradients/ragas/blob/main/examples/quickstart.ipynb

v0.0.3rc1

feat: make `Result` more usefull (#39)

- added a few tests too

0.0.2

What's Changed

• Update README by @shahules786 in #27
• Added evaluation benchmark by @shahules786 in #29
• Fix bert score by @shahules786 in #30
• Update Readme by @shahules786 in #31
• fix: lazyloading of model used in metrics to speed up import by @jjmachan in #32

Full Changelog: 0.0.1...0.0.2

0.0.1

MVP release!!!

What's Changed

• fix: added a spacy check before installation by @jjmachan in #22
• fix: remove incorrect version by @jjmachan in #23
• Update Metrics info and minor bug fixes by @shahules786 in #24
• Update README by @shahules786 in #25
• fix: some fixes and readme by @jjmachan in #26

Full Changelog: 0.0.1a6...0.0.1

0.0.1a8

What's Changed

• fix: added a spacy check before installation by @jjmachan in #22
• fix: remove incorrect version by @jjmachan in #23
• Update Metrics info and minor bug fixes by @shahules786 in #24
• Update README by @shahules786 in #25

Full Changelog: 0.0.1a6...0.0.1a8

0.0.1a6

What's Changed

• chore: fix issues with released package by @jjmachan in #20
• Initialise all metics by @shahules786 in #21

Full Changelog: 0.0.1a5...0.0.1a6

0.0.1a5

testing release workflow

What's Changed

• chore: mention release environment by @jjmachan in #19

Full Changelog: 0.0.1a4...0.0.1a5

0.0.1a4

Init alpha release

What's Changed

• BertScore metric by @shahules786 in #1
• fix: batching in Metric by @jjmachan in #2
• added edit score by @shahules786 in #6
• added textual entailment score by @shahules786 in #3
• added bleu score by @shahules786 in #4
• feat: added support for variable ground_text by @jjmachan in #5
• feat: added Result by @jjmachan in #7
• fix: some general bug fixes by @jjmachan in #8
• Create python-publish.yml by @jjmachan in #12
• chore: adding a CI/CD pipeline by @jjmachan in #11
• docs: added quickstart by @jjmachan in #14
• Fix Entailment score by @shahules786 in #18
• Added Q-square metric by @shahules786 in #16
• name change belar => ragas by @jjmachan in #15

New Contributors

• @shahules786 made their first contribution in #1
• @jjmachan made their first contribution in #2

Full Changelog: https://github.com/explodinggradients/ragas/commits/0.0.1a4