StatementGeneratorPrompt's instruction mentions "statements", but these are not part of inputs anymore

[diegodebrito]

[X ] I have checked the documentation and related resources and couldn't resolve my bug.

Describe the bug
A clear and concise description of what the bug is.

This is probably a minor one. I am just opening for awareness, and it could impact the results when using less capable LLMs.

The instruction for StatementGeneratorPrompt start with "Given a question, an answer, and sentences from the answer [...]", but sentences are not part of the inputs anymore. Just question and answer. I believe this was changed in a recent PR.

ragas/src/ragas/metrics/_faithfulness.py

Line 37 in 2605de5

instruction = "Given a question, an answer, and sentences from the answer analyze the complexity of each sentence given under 'sentences' and break down each sentence into one or more fully understandable statements while also ensuring no pronouns are used in each statement. Format the outputs in JSON."

Ragas version: main branch in this repo
Python version: not applicable

Code to Reproduce

Not applicable

Error trace

Not applicable

Expected behavior

Instruction should reflect the fact that simple statements are extracted from the full answer now, and not the answer statements.

Additional context
Add any other context about the problem here.

[sahusiddharth]

Hi @diegodebrito,

Thank you for pointing that out. I’ve raised a PR to address and fix this issue.