Question on Reasoning Enhancement Reproducibility

[nicolay-r]

Dear @scofield7419,

According to the original experiment, it was mentioned that highest results were obtained vith Self-Consistency as follows:

Since the implementation represent a pure contribution from the prospect of THoR, I belive that such technique was not sources in the repository.
If so, I would be delighted if you be able to provide a bit more details onto the following questions:

1. Are there any parameters were affected to vary the reasoning paths of Flan-T5 at generation stage?
2. For aspect (a) and opinion (o), how the voting is applicable?

Thank you very much for your time!