Open
Description
There seems to currently be a mixture of OOP principles as well as functional principles throughout the codebase. Some of these seem like they can be combined.
For example, MMLUEvaluator implements all common functionality in a base abstract class which its variants then inherit.
However; MTBench seems to implement some base methods in the class, but also call out to generate_answers
functionally, which seems counterintuitive to intended functionality.
We should combine this into the existing abstract class or make everuthing functional.
Metadata
Metadata
Assignees
Labels
No labels