Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add ability to reevaluate runs #142

Open
leondz opened this issue Jun 19, 2023 · 0 comments · May be fixed by #833
Open

add ability to reevaluate runs #142

leondz opened this issue Jun 19, 2023 · 0 comments · May be fixed by #833
Labels
enhancement Architectural upgrades reporting Reporting, analysis, and other per-run result functions

Comments

@leondz
Copy link
Owner

leondz commented Jun 19, 2023

requires #141

  • --reeval [jsonl] do eval over detected attempts again (i.e. using stored output; don't generate any new output)
@leondz leondz added the reporting Reporting, analysis, and other per-run result functions label Jun 19, 2023
@leondz leondz added the enhancement Architectural upgrades label Dec 1, 2023
@leondz leondz linked a pull request Aug 21, 2024 that will close this issue
Open
@leondz leondz linked a pull request Aug 21, 2024 that will close this issue
harness: Detector only #833
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement Architectural upgrades reporting Reporting, analysis, and other per-run result functions
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

harness: Detector only vidushiMaheshwari/garak
1 participant
@leondz