Skip to content

Commit

Permalink
Only use the rr evaluation's log when retrying.
Browse files Browse the repository at this point in the history
  • Loading branch information
maleadt committed Jan 10, 2024
1 parent 6c3a9f8 commit cdf8916
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion src/evaluate.jl
Original file line number Diff line number Diff line change
Expand Up @@ -968,7 +968,9 @@ function evaluate(configs::Vector{Configuration}, packages::Vector{Package}=Pack

# if the rr test crashed in the same way, use that evaluation
if rr_results.status === status && rr_results.reason === reason
(; log, status, reason, version, duration, input_output) = rr_results
# NOTE: we only use the rr log, as other metrics should be
# either identical, or not comparable (e.g., duration)
log = rr_results.log
else
log *= "\n\n" * '#'^80 * "\n# Bug reporting\n#\n\n"
log *= """The package crashed during testing (reason=$reason), but PkgEval was unable to
Expand Down

0 comments on commit cdf8916

Please sign in to comment.