Skip to content

Commit

Permalink
Bugfix: equal-issue mode on offline causing accuracy run to fail (3D-…
Browse files Browse the repository at this point in the history
…UNet) (mlcommons#1624)

Currently 3D-UNet is the only workload using equal-issue mode on Offline scenario. 
Recent code change on LLM equal-issue mode caused 3D-UNet accuracy run to run more than 1 queries, causing the accuracy log to bloat and fail the accuracy checking script.
This change fixes the problem described above.
  • Loading branch information
nv-jinhosuh authored Feb 12, 2024
1 parent 0ed5190 commit f06b920
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion loadgen/loadgen.cc
Original file line number Diff line number Diff line change
Expand Up @@ -315,7 +315,7 @@ std::vector<QueryMetadata> GenerateQueries(
// When sample_concatenate_permutation is turned on, pad to a multiple of the
// complete dataset to ensure fairness.
auto enable_equal_issue = settings.sample_concatenate_permutation;
if (enable_equal_issue)
if (mode != TestMode::AccuracyOnly && enable_equal_issue)
{
if (scenario == TestScenario::Offline &&
samples_per_query % loaded_samples.size() != 0)
Expand Down

0 comments on commit f06b920

Please sign in to comment.