Skip to content

Commit

Permalink
Require equal issue mode for R-GAT (#1968)
Browse files Browse the repository at this point in the history
* Require equal issue mode for R-GAT

* Add equal issue note in readme

---------

Co-authored-by: Miro <mirhodak@amd.com>
  • Loading branch information
pgmpablo157321 and mrmhodak authored Dec 18, 2024
1 parent 03c9666 commit 867def4
Show file tree
Hide file tree
Showing 3 changed files with 6 additions and 0 deletions.
2 changes: 2 additions & 0 deletions graph/R-GAT/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -188,3 +188,5 @@ Go inside the root folder and run benchmark inside the docker container:
cd root
python3 main.py --dataset igbh-dgl --dataset-path igbh/ --profile rgat-dgl-full --device gpu [--model-path <path_to_ckpt>] [--in-memory] [--dtype <fp16 or fp32>] [--scenario <SingleStream, MultiStream, Server or Offline>]
```

**NOTE:** For official submissions, this benchmark is required to run in equal issue mode. Please make sure that the flag `rgat.*.sample_concatenate_permutation` is set to one in the [mlperf.conf](../../loadgen/mlperf.conf) file when loadgen is built.
3 changes: 3 additions & 0 deletions loadgen/mlperf.conf
Original file line number Diff line number Diff line change
Expand Up @@ -42,6 +42,9 @@ retinanet.MultiStream.target_latency = 528
# 3D-UNet uses equal issue mode because it has non-uniform inputs
3d-unet.*.sample_concatenate_permutation = 1

# R-GAT uses equal issue mode because it may have non-uniform inputs
rgat.*.sample_concatenate_permutation = 1

# LLM benchmarks have non-uniform inputs and outputs, and use equal issue mode for all latency scenario
gptj.*.sample_concatenate_permutation = 1
llama2-70b.*.sample_concatenate_permutation = 1
Expand Down
1 change: 1 addition & 0 deletions tools/submission/submission_checker.py
Original file line number Diff line number Diff line change
Expand Up @@ -957,6 +957,7 @@ def requires_equal_issue(self, model, division):
"llama2-70b-99.9",
"mixtral-8x7b",
"llama3-405b",
"rgat",
]
and self.version not in ["v4.0", "v4.1"]
)
Expand Down

0 comments on commit 867def4

Please sign in to comment.