Skip to content

Commit

Permalink
remove mpt-7b due to accuracy failure (#477)
Browse files Browse the repository at this point in the history
In the latest run of Regression test, mpt-7b failed (it was working
before):
https://github.com/CentML/hidet/actions/runs/10949579499/job/30403232598
Removed it.

Co-authored-by: Zhumakhan <nazirzhumakhan@gmail,.com>
  • Loading branch information
2 people authored and vadiklyutiy committed Dec 20, 2024
1 parent 85bb6dd commit 53a0cc4
Showing 1 changed file with 0 additions and 10 deletions.
10 changes: 0 additions & 10 deletions tests/benchmarks/run_configs_full.json
Original file line number Diff line number Diff line change
Expand Up @@ -79,16 +79,6 @@
"dtype_id": 1,
"dtype_name": "float16"
},
{
"type": "model",
"id": 20,
"name": "mpt-7b",
"runfile": "bench_transformer.py",
"param_id": 14,
"param_name": "bs=16,genlen=1",
"dtype_id": 1,
"dtype_name": "float16"
},
{
"type": "model",
"id": 17,
Expand Down

0 comments on commit 53a0cc4

Please sign in to comment.