-
Notifications
You must be signed in to change notification settings - Fork 43
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
how to generate accuracy.txt when generated mlperf_log_accuracy.json with int4_offline #17
Comments
@XiaotaoChen You need to use this script. See here how to run it. You can obtain the labels file ( $ python -m pip install ck --user
$ ck pull repo:ck-env
$ ck install package --tags=image-classification,dataset,imagenet,aux
$ ck locate env --tags=image-classification,dataset,imagenet,aux
/home/dvdt/CK-TOOLS/dataset-imagenet-ilsvrc2012-aux
$ cd `ck locate env --tags=aux`
$ ls -la val.txt |
@XiaotaoChen If you look at the Makefile, you will find how we did this:
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I'm to reproduce nvidia int4 perf according guide docs
my envs
performance
i produced the
performanceOnly
test as belows:and its' perf seems align with the result as docs tells
accuracy
so i change
test_mode
toAccuracyOnly
, there are four output files inoutputs
directory as belows:And the contexts in
mlperf_log_accuracy.json
as belows. inperformanceOnly
mode it's null:I don't how to generate
accuracy.txt
inopen/NVIDIA/results/TitanRTXx4/resnet/Offline/accuracy/accuracy.txt
.Do you have any suggestions? @nvpohanh thanks.
The text was updated successfully, but these errors were encountered: