dgx-a100.md

New Result

Comparison single DGX-A100 gpu
Total(train)
Half	Single	Double
Total(inference)
Half	Single	Double
densenet(train)
Half	Single	Double
densenet(inference)
Half	Single	Double
vgg(train)
Half	Single	Double
vgg(inference)
Half	Single	Double
squeezenet(train)
Half	Single	Double
squeezenet(inference)
Half	Single	Double
shufflenetv2(train)
Half	Single	Double
shufflenetv2(inference)
Half	Single	Double
resnet(train)
Half	Single	Double
resnet(inference)
Half	Single	Double
mobilenet(train)
Half	Single	Double
mobilenet(inference)
Half	Single	Double
mnasnet(train)
Half	Single	Double
mnasnet(inference)
Half	Single	Double

Comparison multi gpu ( using 2 DGX-A100 gpus)
Total(train)
Half	Single	Double
Total(inference)
Half	Single	Double
densenet(train)
Half	Single	Double
densenet(inference)
Half	Single	Double
vgg(train)
Half	Single	Double
vgg(inference)
Half	Single	Double
squeezenet(train)
Half	Single	Double
squeezenet(inference)
Half	Single	Double
shufflenetv2(train)
Half	Single	Double
shufflenetv2(inference)
Half	Single	Double
resnet(train)
Half	Single	Double
resnet(inference)
Half	Single	Double
mobilenet(train)
Half	Single	Double
mobilenet(inference)
Half	Single	Double
mnasnet(train)
Half	Single	Double
mnasnet(inference)
Half	Single	Double

Comparison multi gpu ( using 3 DGX-A100 gpus)
Total(train)
Half	Single	Double
Total(inference)
Half	Single	Double
densenet(train)
Half	Single	Double
densenet(inference)
Half	Single	Double
vgg(train)
Half	Single	Double
vgg(inference)
Half	Single	Double
squeezenet(train)
Half	Single	Double
squeezenet(inference)
Half	Single	Double
shufflenetv2(train)
Half	Single	Double
shufflenetv2(inference)
Half	Single	Double
resnet(train)
Half	Single	Double
resnet(inference)
Half	Single	Double
mobilenet(train)
Half	Single	Double
mobilenet(inference)
Half	Single	Double
mnasnet(train)
Half	Single	Double
mnasnet(inference)
Half	Single	Double

Comparison multi gpu ( using 4 DGX-A100 gpus)
Total(train)
Half	Single	Double
Total(inference)
Half	Single	Double
densenet(train)
Half	Single	Double
densenet(inference)
Half	Single	Double
vgg(train)
Half	Single	Double
vgg(inference)
Half	Single	Double
squeezenet(train)
Half	Single	Double
squeezenet(inference)
Half	Single	Double
shufflenetv2(train)
Half	Single	Double
shufflenetv2(inference)
Half	Single	Double
resnet(train)
Half	Single	Double
resnet(inference)
Half	Single	Double
mobilenet(train)
Half	Single	Double
mobilenet(inference)
Half	Single	Double
mnasnet(train)
Half	Single	Double
mnasnet(inference)
Half	Single	Double