Skip to content

Latest commit

 

History

History
464 lines (384 loc) · 79.6 KB

README.md

File metadata and controls

464 lines (384 loc) · 79.6 KB
Raw

📜 ADer Benchmark under the Multi-class Setting on Popular AD Datasets

  • Red metrics are recommended for comprehensive evaluations.
    Subscripts I, R, and P represent image-level, region-level, and pixel-level, respectively.
  • The following results are derived from the original paper. Since the benchmark re-runs all experiments on the same L40S platform, slight differences in the results are reasonable.
  • All experiments are conducted on 256x256 resolution and 100/300 epochs by default.

Content

100epoch

MVTec AD-100epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 54.5 76.3 83.6 47.6 3.2 6.7 14.3 3.5 44.7 log
SimpleNet, CVPR'23 95.4 98.3 95.7 96.8 48.8 51.9 86.9 36.4 83.8 log
RealNet, CVPR'24 84.8 94.1 90.9 72.6 48.2 41.4 56.8 28.8 72.3 log
CFA, Access'22 57.6 78.3 84.7 54.8 11.9 14.7 25.3 8.9 50.1 log
PatchCore, CVPR'22 98.8 99.5 98.4 98.3 59.9 61.0 94.2 44.9 88.6 log
CFLOW-AD, WACV'22 91.6 96.7 93.4 95.7 45.9 48.6 88.3 33.2 81.8 log
PyramidalFlow, CVPR'23 70.2 85.5 85.5 80.0 22.3 22.0 47.5 12.8 61.7 log
RD, CVPR'22 93.6 97.2 95.6 95.8 48.2 53.6 91.2 37.0 83.8 log
DiAD, AAAI'24 88.9 95.8 93.5 89.3 27.0 32.5 63.9 21.1 70.1 log
ViTAD, arXiv'23 98.3 99.3 97.3 97.6 55.2 58.4 92.0 42.3 87.1 log
InvAD, arXiv'24 98.1 99.0 97.6 98.0 56.3 59.2 94.4 42.8 87.6 log
InvAD-lite, arXiv'24 97.9 99.2 96.8 97.3 54.4 57.8 93.3 41.4 86.8 log
MambaAD, arXiv'24 97.8 99.3 97.3 97.4 55.1 57.6 93.4 41.2 87.0 log
UniAD, NeurIPS'22 92.5 97.3 95.4 95.8 42.7 48.0 89.3 32.5 82.0 log
RD++, CVPR'23 97.9 98.8 96.4 97.3 54.7 58.0 93.2 41.5 86.8 log
DesTSeg, CVPR'23 96.4 98.6 96.2 92.0 71.1 68.2 83.4 52.8 87.9 log

MVTec 3D-100epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 55.7 81.8 88.8 46.6 0.8 1.9 21.9 1.0 46.6 log
SimpleNet, CVPR'23 75.8 92.3 90.4 94.7 17.3 23.4 81.0 13.9 70.1 log
CFA, Access'22 67.1 89.3 89.6 71.6 9.7 16.1 43.2 9.3 58.6 log
PatchCore, CVPR'22 84.1 95.1 92.5 98.6 33.7 38.5 94.4 24.5 78.4 log
CFLOW-AD, WACV'22 73.1 91.0 90.2 96.8 21.6 26.6 89.0 15.8 71.6 log
PyramidalFlow, CVPR'23 58.7 85.6 88.6 90.8 7.2 12.0 74.9 6.4 61.9 log
RD, CVPR'22 75.8 91.2 91.5 98.4 29.6 35.5 93.9 22.2 75.3 log
DiAD, AAAI'24 75.4 91.0 90.9 91.7 5.3 10.2 74.9 5.4 62.8 log
ViTAD, arXiv'23 79.6 93.4 91.6 98.0 27.2 33.3 91.6 20.4 75.4 log
InvAD, arXiv'24 86.9 96.2 93.3 98.7 37.4 42.4 95.2 27.4 80.3 log
InvAD-lite, arXiv'24 84.7 95.6 92.6 98.6 38.3 41.9 94.2 26.9 79.6 log
MambaAD, arXiv'24 84.1 95.1 92.2 98.6 36.9 40.8 94.2 25.9 79.0 log
UniAD, NeurIPS'22 75.3 92.1 90.3 96.6 21.2 27.9 88.9 16.7 72.3 log
RD++, CVPR'23 81.8 93.9 92.8 98.5 34.4 39.6 94.1 25.2 78.1 log
DesTSeg, CVPR'23 79.1 93.8 90.7 81.1 41.3 42.7 64.0 28.4 72.6 log

MVTec LOCO-100epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 52.5 65.4 77.6 46.7 4.5 10.4 12.4 5.6 41.8 log
SimpleNet, CVPR'23 81.6 88.5 82.9 76.5 29.0 32.7 63.8 21.2 67.4 log
CFA, Access'22 66.5 78.6 77.9 58.5 14.2 16.3 31.1 9.1 52.2 log
PatchCore, CVPR'22 80.5 89.0 81.5 75.1 29.9 31.8 69.9 20.4 67.7 log
CFLOW-AD, WACV'22 75.1 84.2 79.8 70.7 25.0 27.9 69.5 17.3 64.0 log
PyramidalFlow, CVPR'23 53.4 69.3 77.5 57.7 15.0 14.5 25.7 8.0 47.5 log
RD, CVPR'22 74.6 85.3 78.9 70.7 21.0 26.1 67.7 15.8 63.0 log
DiAD, AAAI'24 71.3 79.5 80.9 71.8 19.0 24.8 48.4 14.9 56.5 log
ViTAD, arXiv'23 76.4 85.2 79.6 73.4 28.7 31.2 63.1 19.8 64.8 log
InvAD, arXiv'24 82.0 89.9 82.0 76.4 31.1 34.8 73.0 23.1 69.2 log
InvAD-lite, arXiv'24 79.4 87.8 80.9 75.8 28.5 32.2 69.4 20.6 67.1 log
MambaAD, arXiv'24 75.8 85.5 81.0 76.5 28.8 32.5 70.2 20.6 66.4 log
UniAD, NeurIPS'22 73.2 82.1 79.6 73.1 30.7 33.4 64.7 21.6 64.4 log
RD++, CVPR'23 76.4 86.8 79.2 71.5 24.3 28.3 68.8 17.6 64.5 log
DesTSeg, CVPR'23 77.9 86.7 81.3 64.1 35.2 30.5 53.4 20.3 63.9 log

VisA-100epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 55.1 62.4 72.9 37.5 0.6 1.7 10.0 0.9 38.0 log
SimpleNet, CVPR'23 86.4 89.1 82.8 96.6 34.0 37.8 79.2 25.7 74.0 log
RealNet, CVPR'24 71.4 79.5 74.7 61.0 25.7 22.6 27.4 13.5 54.7 log
CFA, Access'22 66.3 74.3 74.2 81.3 22.1 26.2 50.8 17.0 58.4 log
CFLOW-AD, WACV'22 86.5 88.8 84.9 97.7 33.9 37.2 86.8 24.9 75.3 log
PyramidalFlow, CVPR'23 58.2 66.3 74.4 77.0 7.2 9.6 42.8 5.6 50.2 log
RD, CVPR'22 90.6 90.9 89.3 98.0 35.4 42.5 91.9 27.9 78.6 log
DiAD, AAAI'24 84.8 88.5 86.9 82.5 17.9 23.2 44.5 14.9 61.2 log
ViTAD, arXiv'23 90.4 91.1 86.0 98.2 36.4 41.0 85.7 27.5 77.2 log
InvAD, arXiv'24 95.4 95.7 91.6 98.9 43.3 46.8 93.1 32.5 82.4 log
InvAD-lite, arXiv'24 94.9 95.2 90.7 98.6 40.2 44.0 93.1 29.8 81.3 log
MambaAD, arXiv'24 94.5 94.9 90.2 98.4 39.3 43.7 92.1 29.5 80.8 log
UniAD, NeurIPS'22 89.0 91.0 85.8 98.3 34.5 39.6 86.5 26.4 76.7 log
RD++, CVPR'23 93.9 94.7 90.2 98.4 42.3 46.3 91.9 31.2 81.3 log
DesTSeg, CVPR'23 89.9 91.4 86.7 86.7 46.6 47.2 61.1 32.7 74.9 log

BTAD-100epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 71.3 78.5 78.0 49.0 3.7 6.5 16.2 3.4 47.4 log
SimpleNet, CVPR'23 93.2 97.3 93.3 96.3 41.5 44.3 69.8 28.6 78.8 log
RealNet, CVPR'24 89.7 95.3 92.8 84.0 48.1 52.7 53.4 36.6 76.1 log
CFA, Access'22 92.7 97.5 93.5 96.3 47.4 50.2 69.5 33.6 80.2 log
PatchCore, CVPR'22 94.4 98.2 94.6 97.5 55.0 54.9 76.0 38.0 83.3 log
CFLOW-AD, WACV'22 91.2 94.8 88.3 96.8 45.6 50.1 72.7 33.8 78.9 log
PyramidalFlow, CVPR'23 87.0 83.1 81.0 90.9 29.6 26.9 64.1 18.3 68.3 log
RD, CVPR'22 94.4 96.6 94.0 98.1 59.6 59.2 80.7 42.1 84.7 log
DiAD, AAAI'24 90.1 88.4 92.6 91.7 19.6 26.7 70.4 15.7 68.5 log
ViTAD, arXiv'23 93.6 96.8 93.3 97.6 59.2 56.7 73.2 40.1 83.1 log
InvAD, arXiv'24 96.1 97.8 94.3 98.1 62.6 61.4 80.9 44.3 85.9 log
InvAD-lite, arXiv'24 93.1 97.4 94.6 97.9 59.2 59.7 78.6 42.6 84.4 log
MambaAD, arXiv'24 93.1 96.1 92.5 97.7 52.5 56.0 78.2 39.0 82.5 log
UniAD, NeurIPS'22 94.8 98.3 94.2 97.2 50.3 53.8 78.8 36.9 82.9 log
RD++, CVPR'23 94.6 97.8 94.1 98.0 59.6 59.8 79.0 42.8 84.8 log
DesTSeg, CVPR'23 92.8 95.9 92.3 92.2 34.8 44.3 70.0 29.0 77.0 log

MPDD-100epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 35.6 53.3 72.5 42.1 2.2 4.6 19.0 2.5 35.4 log
SimpleNet, CVPR'23 88.4 92.0 87.9 96.5 32.0 34.6 89.0 24.5 76.2 log
RealNet, CVPR'24 85.1 90.2 88.3 83.3 36.1 39.6 68.1 28.2 72.3 log
CFA, Access'22 81.6 87.7 85.7 84.9 19.6 22.9 53.5 16.6 65.1 log
PatchCore, CVPR'22 94.6 96.9 93.4 98.9 46.1 47.6 95.7 35.0 83.5 log
CFLOW-AD, WACV'22 75.7 80.1 81.7 96.8 26.3 28.0 89.5 20.1 69.7 log
PyramidalFlow, CVPR'23 73.6 77.0 79.4 94.1 21.1 17.8 77.2 10.4 64.6 log
RD, CVPR'22 91.3 93.6 91.8 98.3 40.4 41.8 95.5 31.4 80.6 log
DiAD, AAAI'24 68.3 77.9 80.1 90.4 10.9 13.1 66.1 8.2 58.1 log
ViTAD, arXiv'23 87.8 90.5 88.0 97.7 35.2 37.4 92.8 27.7 77.3 log
InvAD, arXiv'24 93.7 93.9 93.0 98.2 42.4 45.7 94.8 34.0 81.9 log
InvAD-lite, arXiv'24 90.9 92.9 89.5 98.0 39.7 42.6 94.0 30.9 79.8 log
MambaAD, arXiv'24 88.7 93.2 90.8 97.5 33.6 38.1 92.3 26.8 78.1 log
UniAD, NeurIPS'22 70.5 76.0 78.0 93.9 13.7 19.9 79.7 12.5 63.3 log
RD++, CVPR'23 90.2 93.3 90.5 98.5 43.0 44.1 95.5 33.6 80.8 log
DesTSeg, CVPR'23 91.3 90.8 90.2 82.0 32.6 34.6 63.3 25.6 71.9 log

MAD_Real-100epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 59.1 88.1 90.4 49.4 0.6 1.7 22.3 0.8 48.9 log
SimpleNet, CVPR'23 47.8 81.9 90.7 83.1 5.4 11.6 59.8 6.3 56.7 log
CFA, Access'22 49.3 81.7 91.4 83.3 10.5 15.2 64.2 8.7 58.7 log
PatchCore, CVPR'22 59.7 84.8 93.5 95.4 20.2 27.3 85.5 16.6 68.2 log
CFLOW-AD, WACV'22 59.8 86.0 91.2 90.9 10.7 15.4 74.4 8.8 63.4 log
PyramidalFlow, CVPR'23 52.1 83.6 90.3 88.4 5.0 9.4 68.2 5.1 59.0 log
RD, CVPR'22 55.5 85.8 90.6 87.0 8.2 12.8 67.8 7.2 60.6 log
DiAD, AAAI'24 49.9 85.1 90.8 87.7 2.9 6.8 67.4 3.6 55.8 log
ViTAD, arXiv'23 47.0 81.3 90.2 87.3 4.5 9.3 66.6 5.0 57.4 log
InvAD, arXiv'24 66.5 87.7 93.8 88.3 22.1 26.2 73.2 16.8 67.6 log
InvAD-lite, arXiv'24 60.4 84.3 92.2 88.2 9.0 14.3 72.9 8.1 62.5 log
MambaAD, arXiv'24 56.2 84.3 90.3 87.8 7.5 12.8 68.5 7.2 60.5 log
UniAD, NeurIPS'22 47.6 81.3 90.4 88.2 5.8 10.6 68.6 5.8 58.2 log
RD++, CVPR'23 54.7 83.9 92.3 88.5 9.4 14.9 70.4 8.5 61.4 log
DesTSeg, CVPR'23 45.4 80.3 90.7 72.7 5.0 8.2 48.3 4.5 52.8 log

MAD_Sim-100epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 49.5 88.3 93.8 48.4 0.8 1.5 24.5 0.7 48.0 log
SimpleNet, CVPR'23 58.9 91.7 93.8 85.5 4.2 8.0 63.9 4.2 60.9 log
CFA, Access'22 56.4 91.1 93.8 76.6 4.2 8.7 54.7 4.6 58.2 log
CFLOW-AD, WACV'22 55.8 90.6 93.8 86.9 3.4 5.2 63.9 2.7 60.0 log
PyramidalFlow, CVPR'23 50.8 88.9 93.8 82.0 2.3 4.8 58.8 2.5 57.4 log
RD, CVPR'22 58.6 91.7 93.8 88.3 4.7 8.5 74.2 4.5 62.6 log
DiAD, AAAI'24 65.7 93.3 94.1 87.2 3.9 7.9 60.1 4.2 58.9 log
ViTAD, arXiv'23 58.5 91.5 93.8 89.0 5.0 9.5 73.5 5.0 62.8 log
InvAD, arXiv'24 70.4 94.6 93.9 90.5 8.8 15.7 79.3 8.6 67.4 log
InvAD-lite, arXiv'24 64.7 93.3 93.8 89.4 6.4 11.2 76.1 6.0 64.9 log
MambaAD, arXiv'24 63.0 92.9 93.8 88.3 5.2 9.4 73.3 5.0 63.6 log
UniAD, NeurIPS'22 54.2 90.0 93.8 88.1 3.5 6.8 71.8 3.5 60.9 log
RD++, CVPR'23 59.3 91.7 93.8 88.3 4.6 8.5 73.8 4.4 62.7 log
DesTSeg, CVPR'23 57.9 91.8 93.8 54.5 6.2 7.7 35.8 4.1 53.6 log

Uni-Medical-100epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 51.6 60.6 70.6 33.8 2.0 5.7 10.5 3.0 37.0 log
SimpleNet, CVPR'23 77.5 77.7 76.7 94.3 34.4 36.0 77.0 23.3 68.9 log
CFA, Access'22 71.0 73.3 73.1 78.3 19.5 24.9 44.7 14.7 57.2 log
CFLOW-AD, WACV'22 79.2 79.6 77.2 95.4 40.4 26.9 81.8 17.7 69.9 log
PyramidalFlow, CVPR'23 53.9 57.3 70.5 78.8 8.4 17.1 34.2 9.4 47.6 log
RD, CVPR'22 76.1 75.7 78.2 96.5 38.8 39.8 86.8 26.9 71.1 log
DiAD, AAAI'24 78.8 77.2 77.7 95.8 34.2 35.5 84.3 23.2 69.1 log
ViTAD, arXiv'23 81.8 80.7 80.0 97.1 48.3 48.2 86.7 33.7 75.5 log
InvAD, arXiv'24 82.4 80.5 80.5 97.3 46.2 46.1 89.3 32.6 75.4 log
InvAD-lite, arXiv'24 77.9 77.3 79.1 96.2 39.0 39.3 85.8 26.5 71.6 log
MambaAD, arXiv'24 83.9 80.8 81.9 96.8 45.8 47.5 88.2 33.5 75.9 log
UniAD, NeurIPS'22 79.0 76.1 77.1 96.6 39.3 41.1 86.0 27.6 71.6 log
RD++, CVPR'23 77.2 76.5 79.2 96.7 41.5 42.2 87.8 29.4 72.3 log
DesTSeg, CVPR'23 78.5 77.0 78.2 65.7 41.7 34.0 35.3 21.2 61.0 log

Real-IAD-100epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 50.9 45.9 61.3 44.0 0.2 0.4 13.6 0.2 33.6 log
SimpleNet, CVPR'23 54.9 50.6 61.5 76.1 1.9 4.9 42.4 2.5 43.5 log
CFA, Access'22 55.7 50.5 61.9 81.3 1.6 3.8 48.8 2.0 45.0 log
CFLOW-AD, WACV'22 77.0 75.8 69.9 94.8 17.6 21.7 80.4 12.4 63.9 log
PyramidalFlow, CVPR'23 54.4 48.0 62.0 71.1 1.2 1.1 34.9 0.5 40.9 log
RD, CVPR'22 82.7 79.3 74.1 97.2 25.2 32.8 90.0 20.0 70.0 log
DiAD, AAAI'24 75.6 66.4 69.9 88.0 2.9 7.1 58.1 3.7 52.6 log
ViTAD, arXiv'23 82.7 80.2 73.7 97.2 24.3 32.3 84.8 19.6 69.3 log
InvAD, arXiv'24 89.4 87.0 80.2 98.4 32.6 38.9 92.7 24.6 75.6 log
InvAD-lite, arXiv'24 87.2 85.2 77.8 98.0 31.7 37.9 92.0 23.8 74.2 log
MambaAD, arXiv'24 87.0 85.3 77.6 98.6 32.4 38.1 91.2 23.9 74.2 log
UniAD, NeurIPS'22 83.1 81.2 74.5 97.4 23.3 30.9 87.1 18.6 69.6 log
RD++, CVPR'23 83.6 80.6 74.8 97.7 25.9 33.6 90.7 20.5 70.8 log
DesTSeg, CVPR'23 79.3 76.7 70.7 80.3 36.9 40.3 56.1 26.2 64.5 log

COCO-AD-100epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download Download Download Download
DRAEM, ICCV'21 53.5 48.5 62.5 49.9 7.6 14.4 15.3 8.0 38.3 log0 log1 log2 log3
SimpleNet, CVPR'23 55.6 49.4 62.3 60.2 14.5 19.2 26.1 11.5 42.9 log0 log1 log2 log3
CFA, Access'22 56.7 51.2 62.6 56.2 10.3 16.0 17.9 8.9 41.0 log0 log1 log2 log3
CFLOW-AD, WACV'22 67.7 57.9 64.5 76.0 20.3 26.4 47.7 16.0 53.0 log0 log1 log2 log3
PyramidalFlow, CVPR'23 51.6 47.4 61.6 50.0 13.4 14.4 15.0 8.0 38.4 log0 log1 log2 log3
RD, CVPR'22 57.6 49.9 62.0 66.5 13.9 20.0 39.8 11.5 45.8 log0 log1 log2 log3
DiAD, AAAI'24 59.0 53.0 63.2 68.1 20.5 14.2 30.8 11.6 44.1 log0 log1 log2 log3
ViTAD, arXiv'23 66.9 59.3 63.7 76.2 27.6 32.2 39.1 20.1 53.5 log0 log1 log2 log3
InvAD, arXiv'24 64.2 56.0 63.4 71.2 18.5 24.1 45.8 14.3 50.5 log0 log1 log2 log3
InvAD-lite, arXiv'24 63.3 56.0 62.9 69.9 18.2 23.1 39.7 13.7 49.2 log0 log1 log2 log3
MambaAD, arXiv'24 62.8 55.2 62.8 68.9 16.7 22.0 41.6 12.9 48.8 log0 log1 log2 log3
UniAD, NeurIPS'22 55.2 49.3 61.7 64.6 12.8 19.0 34.3 10.9 44.0 log0 log1 log2 log3
RD++, CVPR'23 57.5 49.3 62.0 68.2 15.5 20.1 42.2 11.8 46.4 log0 log1 log2 log3
DesTSeg, CVPR'23 54.4 49.4 61.8 54.5 10.6 15.4 24.4 8.5 40.7 log0 log1 log2 log3

300epochs

MVTec AD-300epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 55.2 77.0 83.9 48.7 3.1 6.3 15.8 3.3 45.3 log
SimpleNet, CVPR'23 79.2 90.8 87.6 82.4 24.0 29.0 62.0 17.8 67.6 log
RealNet, CVPR'24 82.9 93.3 90.9 69.8 50.0 40.4 51.2 28.5 70.9 log
CFA, Access'22 55.8 78.8 84.5 43.9 4.8 8.9 19.3 4.7 46.1 log
CFLOW-AD, WACV'22 92.7 97.2 94.0 95.8 46.8 49.6 89.0 34.0 82.5 log
PyramidalFlow, CVPR'23 66.2 84.3 85.1 74.2 17.2 19.6 40.0 11.4 58.1 log
RD, CVPR'22 90.5 95.0 95.1 95.9 47.1 52.1 91.2 35.8 82.6 log
DiAD, AAAI'24 92.0 96.8 94.4 89.3 27.3 32.7 64.4 21.3 71.0 log
ViTAD, arXiv'23 98.4 99.4 97.5 97.5 55.2 58.1 91.7 42.0 87.0 log
InvAD, arXiv'24 98.9 99.6 98.2 98.1 57.1 59.6 94.4 43.1 88.1 log
InvAD-lite, arXiv'24 98.1 99.1 96.8 97.3 55.0 58.1 93.1 41.7 86.9 log
MambaAD, arXiv'24 98.5 99.5 97.7 97.6 56.1 58.7 93.6 42.3 87.5 log
UniAD, NeurIPS'22 96.8 98.9 97.0 96.8 45.0 50.2 91.0 34.2 84.2 log
RD++, CVPR'23 95.8 98.0 96.6 97.3 53.0 57.0 92.9 40.5 85.9 log
DesTSeg, CVPR'23 96.3 98.8 96.1 92.6 75.8 71.3 82.6 56.6 88.8 log

MVTec 3D-300epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 49.2 79.4 89.0 50.7 0.7 2.2 23.4 1.1 45.9 log
SimpleNet, CVPR'23 74.9 91.8 90.2 94.0 14.4 21.4 79.2 12.4 68.9 log
CFA, Access'22 60.1 86.3 89.5 52.0 7.0 11.9 28.7 6.9 51.8 log
CFLOW-AD, WACV'22 74.8 91.4 90.5 96.9 21.6 26.8 89.2 15.9 72.1 log
PyramidalFlow, CVPR'23 52.5 80.8 88.6 87.2 5.9 10.4 68.0 5.6 58.4 log
RD, CVPR'22 79.3 93.0 92.3 98.3 28.6 35.4 93.5 22.1 76.1 log
DiAD, AAAI'24 78.8 91.3 91.7 91.8 5.2 10.5 75.1 5.6 63.5 log
ViTAD, arXiv'23 78.7 93.3 91.5 98.0 27.0 33.0 91.3 20.2 75.1 log
InvAD, arXiv'24 86.3 95.9 93.4 98.7 36.2 41.1 94.9 26.4 79.8 log
InvAD-lite, arXiv'24 85.1 95.6 92.3 98.4 34.4 39.0 93.4 24.6 78.7 log
MambaAD, arXiv'24 85.8 95.5 92.6 98.6 37.1 40.8 94.1 26.0 79.5 log
UniAD, NeurIPS'22 77.0 92.6 91.0 96.8 23.7 30.6 89.4 18.6 73.5 log
RD++, CVPR'23 80.1 93.5 92.2 98.4 31.5 37.2 93.6 23.4 76.9 log
DesTSeg, CVPR'23 82.5 95.1 90.9 82.1 43.8 45.2 65.1 30.2 74.3 log

MVTec LOCO-300epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 51.4 66.9 77.5 48.0 5.2 10.5 13.7 5.6 42.3 log
SimpleNet, CVPR'23 81.8 89.1 82.5 70.9 28.3 32.1 61.2 20.9 66.3 log
CFA, Access'22 60.6 73.7 77.6 64.7 16.5 18.8 36.4 10.8 52.4 log
CFLOW-AD, WACV'22 76.0 85.0 79.9 70.9 25.6 28.4 70.0 17.7 64.5 log
PyramidalFlow, CVPR'23 58.1 70.4 77.4 55.5 16.8 14.4 20.4 8.1 47.7 log
RD, CVPR'22 73.7 84.6 79.4 70.7 21.0 26.2 67.5 15.9 62.8 log
DiAD, AAAI'24 77.2 84.6 81.5 72.1 18.6 25.3 54.4 15.2 59.1 log
ViTAD, arXiv'23 76.2 85.0 80.1 73.2 27.9 30.6 62.0 19.3 64.4 log
InvAD, arXiv'24 82.3 89.9 82.4 77.7 30.9 34.1 72.8 22.4 69.4 log
InvAD-lite, arXiv'24 78.0 86.8 81.6 77.0 28.0 32.0 69.4 20.4 66.9 log
MambaAD, arXiv'24 78.2 87.1 81.8 77.5 28.0 32.9 68.6 20.8 67.1 log
UniAD, NeurIPS'22 78.7 87.1 80.9 74.6 32.6 35.8 70.7 23.4 67.8 log
RD++, CVPR'23 75.7 85.9 79.3 72.1 24.2 28.5 67.9 17.8 64.2 log
DesTSeg, CVPR'23 81.2 88.6 81.8 63.7 31.8 31.9 59.2 21.1 65.3 log

VisA-300epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 56.2 64.6 74.9 45.0 0.7 1.8 16.0 0.9 40.6 log
SimpleNet, CVPR'23 80.7 83.8 79.3 94.4 29.2 33.1 74.2 22.1 69.5 log
RealNet, CVPR'24 79.2 84.8 78.3 65.4 29.2 27.9 33.9 17.4 59.9 log
CFA, Access'22 67.1 73.8 75.3 83.0 13.7 18.7 48.7 11.3 56.5 log
CFLOW-AD, WACV'22 87.2 89.5 85.1 97.8 34.2 37.2 87.3 24.9 75.7 log
PyramidalFlow, CVPR'23 69.0 72.9 75.8 79.1 7.9 8.7 52.6 4.7 54.8 log
RD, CVPR'22 93.9 94.8 90.4 98.1 38.4 43.7 91.9 29.0 80.5 log
DiAD, AAAI'24 90.5 91.4 90.4 83.4 19.2 25.0 44.3 16.2 63.5 log
ViTAD, arXiv'23 90.3 91.2 86.4 98.2 36.4 40.9 85.8 27.5 77.3 log
InvAD, arXiv'24 95.6 96.0 92.3 99.0 43.7 46.9 93.0 32.6 82.6 log
InvAD-lite, arXiv'24 95.3 95.8 91.0 98.7 41.2 44.9 93.2 30.6 81.8 log
MambaAD, arXiv'24 93.6 93.9 89.8 98.2 34.0 39.3 90.5 25.9 79.0 log
UniAD, NeurIPS'22 91.4 93.3 87.5 98.5 35.3 40.2 89.0 26.5 78.2 log
RD++, CVPR'23 93.1 94.1 90.0 98.4 40.4 44.8 91.4 29.9 80.6 log
DesTSeg, CVPR'23 89.0 90.3 85.9 84.8 43.3 44.4 57.5 30.1 73.0 log

BTAD-300epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 69.3 76.8 79.5 47.7 3.2 6.1 16.1 3.2 46.7 log
SimpleNet, CVPR'23 94.0 97.9 93.9 96.2 41.0 43.7 69.6 28.1 78.9 log
RealNet, CVPR'24 93.1 96.3 92.5 87.2 48.0 55.5 57.9 38.7 78.1 log
CFA, Access'22 92.7 97.8 94.6 96.2 46.7 49.7 69.0 33.2 80.2 log
CFLOW-AD, WACV'22 91.6 95.6 89.7 96.9 46.0 49.0 72.7 33.0 79.2 log
PyramidalFlow, CVPR'23 85.3 81.7 79.0 76.1 27.7 23.4 43.1 15.0 62.3 log
RD, CVPR'22 94.1 96.8 93.8 98.0 57.1 58.0 79.9 41.0 84.1 log
DiAD, AAAI'24 90.2 88.3 92.6 91.9 20.5 27.0 70.3 16.0 68.7 log
ViTAD, arXiv'23 94.0 97.0 93.7 97.6 58.3 56.5 72.8 39.9 83.1 log
InvAD, arXiv'24 95.3 97.3 93.7 97.9 58.7 58.8 78.8 41.7 84.5 log
InvAD-lite, arXiv'24 94.2 97.9 94.4 97.7 55.7 57.0 77.4 40.0 83.7 log
MambaAD, arXiv'24 92.9 96.2 93.0 97.6 51.2 55.1 77.3 38.2 82.2 log
UniAD, NeurIPS'22 94.5 98.4 94.9 97.4 52.4 55.5 78.9 38.4 83.5 log
RD++, CVPR'23 94.5 97.6 94.3 98.0 57.7 58.2 78.9 41.2 84.3 log
DesTSeg, CVPR'23 93.5 96.7 93.8 94.8 39.1 38.5 72.9 24.6 78.0 log

MPDD-300epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 60.2 67.5 75.1 50.4 5.4 4.7 21.8 2.6 44.1 log
SimpleNet, CVPR'23 90.6 94.1 89.7 97.1 33.6 35.7 90.0 25.6 77.8 log
RealNet, CVPR'24 86.0 90.0 87.3 74.7 39.2 39.7 52.3 28.0 69.6 log
CFA, Access'22 92.0 93.5 90.2 95.7 29.0 33.0 83.2 23.8 76.1 log
CFLOW-AD, WACV'22 80.4 85.1 84.7 97.3 28.4 30.1 90.9 21.5 72.5 log
PyramidalFlow, CVPR'23 72.5 76.2 77.6 89.0 12.4 15.8 68.5 9.1 60.9 log
RD, CVPR'22 90.3 92.8 90.5 98.3 39.6 40.6 95.2 30.2 79.8 log
DiAD, AAAI'24 85.8 89.2 86.5 91.4 15.3 19.2 66.1 12.0 64.8 log
ViTAD, arXiv'23 87.4 90.8 87.0 97.8 34.6 37.8 92.9 28.0 77.1 log
InvAD, arXiv'24 96.0 97.1 94.5 98.5 44.1 46.4 95.3 34.4 83.5 log
InvAD-lite, arXiv'24 92.8 93.2 91.4 98.3 41.4 43.9 94.6 32.1 81.0 log
MambaAD, arXiv'24 89.2 93.1 90.3 97.7 33.5 38.6 92.8 27.2 78.3 log
UniAD, NeurIPS'22 80.1 83.2 85.1 95.4 19.0 25.6 83.8 16.8 69.4 log
RD++, CVPR'23 90.6 93.3 90.0 98.4 42.8 43.0 95.3 32.7 80.6 log
DesTSeg, CVPR'23 92.6 91.8 92.8 90.8 30.6 32.9 78.3 24.1 75.3 log

MAD_Real-300epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 46.3 82.5 90.2 42.5 0.5 1.2 14.9 0.6 43.9 log
SimpleNet, CVPR'23 36.1 77.0 89.6 77.2 2.6 6.3 48.9 3.3 50.7 log
CFA, Access'22 48.5 81.2 91.4 83.3 10.4 15.0 64.1 8.6 58.5 log
CFLOW-AD, WACV'22 57.4 85.9 91.2 90.9 10.8 15.3 74.1 8.8 63.0 log
PyramidalFlow, CVPR'23 50.6 82.9 90.5 88.6 7.5 12.0 68.8 6.7 59.4 log
RD, CVPR'22 56.0 84.9 90.7 86.9 8.7 13.2 66.9 7.4 60.6 log
DiAD, AAAI'24 58.0 85.7 91.1 87.8 5.1 9.6 69.4 5.2 58.1 log
ViTAD, arXiv'23 44.5 81.3 90.2 86.9 4.5 8.9 65.0 4.8 56.7 log
InvAD, arXiv'24 63.5 86.5 92.7 91.6 18.9 24.2 77.2 14.9 66.9 log
InvAD-lite, arXiv'24 57.3 84.8 91.9 90.8 11.4 16.3 74.7 9.5 63.1 log
MambaAD, arXiv'24 54.7 83.1 92.2 90.8 13.1 19.2 74.7 11.4 63.1 log
UniAD, NeurIPS'22 45.4 80.3 90.8 87.8 6.4 11.6 68.3 6.4 57.8 log
RD++, CVPR'23 52.3 84.0 91.3 88.7 9.3 14.4 70.4 8.2 60.8 log
DesTSeg, CVPR'23 36.1 77.9 89.8 82.5 3.2 6.0 52.7 3.2 52.0 log

MAD_Sim-300epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 48.8 88.1 93.8 47.9 0.7 1.5 20.0 0.8 47.2 log
SimpleNet, CVPR'23 51.5 88.6 93.8 86.1 2.3 4.5 63.9 2.3 58.6 log
CFA, Access'22 55.7 91.1 93.8 71.8 3.7 7.7 45.3 4.1 56.2 log
CFLOW-AD, WACV'22 56.9 90.9 93.8 86.9 3.4 5.1 63.7 2.6 60.2 log
PyramidalFlow, CVPR'23 49.0 88.1 93.8 84.4 2.4 5.0 62.7 2.6 57.8 log
RD, CVPR'22 57.9 91.3 93.8 88.3 4.4 8.2 73.7 4.3 62.3 log
DiAD, AAAI'24 65.6 93.4 94.1 87.7 4.4 8.8 61.4 4.7 59.4 log
ViTAD, arXiv'23 59.0 91.4 93.8 89.0 4.8 9.3 73.6 4.9 62.8 log
InvAD, arXiv'24 70.4 94.5 94.0 90.7 8.9 15.3 79.1 8.4 67.4 log
InvAD-lite, arXiv'24 65.3 93.4 93.9 89.7 6.6 11.4 76.4 6.1 65.1 log
MambaAD, arXiv'24 61.4 92.4 93.8 88.3 4.8 9.0 73.0 4.8 63.2 log
UniAD, NeurIPS'22 59.4 91.5 93.8 89.0 4.4 8.4 74.6 4.4 62.8 log
RD++, CVPR'23 58.6 91.7 93.8 88.3 4.4 8.1 73.2 4.2 62.4 log
DesTSeg, CVPR'23 59.2 91.9 93.8 56.8 5.7 8.6 41.8 4.5 54.9 log

Uni-Medical-300epochs

Method mAU-ROCI mAPI mF1-maxI mAU-ROCP mAPP mF1-maxP mAU-PROR mIoU-maxP mAD Download
DRAEM, ICCV'21 58.5 63.2 71.7 32.5 2.0 6.1 9.1 3.2 38.4 log
SimpleNet, CVPR'23 72.5 75.3 76.7 94.9 35.9 37.0 79.2 24.2 68.3 log
CFA, Access'22 56.3 62.8 70.4 38.1 4.8 6.6 8.9 3.4 38.9 log
CFLOW-AD, WACV'22 79.0 78.5 77.3 95.4 39.6 26.3 81.7 17.0 69.5 log
PyramidalFlow, CVPR'23 60.0 62.8 71.9 82.2 8.8 14.9 46.9 8.3 51.5 log
RD, CVPR'22 76.4 75.8 77.9 96.4 38.9 39.8 86.5 27.0 71.1 log
DiAD, AAAI'24 82.9 81.9 79.4 96.0 35.9 38.2 85.4 25.2 71.4 log
ViTAD, arXiv'23 81.5 80.6 80.1 97.0 46.8 46.9 86.5 32.7 75.0 log
InvAD, arXiv'24 81.3 80.0 79.9 97.2 45.4 45.5 89.0 32.3 74.8 log
InvAD-lite, arXiv'24 77.6 77.2 79.3 96.2 38.7 39.7 85.7 27.1 71.6 log
MambaAD, arXiv'24 82.3 78.9 81.3 96.7 43.0 46.1 87.9 32.4 74.6 log
UniAD, NeurIPS'22 80.4 76.6 77.5 96.5 39.0 41.3 85.8 27.8 71.9 log
RD++, CVPR'23 77.2 76.1 78.5 96.7 41.0 41.9 87.4 29.1 72.0 log
DesTSeg, CVPR'23 82.0 85.0 79.7 83.2 50.6 50.5 66.1 34.1 72.4 log