Why mIoU uses sum(intersect)/sum(union) instead of mean over IoU?

[hubert0527]

I found the mIoU evaluation codes here:

semantic-segmentation-pytorch/eval.py

Line 98 in 8f27c9b

iou = intersection_meter.sum / (union_meter.sum + 1e-10)

I am wondering what is the motivation of using sum(intersect)/sum(union) instead of the mean over sample-wise intersect / union? The former one seems to disregard the testing samples are iid.

Thanks!

[apple2373]

This appears to be a common issue in semantic segmentation. Some use global IoU, while others use the average per-image IoU.

IvLabs/stagewise-knowledge-distillation#12 (comment)
https://stats.stackexchange.com/questions/554724/is-there-an-official-procedure-to-compute-miou-mean-intersection-over-union

I've noticed others raising similar queries, and unfortunately, there's no universally accepted method. I think it's crucial to specify which approach you're using, and to ensure that you compare the same mIoU when publishing a paper.