locateOnScreen has some accuracy issues

[11522514]

I am working with very small fixed regions so any tiny differences should give large accuracy errors, but despite that, I am finding matches with very high confidence levels. The attached two images have a 0.981 confidence difference between them. Below is the command I am using.
pyautogui.locateOnScreen("test.png", region=(794, 765, 3, 3))

[11522514]

Also the following fails with a 1.000 highest confidence.
pyautogui.locateOnScreen("test.png", region=(848, 762, 3, 5))