Testing DQ checks: miscellany - Possible duplicate record

[Mesibov]

371332 false
85743 true

Tested first on the 9895 duplicate pairs (19790 records) with same taxon (= matched scientific name), same repository, same catalog number (#96):

5448 pairs with both records flagged 'false'
1571 pairs with both records flagged 'true'
2876 pairs with 1 record flagged 'false', the other 'true'

That's one kind of duplicate. From the full beetles data set I also generated record abstracts with 'Possible duplicate record', 'Matched Scientific Name', 'Locality', 'Latitude - processed', 'Longitude - processed', 'Collector', 'Event Date - parsed' and 'Basis Of Record - processed'. These are same taxon collected at same place on same date by same collector. Each abstract below is prefixed with the number of repeats.

In many cases a single abstract is flagged 'false' and its repeats are flagged 'true', which is what I would expect for a 'Possible duplicate record' flag:

1 false Onthophagus sydneyensis -32.58486 151.00613 Gollan, Mr John - Australian Museum - Science 2005-11-18 PreservedSpecimen
97 true Onthophagus sydneyensis -32.58486 151.00613 Gollan, Mr John - Australian Museum - Science 2005-11-18 PreservedSpecimen

But the 'true' and 'false' assignments are inconsistent, e.g.

10 false Zygocera lugubris Mount Gambier -37.81106163 140.7444735 D. Hangen 1988-12-12 PreservedSpecimen
2 true Zygocera lugubris Mount Gambier -37.81106163 140.7444735 D. Hangen 1988-12-12 PreservedSpecimen

8 false Anoplognathus narmarus Pitchi Ritchi Pass nr. Port Augusta -32.5 137.7667 Moulds,M.S. & Moulds,B.J. 1976-01-17 PreservedSpecimen
13 true Anoplognathus narmarus Pitchi Ritchi Pass nr. Port Augusta -32.5 137.7667 Moulds,M.S. & Moulds,B.J. 1976-01-17 PreservedSpecimen

9 false Eupoecila inscripta Exmouth -21.923847 114.11691 Bill & Mark Bell 2008-04-01 Image
8 true Eupoecila inscripta Exmouth -21.923847 114.11691 Bill & Mark Bell 2008-04-01 Image

5 false Coelophora inaequalis Hodgson Vale -27.6228 151.9373 Arthur Chapman 2010-05-07 Image
3 true Coelophora inaequalis Hodgson Vale -27.6228 151.9373 Arthur Chapman 2010-05-07 Image

2 false Tesserodon feehani 14km W by N Hope Vale Mission -15.26667 144.9833 Feehan,J.E. 1981-05-07 PreservedSpecimen
3 true Tesserodon feehani 14km W by N Hope Vale Mission -15.26667 144.9833 Feehan,J.E. 1981-05-07 PreservedSpecimen