Title: Feature Request: Duplicate File Detection and Deletion

[BoBBer446]

Title: Feature Request: Duplicate File Detection and Deletion

Describe the enhancement you'd like
I propose the implementation of a feature for detecting and deleting duplicate photos within the LibrePhotos library. This functionality should intelligently identify identical images, even if their file names differ, and offer users the option to review and delete duplicates. Ideally, this feature could leverage hash comparisons or advanced image recognition techniques to ensure accuracy in detection.

Describe why this will benefit the LibrePhotos
Implementing a duplicate detection and deletion feature would significantly enhance the user experience by helping to declutter the photo library, freeing up storage space, and making photo management more efficient. Many users accumulate numerous duplicates over time, which can make navigating and organizing photos challenging. By providing a tool to easily find and remove these duplicates, LibrePhotos would stand out even more as a powerful and user-friendly photo management solution. This feature would also save users time and reduce frustration, as manually searching for and removing duplicates is a tedious and error-prone process.

Additional context
In many scenarios, especially after importing large photo collections, users may not realize how many duplicate images they have. This feature could also include options for automatic or semi-automatic handling of duplicates based on user-defined criteria, such as always keeping the highest resolution version. Screenshots or mockups of potential UI/UX implementations could be added here for further illustration. Additionally, considering privacy and data integrity, ensuring that users have the final say before any deletions are finalized is crucial.

[adamwea]

I'd also like to see this implemented.

[apavelm]

me too

[apavelm]

Because of some circumstances, it is not a rare even when the same file uploaded with different filenames because of different sources. Sometimes files are identical. For example, a photo made by the phone was auto-uploaded to Google photos, but I sent it via whatsup, and whatsup folder also contains it.
A couple of years ago when I tried to consolidate all photos from all sources I used some software, but now I would to use incremental updated, so I can't. (I'm trying to setup LibrePhotos)
I understand there are various approaches to searching for identical/similar images, but for the current case, comparing by file-hash will be more than enough for my case.
It would be nice to have such a feature. I haven't checked the sources but probably on "scanning" photos you already do something like making a thumbnail of the image, or it will be not a big deal to do that.
A page with a list of duplicate files and the possibility to remove them - will be wonderful.
@derneuere please consider this feature request.

I believe, it will be an outstanding feature that could be significantly extended in the future to similar image search (there are a lot of interesting algorithms and libraries, like ImageNet, OpenCV, and others). But for now, searching for duplicates on upload by file-hash will be perfect

Thanks.