Create checksums and check if files are corrupted. Useful to fight bitrot!
Files on your new RAID-controller get corrupt?
You want to move your data to an encrypted filesystem and want to be sure that every file is being written and read correctly?
checksummer creates a checksum of EVERY file and saves it into a sqlite3 db. You can change the base path (i.e. your data has new mountpoint) and recheck again. Every bit of every file is being read and checksummer reports differences.
go get github.com/claudehohl/checksummer
These are the positive side-effects when we have the filename, checksum, filesize and modification time in one database:
Search your files. Results are sorted by size.
Find out which files have the same content.
Scroll through the history of your files and discover RFC textfiles that are dated 1986.
Just provide the location where you want the sqlite3 database.
It's a good habit to put that on the root of the filesystem you want to check as a hidden file, e.g. /mnt/Data/.checksummer.db
First run: Provide the base path; from which checksummer will scan files. You can change that anytime.
checksummer /mnt/Data/.checksummer.db
Just type in cf and [Enter], and checksummer will scan every file starting from the base path and collects file infos like size and modification time.
Now we can show all files, sorted by size: r
Or by modification time: m
mc - this process can take very long of course, because every file is being read.
After that, duplicates can be listed.
rc Reindex & check. You can do that from time to time...
If you've moved your files on a different location, you can change the base path first, and then run rc. That allows checking file content independent of file systems.
Just append the search term:
checksummer /mnt/Data/.checksummer.db movies find any file- or folder name containing "movies"
checksummer /mnt/Data/.checksummer.db .flac list all .flac files
checksummer /mnt/Data/.checksummer.db .flac | wc -l how many .flac files do you have?