exiftool (many types of metadata) adapter

[Pfeil]

Extending the solution to my feature request, I found some time to make an adapter that uses all extensions/file types found on my manjaro manpages (exiftool 12.76-1). Not sure how far metadata extraction is so far in rga, but I guess exiftool will extend this a lot: exiftool supports various kind of metadata and will also try to find unknown kinds, as long as they are plain text. From the manpage:

 Meta Information
----------------------+----------------------+---------------------
EXIF           r/w/c  |  CIFF           r/w  |  Ricoh RMETA    r
GPS            r/w/c  |  AFCP           r/w  |  Picture Info   r
IPTC           r/w/c  |  Kodak Meta     r/w  |  Adobe APP14    r
XMP            r/w/c  |  FotoStation    r/w  |  MPF            r
MakerNotes     r/w/c  |  PhotoMechanic  r/w  |  Stim           r
Photoshop IRB  r/w/c  |  JPEG 2000      r    |  DPX            r
ICC Profile    r/w/c  |  DICOM          r    |  APE            r
MIE            r/w/c  |  Flash          r    |  Vorbis         r
JFIF           r/w/c  |  FlashPix       r    |  SPIFF          r
Ducky APP12    r/w/c  |  QuickTime      r    |  DjVu           r
PDF            r/w/c  |  Matroska       r    |  M2TS           r
PNG            r/w/c  |  MXF            r    |  PE/COFF        r
Canon VRD      r/w/c  |  PrintIM        r    |  AVCHD          r
Nikon Capture  r/w/c  |  FLAC           r    |  ZIP            r
GeoTIFF        r/w/c  |  ID3            r    |  (and more)

So, here is what I did:

• Contains all file extensions from the manpage (218 when fully expanded) plus jpg in addition to jpeg (219)
• I used the python3 mimetypes module to map/guess the mimetypes from the extensions (114 non-None results)

As you can guess, there may be some bad guesses by the mimetype module in some cases. I did obviously not test everything extensively (my focus was jpg with xmp metadata). Please let me know if you found some nonsense inside or have ideas for improvements. Also, if you see faster alternatives to exiftool, please let me know.

{
      "name": "exiftool",
      "version": 1,
      "description": "Uses exiftool to extract all plain text metadata from supported files.",

      "extensions": ["360", "3fr", "3g2", "3gp", "7z", "a", "aa", "aac", "aae", "aax", "acr", "afm", "ai", "aiff", "ape", "arq", "arw", "asf", "avi", "avif", "azw", "bmp", "bpg", "btf", "c2pa", "chm", "cos", "cr2", "cr3", "crm", "crw", "cs1", "csv", "cur", "czi", "dcm", "dcp", "dcr", "dfont", "divx", "djvu", "dll", "dng", "doc", "docx", "dpx", "dr4", "dss", "dv", "dvb", "dvr-ms", "dylib", "eip", "eps", "epub", "erf", "exe", "exif", "exr", "exv", "f4a", "f4v", "fff", "fits", "fla", "flac", "flif", "flv", "fpf", "fpx", "gif", "glv", "gpr", "gz", "hdp", "hdr", "heic", "heif", "html", "icc", "ico", "ics", "idml", "iiq", "ind", "insp", "insv", "inx", "iso", "itc", "j2c", "jng", "jp2", "jpeg", "jpg", "json", "jxl", "k25", "kdc", "key", "la", "lfp", "lif", "lnk", "lrv", "m2ts", "m4a", "m4v", "macos", "max", "mef", "mie", "miff", "mka", "mks", "mkv", "mng", "mobi", "modd", "moi", "mos", "mov", "mp3", "mp4", "mpc", "mpg", "mpo", "mqv", "mrc", "mrw", "mxf", "nef", "nksc", "nrw", "numbers", "o", "odp", "ods", "odt", "ofr", "ogg", "ogv", "onp", "opus", "orf", "ori", "otf", "pac", "pages", "pbm", "pcd", "pcx", "pdb", "pdf", "pef", "pfa", "pfb", "pfm", "pgf", "pgm", "pict", "plist", "pmp", "png", "ppm", "ppt", "pptx", "ps", "psb", "psd", "psp", "qtif", "r3d", "ra", "raf", "ram", "rar", "raw", "riff", "rm", "rsrc", "rtf", "rw2", "rwl", "rwz", "seq", "sketch", "so", "sr2", "srf", "srw", "svg", "swf", "thm", "tiff", "torrent", "ttc", "ttf", "txt", "vcf", "vnt", "vrd", "vsd", "wav", "wdp", "webm", "webp", "wma", "wmv", "wpg", "wtv", "wv", "x3f", "xcf", "xisf", "xls", "xlsx", "xmp", "zip"],
      "mimetypes": ["application/dicom", "application/epub+zip", "application/gzip", "application/json", "application/marc", "application/msword", "application/mxf", "application/octet-stream", "application/octet-stream", "application/pdf", "application/postscript", "application/postscript", "application/postscript", "application/rtf", "application/vnd.3gpp.pic-bw-small", "application/vnd.amazon.ebook", "application/vnd.apple.numbers", "application/vnd.apple.pages", "application/vnd.dtg.local.flash", "application/vnd.iccprofile", "application/vnd.mophun.certificate", "application/vnd.ms-excel", "application/vnd.ms-htmlhelp", "application/vnd.ms-powerpoint", "application/vnd.oasis.opendocument.presentation", "application/vnd.oasis.opendocument.spreadsheet", "application/vnd.oasis.opendocument.text", "application/vnd.openxmlformats-officedocument.presentationml.presentation", "application/vnd.openxmlformats-officedocument.spreadsheetml.sheet", "application/vnd.openxmlformats-officedocument.wordprocessingml.document", "application/vnd.palm", "application/vnd.rn-realmedia", "application/vnd.visio", "application/vnd.wv.csp+wbxml", "application/x-7z-compressed", "application/x-bittorrent", "application/x-director", "application/x-font-type1", "application/x-font-type1", "application/x-font-type1", "application/x-font-type1", "application/x-iso9660-image", "application/x-mie", "application/x-mobipocket-ebook", "application/x-ms-shortcut", "application/x-msdownload", "application/x-msdownload", "application/x-rar-compressed", "application/x-shockwave-flash", "application/zip", "audio/mp4", "audio/mpeg", "audio/ogg", "audio/ogg", "audio/x-aac", "audio/x-aiff", "audio/x-flac", "audio/x-matroska", "audio/x-ms-wma", "audio/x-pn-realaudio", "audio/x-pn-realaudio", "audio/x-wav", "font/collection", "font/otf", "font/ttf", "image/aces", "image/avif", "image/bmp", "image/dpx", "image/fits", "image/gif", "image/heic", "image/heif", "image/jp2", "image/jpeg", "image/jxl", "image/png", "image/prs.btif", "image/svg+xml", "image/tiff", "image/vnd.adobe.photoshop", "image/vnd.djvu", "image/vnd.fpx", "image/vnd.ms-photo", "image/vnd.radiance", "image/webp", "image/x-icon", "image/x-pcx", "image/x-portable-bitmap", "image/x-portable-graymap", "image/x-portable-pixmap", "text/calendar", "text/csv", "text/html", "text/plain", "text/vnd.a", "text/x-vcard", "video/3gpp", "video/3gpp2", "video/mp4", "video/mpeg", "video/ogg", "video/quicktime", "video/vnd.dvb.file", "video/webm", "video/x-f4v", "video/x-flv", "video/x-m4v", "video/x-matroska", "video/x-matroska", "video/x-mng", "video/x-ms-asf", "video/x-ms-wmv", "video/x-msvideo"],

      "binary": "exiftool",
      "args": ["-g", "-u", "-"],
      "disabled_by_default": false,
      "match_only_by_mime": false
}

• -g[NUM...] (-groupHeadings) Organize output by tag group
• -u (-unknown) Extract unknown tags (-U would include binary tags)

Results look like this:

$ rga "Notiz" . 
./IMG_20240113_183022.jpg
Subject                         : Notiz

My use case, as describes in the issue, is receiving tagged images via command line. For this, it works fine.

Current issues:

• somewhat slow (exiftool alone runs ~700ms per image and ~1.1s per opus file)
• does not seem to work with my opus audio files (does not grep things, even though exiftools works fine on them)
• may have overlap with other (faster?) adapters (would be interesting if we could reduce the amount of extensions & types)