Remember which options were last given to which binaries

[Ekleog]

This can be useful both in a single run (because we run binaries twice), but also across runs, because the option list usually won't change even if the package version changes a lot.

Actually… it might even make sense to include a shared list, and a command to export that list, so that we could provide better defaults by accepting PRs from people who have recorded their own defaults?