https://github.com/webmachinelearning/prompt-api/blob/main/README.md mentions
free users of a website use on-device AI whereas paid users use a more powerful API-based model.
There's a risk that this could reveal to a website whether its user is wealthy (cloud available) or not (local-only). I think there are ways to mitigate this (e.g. help users choose to use their cloud subscription or not per-site), but it should be addressed in the privacy considerations.