deps: update robots-parser to latest

[brendankenny]

Follow up to #13545 (comment)

robots-parser published the change to use the global URL, so that can be removed from the url shim TODO.

robots-parser 2.4.0 also added typedefs, so we can remove ours! Only issue is that they're written for an ESM future (export default callableFunction) and we're still in commonjs land. Rather than upstream a fix (which can be contentious depending on where you're coming from, see e.g. this epic thread), it seems fine to work around with a typecast plus a TODO(esmodules) since

• it's a cast to its own type
• esmodules are coming
• we get to get rid of a whole d.ts file
• when esmodule do come, I don't think we'll remember to ditch this d.ts file then

No functional changes since our previous robots-parser version 2.3.0.