CLI Retry Options for commands pk nodes ping and pk nodes find and notifications

[CMCDragonkai]

Specification

So primarily the idea here is that one could do this for a few commands where it supports it. The --retry-count will retry something up to a limit, while --retry-interval will be the delay between retries.

At the same time, one must define what it means to retry something. What exceptions are considered retryable... maybe it depends on the command itself. It's not exactly generic.

At any case if this is needed, this needs to rebased and redone due to big changes in PK.

Additional context

• CLI Retry Options due to Intermittent Network Polykey#325 - Never merged because of other priorities
• https://aws.amazon.com/builders-library/timeouts-retries-and-backoff-with-jitter/
• https://aws.amazon.com/blogs/architecture/exponential-backoff-and-jitter/

Tasks

1. Put --retry-count, --retry-interval, --retry-multiplier into src/utils/options.ts
2. Design the sentinel values for each
3. Default to retrying 0 times, 1000 ms interval and multiplier of 1
4. Consider the need for a --retry-jitter? - requires review of AWS blogs

[CMCDragonkai]

This #180 (comment) illuminated a possibility of creating --retry-multiplier too.

[CMCDragonkai]

@amydevs