[Milestone] Operational resilience from recent events

[BigLep]

eta: 2023-06-30

description:
We have graduated from the "school of hard knocks" from the last 6 months. Production operators avoid known failure modes and are more self-service in identifying issues that are affecting their users and potentially the whole users. This includes keeping resilient routing tables void of non-responsive nodes, guardrails to help providers from unknowing fall behind in providing, and improved bitswap with backpressure, timeouts, and metrics.

Notes:
This is a Starmap "child" issue.

These are all related to operational pain from the last 6 months. They can be delivered on independently.

Resilient routing tables:
Related event: https://github.com/protocol/ipfs-vulnerabilities/issues/25
libp2p/go-libp2p-kad-dht#811

Providing guardrails:
#9703
#9702
#9704

Improved bitswap:
TODO: create a better issue or repurpose https://github.com/ipfs/go-bitswap/issues/560

[BigLep]

This is a draft milestone in preparation for IPFS Thing 2023. It hasn't been reviewed or committed to by the maintainers yet.