Improve jsonRPC error UX for eth1 + execution

[g11tech]

As brought to notice by a discord user seamonkey, sometimes because of the nodejs engine intermittent loading or the execution engine's intermittent loading the json rpc api can throw harmless intermittent errors like UNAVAILABLE, TIMEOUT like these

However these give users not so good experience, and hence we need to have an error accumulator for such unavailable errors and log the throw only if counter surpasses.

[g11tech]

will be picking this up

[nazarhussain]

@g11tech We already have a delay set for such cases of errors.

lodestar/packages/beacon-node/src/eth1/eth1DepositDataTracker.ts

Lines 182 to 186 in 6ac8c07

	} else if (!isErrorAborted(e)) {
	this.logger.error("Error updating eth1 chain cache", {}, e as Error);
	await sleep(MIN_WAIT_ON_ERROR_MS, this.signal);
	}

And the http errors UNAVAILABLE or TIMEOUT can actually be fatal. We can increase the wait time which is 1s right now, so such errors don't show a lot such errors in case the endpoint if momentarily not available. What do you think?

[g11tech]

@g11tech We already have a delay set for such cases of errors.

lodestar/packages/beacon-node/src/eth1/eth1DepositDataTracker.ts

Lines 182 to 186 in 6ac8c07

	} else if (!isErrorAborted(e)) {
	this.logger.error("Error updating eth1 chain cache", {}, e as Error);
	await sleep(MIN_WAIT_ON_ERROR_MS, this.signal);
	}

And the http errors UNAVAILABLE or TIMEOUT can actually be fatal. We can increase the wait time which is 1s right now, so such errors don't show a lot such errors in case the endpoint if momentarily not available. What do you think?

its not about wait time but sort of debounce the error .... like how we do for engine coming offfline online etc. so 1 error for state change