Make remote ping and compress settings dynamic

[Tim-Brooks]

Traditionally remote clusters can be configured dynamically. However,
the compress and ping settings are not currently set to be configured
dynamically. This commit changes that.

[elasticmachine]

Pinging @elastic/es-distributed

[Tim-Brooks]

I have opened #37201 to track additional work we might want done in this area.

[Tim-Brooks]

@dliappis I did not get a review for this today, so I was not able to merge it. But if it looks good to you, you can merge it. If you do, just mark the backport pending. And I will backport it.

[jasontedor]

LGTM. Let's follow-up with responding to changes in these settings on an existing remote cluster.

[dliappis]

Also LGTM from me, thanks @tbrooks8 ; I have tested it on master and the setting works fine and can be seen enabled in cluster settings.

[javanna]

heya I was looking at this with @dliappis and we don't see the setting being applied, even when specified while registering a new cluster. I understand from the description that it's expected that the setting does not currently get updated for existing clusters (as there is no consumer), but I would expect it to be applied to a newly built connection profile created when registering a new cluster. This should be reproducible with a unit test.

[Tim-Brooks]

Yeah it looks like there will be more steps involved to use the dynamic settings when adding a remote cluster. I marked the related issue as a bug and it will be fixed with that.