[BUG] [Remote State] Auto Restore during remote cluster state restore can lead to split primaries in Remote Store Domains

[linuxpi]

Describe the bug

• With Remote Store domains, if Remote Cluster State is enabled, after quorum loss recovery if local disk state is lost we auto restore from remote cluster state
• During this auto restore, due to network partitions isolating existing primaries can lead to replica being promoted to primary in other network partition.
• This can eventually lead to 2 primaries writing to remote.

To Reproduce
Steps to reproduce the behavior:

1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error

Expected behavior
Remote cluster state Auto Restore should not lead to split primaries.

Plugins
Please list all plugins currently enabled.

Screenshots
If applicable, add screenshots to help explain your problem.

Host/Environment (please complete the following information):

• OS: [e.g. iOS]
• Version [e.g. 22]

Additional context
Add any other context about the problem here.

[shwetathareja]

@linuxpi : wondering if this should be a configuration control where user accepts the risk and wants to enable auto restore for higher availability.

[linuxpi]

@linuxpi : wondering if this should be a configuration control where user accepts the risk and wants to enable auto restore for higher availability.

yeah, i think we can evaluate that. restoring to a green cluster is a really good state and this a very edge case. i can keep this issue open or open a new one to evaluate that