Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove frozen cache setting leniency #71013

Merged
merged 9 commits into from
Apr 2, 2021

Conversation

jasontedor
Copy link
Member

We previously allowed but deprecated the ability for the shared cache to be positively sized on nodes without the frozen role. This is because we only allocate shared_cache searchable snapshots to nodes with the frozen role. This commit completes our intention to deprecate/remove this ability.

Relates #70341

We previously allowed but deprecated the ability for the shared cache to
be positively sized on nodes without the frozen role. This is because we
only allocate shared_cache searchable snapshots to nodes with the frozen
role. This commit completes our intention to deprecate/remove this
ability.
@jasontedor jasontedor added >breaking :Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs v8.0.0 labels Mar 29, 2021
@elasticmachine elasticmachine added the Team:Distributed Meta label for distributed team (obsolete) label Mar 29, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

dakrone added a commit to dakrone/elasticsearch that referenced this pull request Mar 29, 2021
This commit converts the index metadata of searchable snapshot indices using the `shared_cache`
storage type to:

- Remove all the `index.routing.allocation.(include|exclude|require)._tier` settings
- Sets `index.routing.allocation.include._tier_preference` to `data_frozen` automatically when the index metadata is read

This is in preperation to enforcing that the `_tier_preference` setting is always set to
`data_frozen` for shared cache SBIs.

Relates to elastic#70846, elastic#71013, elastic#70786, elastic#70141
@dakrone
Copy link
Member

dakrone commented Mar 29, 2021

Can you also update docs/reference/searchable-snapshots/index.asciidoc to mention that the setting is un-settable on non-frozen nodes?

EDIT: and I think we should add a blurb in the migration guide for 8.0 for this as well, since it's breaking?

@jasontedor
Copy link
Member Author

@dakrone I pushed.

Copy link
Member

@dakrone dakrone left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, this means I won't have to merge #70846 to master and can just backport it directly to 7.x when it's approved \o/

Copy link
Contributor

@ywelsch ywelsch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@henningandersen henningandersen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@jasontedor
Copy link
Member Author

This is stalled on #71084 to easily get the tests to pass here.

dakrone added a commit that referenced this pull request Mar 31, 2021
This commit converts the index metadata of searchable snapshot indices using the `shared_cache`
storage type to:

- Remove all the `index.routing.allocation.(include|exclude|require)._tier` settings
- Sets `index.routing.allocation.include._tier_preference` to `data_frozen` automatically when the index metadata is read

This is in preperation to enforcing that the `_tier_preference` setting is always set to
`data_frozen` for shared cache SBIs.

Relates to #70846, #71013, #70786, #70141
dakrone added a commit to dakrone/elasticsearch that referenced this pull request Mar 31, 2021
This commit converts the index metadata of searchable snapshot indices using the `shared_cache`
storage type to:

- Remove all the `index.routing.allocation.(include|exclude|require)._tier` settings
- Sets `index.routing.allocation.include._tier_preference` to `data_frozen` automatically when the index metadata is read

This is in preperation to enforcing that the `_tier_preference` setting is always set to
`data_frozen` for shared cache SBIs.

Relates to elastic#70846, elastic#71013, elastic#70786, elastic#70141
dakrone added a commit that referenced this pull request Mar 31, 2021
…#71129)

This commit converts the index metadata of searchable snapshot indices using the `shared_cache`
storage type to:

- Remove all the `index.routing.allocation.(include|exclude|require)._tier` settings
- Sets `index.routing.allocation.include._tier_preference` to `data_frozen` automatically when the index metadata is read

This is in preperation to enforcing that the `_tier_preference` setting is always set to
`data_frozen` for shared cache SBIs.

Relates to #70846, #71013, #70786, #70141
@jasontedor
Copy link
Member Author

@elasticmachine run elasticsearch-ci/bwc

@jasontedor jasontedor merged commit d340432 into elastic:master Apr 2, 2021
@jasontedor jasontedor deleted the frozen-cache-non-frozen-nodes branch April 2, 2021 18:26
masseyke added a commit that referenced this pull request Sep 3, 2021
In 8.0 the ability to have a positive "xpack.searchable.snapshot.shared_cache.size" on a non-frozen node
has been removed. This commit adds a deprecation info API check if a non-frozen node has a positive
 "xpack.searchable.snapshot.shared_cache.size".
Relates #42404 #71013
jrodewig added a commit that referenced this pull request Sep 15, 2021
…he.size` (#77727)

We deprecated the `xpack.searchable.snapshot.shared_cache.size` setting on
non-frozen nodes in 7.12 with PR #70341. However, we didn't add a related item
to the 7.12 deprecation docs. This adds the missing item.

Relates to #71013.
elasticsearchmachine pushed a commit that referenced this pull request Sep 15, 2021
…he.size` (#77727) (#77762)

We deprecated the `xpack.searchable.snapshot.shared_cache.size` setting on
non-frozen nodes in 7.12 with PR #70341. However, we didn't add a related item
to the 7.12 deprecation docs. This adds the missing item.

Relates to #71013.
elasticsearchmachine pushed a commit that referenced this pull request Sep 15, 2021
…he.size` (#77727) (#77763)

We deprecated the `xpack.searchable.snapshot.shared_cache.size` setting on
non-frozen nodes in 7.12 with PR #70341. However, we didn't add a related item
to the 7.12 deprecation docs. This adds the missing item.

Relates to #71013.
elasticsearchmachine pushed a commit that referenced this pull request Sep 15, 2021
…he.size` (#77727) (#77764)

We deprecated the `xpack.searchable.snapshot.shared_cache.size` setting on
non-frozen nodes in 7.12 with PR #70341. However, we didn't add a related item
to the 7.12 deprecation docs. This adds the missing item.

Relates to #71013.
elasticsearchmachine pushed a commit that referenced this pull request Sep 15, 2021
…he.size` (#77727) (#77765)

We deprecated the `xpack.searchable.snapshot.shared_cache.size` setting on
non-frozen nodes in 7.12 with PR #70341. However, we didn't add a related item
to the 7.12 deprecation docs. This adds the missing item.

Relates to #71013.
# Conflicts:
#	docs/reference/migration/migrate_7_12.asciidoc
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>breaking :Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs Team:Distributed Meta label for distributed team (obsolete) v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants