Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Properly apply system flag on data streams when restoring a snapshot #75819

Merged
merged 3 commits into from
Jul 29, 2021

Conversation

gwbrown
Copy link
Contributor

@gwbrown gwbrown commented Jul 28, 2021

This commit modifies the restore process to ensure that the system
flag is properly applied to restored data streams. Otherwise, this
flag is lost when restoring system data streams, which causes errors
and/or assertion failures as the backing indices are properly marked
as system indices, but the restored data stream is no longer a
system data stream.

Also adds a test to ensure this flag survives a round trip through
the snapshot/restore process.

Relates #75802

This commit modifies the restore process to ensure that the `system`
flag is properly applied to restored data streams. Otherwise, this
flag is lost when restoring system data streams, which causes errors
and/or assertion failures as the backing indices are properly marked
as system indices, but the restored data stream is no longer a
system data stream.

Also adds a test to ensure this flag survives a round trip through
the snapshot/restore process.
@gwbrown gwbrown added >bug :Core/Infra/Core Core issues without another label v8.0.0 v7.14.1 labels Jul 28, 2021
@gwbrown gwbrown requested a review from williamrandolph July 28, 2021 22:04
@elasticmachine elasticmachine added the Team:Core/Infra Meta label for core/infra team label Jul 28, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-infra (Team:Core/Infra)

@gwbrown
Copy link
Contributor Author

gwbrown commented Jul 28, 2021

Opened #75820 for the failure, which appears to be unrelated.

Copy link
Contributor

@williamrandolph williamrandolph left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wow, it is probably not great that we have two such similar constructors for data streams.

This PR looks good to me.

@gwbrown gwbrown merged commit 02ea1f9 into elastic:master Jul 29, 2021
gwbrown added a commit to gwbrown/elasticsearch that referenced this pull request Jul 29, 2021
elastic#75819)

This commit modifies the restore process to ensure that the `system`
flag is properly applied to restored data streams. Otherwise, this
flag is lost when restoring system data streams, which causes errors
and/or assertion failures as the backing indices are properly marked
as system indices, but the restored data stream is no longer a
system data stream.

Also adds a test to ensure this flag survives a round trip through
the snapshot/restore process.
gwbrown added a commit to gwbrown/elasticsearch that referenced this pull request Jul 29, 2021
elastic#75819)

This commit modifies the restore process to ensure that the `system`
flag is properly applied to restored data streams. Otherwise, this
flag is lost when restoring system data streams, which causes errors
and/or assertion failures as the backing indices are properly marked
as system indices, but the restored data stream is no longer a
system data stream.

Also adds a test to ensure this flag survives a round trip through
the snapshot/restore process.
elasticsearchmachine pushed a commit that referenced this pull request Jul 29, 2021
…apshot (#75854)

* Properly apply `system` flag on data streams when restoring a snapshot (#75819)

This commit modifies the restore process to ensure that the `system`
flag is properly applied to restored data streams. Otherwise, this
flag is lost when restoring system data streams, which causes errors
and/or assertion failures as the backing indices are properly marked
as system indices, but the restored data stream is no longer a
system data stream.

Also adds a test to ensure this flag survives a round trip through
the snapshot/restore process.

* Fix compilation for backport
elasticsearchmachine pushed a commit that referenced this pull request Jul 29, 2021
…apshot (#75855)

* Properly apply `system` flag on data streams when restoring a snapshot (#75819)

This commit modifies the restore process to ensure that the `system`
flag is properly applied to restored data streams. Otherwise, this
flag is lost when restoring system data streams, which causes errors
and/or assertion failures as the backing indices are properly marked
as system indices, but the restored data stream is no longer a
system data stream.

Also adds a test to ensure this flag survives a round trip through
the snapshot/restore process.

* Fix compilation for backport
@gwbrown gwbrown added >non-issue and removed >bug labels Jul 29, 2021
ywangd pushed a commit to ywangd/elasticsearch that referenced this pull request Jul 30, 2021
elastic#75819)

This commit modifies the restore process to ensure that the `system`
flag is properly applied to restored data streams. Otherwise, this
flag is lost when restoring system data streams, which causes errors
and/or assertion failures as the backing indices are properly marked
as system indices, but the restored data stream is no longer a
system data stream.

Also adds a test to ensure this flag survives a round trip through
the snapshot/restore process.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Core/Infra/Core Core issues without another label >non-issue Team:Core/Infra Meta label for core/infra team v7.14.0 v7.15.0 v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants