Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate existing indices to a data stream #61046

Closed
danhermann opened this issue Aug 12, 2020 · 3 comments
Closed

Migrate existing indices to a data stream #61046

danhermann opened this issue Aug 12, 2020 · 3 comments
Assignees
Labels
:Data Management/Data streams Data streams and their lifecycles >enhancement Team:Data Management Meta label for data/management team

Comments

@danhermann
Copy link
Contributor

danhermann commented Aug 12, 2020

Introduce a new API to migrate existing indices into a data stream. The first iteration of the API will operate on a single alias with the following provisions:

  • The name of the alias will be used as the name of the new data stream. As part of the migration, the alias will be removed.
  • The alias should be "clean" with no filter or routing specifications.
  • All indices referenced by the alias will be set to hidden.
  • The alias must have a write index.
  • The _data_stream_timestamp field mapper will be inserted into the indices to enable validation.
  • The mappings of the indices with _data_stream_timestamp meta field mapper will be validated.
  • A composable index template must exist for the new data stream. If it is missing, the user must create it first.
@danhermann danhermann added >enhancement :Data Management/Data streams Data streams and their lifecycles labels Aug 12, 2020
@danhermann danhermann self-assigned this Aug 12, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-features (:Core/Features/Data streams)

@martijnvg
Copy link
Member

@danhermann I think this can be closed now?

@danhermann
Copy link
Contributor Author

Completed by #61525, #63749, #64415, and #65017.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Data Management/Data streams Data streams and their lifecycles >enhancement Team:Data Management Meta label for data/management team
Projects
None yet
Development

No branches or pull requests

3 participants