Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add frozen phase to ILM UI #91189

Closed
cjcenizal opened this issue Feb 11, 2021 · 6 comments
Closed

Add frozen phase to ILM UI #91189

cjcenizal opened this issue Feb 11, 2021 · 6 comments
Labels
enhancement New value added to drive a business result Feature:ILM Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more

Comments

@cjcenizal
Copy link
Contributor

cjcenizal commented Feb 11, 2021

Previously implemented in #75968 and then removed in #77877

API

Per @dakrone, the frozen phase API is stable enough to develop a UI against, with code merged into master that supports:

The available actions in the frozen phase are:

  • set priority
  • unfollow
  • allocate
  • freeze
  • searchable snapshot

UX considerations

All searchable snapshot actions must use the same repository

Support for different repositories is not going to be in 7.12 and is unlikely to ever be implemented since it seems like a corner case. ILM will reject a policy if you have multiple searchable snapshot actions specifying different repos (elastic/elasticsearch#68856).

A naive UX solution to this constraint would be to surface validation errors if the user selects different repositories for multiple searchable snapshot actions.

A more sophisticated solution would be to prompt the user to specify a single policy-wide repository that will apply to all searchable snapshot actions. But this introduces its own challenges -- where would we surface this input? How do we maintain the connection to the searchable snapshot actions that it configures?

The searchable snapshot storage option is optional

If the storage option of the searchable_snapshot action isn't configured, it will default to different values depending on the phase it's in:

  • In the hot and cold phases it will default to a full searchable snapshot.
  • In the frozen phase it will default to a partial searchable snapshot.

Full searchable snapshots store primary data locally and store replica data in the snapshot. Primary data is restored from the snapshot if it's lost.

Partial searchable snapshots store no data locally. When the index is queried, they transfer data from the snapshot as it's needed, with some additional local caching.

Lee's guidance is that the UI doesn't need to provide a value for this option unless the user wants to.

The searchable snapshot action precludes some subsequent actions

Once searchable snapshot is enabled, certain other actions are disallowed from executing afterwards. This list was pulled from the ES code:

  • shrink
  • force merge
  • freeze
  • rollup

Note: The ES code lists searchable snapshot as also disallowed but elastic/elasticsearch#68864 has been opened to allow it.

@cjcenizal cjcenizal added enhancement New value added to drive a business result Feature:ILM Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more labels Feb 11, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/es-ui (Team:Elasticsearch UI)

@dakrone
Copy link
Member

dakrone commented Feb 11, 2021

specify a single policy-wide repository that will apply to all searchable snapshot actions. But this introduces its own challenges -- where would we surface this input? How do we maintain the connection to the searchable snapshot actions that it configures?

This is related to our idea of adding support for a default repository elastic/elasticsearch#66040

@cjcenizal
Copy link
Contributor Author

@sebelga Could you please review the Cloud UX of this functionality with @zanbel at some point?

@sebelga
Copy link
Contributor

sebelga commented Mar 2, 2021

@cjcenizal of course, we'll do a full UX test on Cloud. 👍

@cjcenizal
Copy link
Contributor Author

Thanks @sebelga. Recently we've been investing in improving the Cloud-specific UX (for example #90592 and #90894), so I was thinking it would be good to chat with Roy earlier in the process and verify any Cloud-specific requirements to consider before getting too far along into implementation.

@cjcenizal
Copy link
Contributor Author

Addressed by #93068

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New value added to drive a business result Feature:ILM Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more
Projects
None yet
Development

No branches or pull requests

4 participants