Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Index Management] Support Hidden Indices #66422

Conversation

jloleysens
Copy link
Contributor

@jloleysens jloleysens commented May 13, 2020

Summary

Fix #56532

Adds support for showing hidden indices in Index Management which replaces the notion of system indices in the UI.

How to test

See the linked issue for more details, but essentially:

  1. Go to Index Management
  2. Toggle the show hidden indices switch
  3. See some hidden indices appearing and disappearing

It would be good to test any other logic that perhaps uses the fetch_indices logic, but because our external contract has not changed this should not affect any enrich consumers.

Checklist

Delete any items that are not applicable to this PR.

For maintainers

@jloleysens jloleysens added chore Feature:Index Management Index and index templates UI v8.0.0 Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more release_note:skip Skip the PR/issue when compiling release notes v7.8.0 v7.9.0 labels May 13, 2020
@jloleysens jloleysens requested a review from sebelga May 13, 2020 14:53
@jloleysens jloleysens requested a review from a team as a code owner May 13, 2020 14:53
@elasticmachine
Copy link
Contributor

Pinging @elastic/es-ui (Team:Elasticsearch UI)

@jloleysens jloleysens removed the v7.8.0 label May 13, 2020
@jloleysens
Copy link
Contributor Author

@elasticmachine merge upstream

Copy link
Contributor

@sebelga sebelga left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Tested locally and works as expected. Great job @jloleysens !

The only thing left is to find out if my concerns about performance with the GET /<indices> API on big clusters is founded.

@@ -33,12 +33,12 @@ export const tableState = handleActions(
currentPage: 0,
};
},
[showSystemIndicesChanged](state, action) {
const { showSystemIndices } = action.payload;
[showHiddenIndicesChanged](state, action) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this also feel like you're reading the docs? 😄

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

😂 quite!

},
});

if (!Object.keys(indices).length) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we know that the GET /<indices> is slower than the _cat/indices, we might better then fetch first the cat indices and exit early from there. WDYT?

Copy link
Contributor Author

@jloleysens jloleysens May 14, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I spoke to @danhermann about this, he mentioned that both _cat/indices and /<indices> would suffer a performance hit on clusters with many indices + shards but that there is a new endpoint that will support this being built #64858 we can use that will be released soon. We can review after it is available - perhaps we will need to remove some values we have in the table at the moment.

@jloleysens
Copy link
Contributor Author

@elasticmachine merge upstream

@kibanamachine
Copy link
Contributor

💚 Build Succeeded

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@jloleysens jloleysens merged commit 2fe3e4e into elastic:master May 15, 2020
@jloleysens jloleysens deleted the index-management/chore/support-hidden-indices branch May 15, 2020 11:06
jloleysens added a commit to jloleysens/kibana that referenced this pull request May 15, 2020
* First iteration of supporting hidden indices in indices table

Tests probably have broken

* Remove unused code

* Fix logic when calling get index endpoint with empty array

Also remove unused translations

* More terse!

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
jloleysens added a commit to jloleysens/kibana that referenced this pull request May 15, 2020
…ent/add-support-in-url-for-hidden-toggle

* 'master' of github.com:elastic/kibana: (34 commits)
  [SIEM][CASE] Fix bug when connector is deleted. (elastic#65876)
  [SIEM][CASE] Improve layout (elastic#66232)
  [Index Management] Support Hidden Indices (elastic#66422)
  Add Login Selector functional tests. (elastic#65705)
  Lens drilldowns (elastic#65675)
  [ML] Custom template for apiDoc markdown (elastic#66567)
  Don't bootstrap core type emits (elastic#66377)
  [Dashboard] Improve loading error handling (elastic#66372)
  [APM] Minor style fixes for the node strokes (elastic#66574)
  [Ingest Manager] Fix create data source from integration (elastic#66626)
  [Metrics UI] Fix default metric alert interval for new conditions (elastic#66610)
  [Metrics UI] Fix alignment and allow clearing metric value (elastic#66589)
  Don't return package name for non-package data streams (elastic#66606)
  [Ingest Manager] Consolidate routing and add breadcrumbs to all pages (elastic#66475)
  [Docs/Reporting] Have the docs about granular timeout match Cloud docs (elastic#66267)
  Don't automatically add license header to code inside plugins dir. (elastic#66601)
  [APM] Don't trigger map layout if no elements (elastic#66625)
  [Logs UI] Validate ML job setup time ranges (elastic#66426)
  Fix pagination bugs in CCR and Remote Clusters (elastic#65931)
  Add cloud icon for supported settings and embed single-sourced getting started (elastic#65610)
  ...

# Conflicts:
#	x-pack/plugins/index_management/public/application/sections/home/index_list/index_table/index_table.js
#	x-pack/plugins/index_management/server/lib/fetch_indices.ts
jloleysens added a commit that referenced this pull request May 16, 2020
* First iteration of supporting hidden indices in indices table

Tests probably have broken

* Remove unused code

* Fix logic when calling get index endpoint with empty array

Also remove unused translations

* More terse!

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
chore Feature:Index Management Index and index templates UI release_note:skip Skip the PR/issue when compiling release notes Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more v7.9.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Update Index Management to support hidden indices
4 participants