You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[manage data] Update for the 9.2 data management menu (elastic#3462)
Closeselastic#3272
Updates references to pages that are moving from Stack Management to
Data Management in 9.2 in the `manage-data` directory of this repo
following the guidance in
elastic#2566.
---------
Co-authored-by: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com>
Copy file name to clipboardExpand all lines: manage-data/_snippets/create-lifecycle-policy.md
+6-2Lines changed: 6 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,13 +10,17 @@ The `min_age` value is relative to the rollover time, not the index creation tim
10
10
::::
11
11
12
12
13
-
You can create the policy in {{kib}} or with the [create or update policy](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-ilm-put-lifecycle) API.
13
+
You can create the policy in {{kib}} or with the [create or update policy](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-ilm-put-lifecycle) API.
14
14
15
15
::::{tab-set}
16
16
:group: kibana-api
17
17
:::{tab-item} {{kib}}
18
18
:sync: kibana
19
-
To create the policy from {{kib}}, open the menu and go to **Stack Management > Index Lifecycle Policies**. Click **Create policy**.
19
+
20
+
To create the policy from {{kib}}:
21
+
22
+
1. Go to the **Index Lifecycle Policies** management page using the navigation menu or the [global search field](/explore-analyze/find-and-organize/find-apps-and-objects.md).
23
+
1. Click **Create policy**.
20
24
21
25
By default, only the hot index lifecycle phase is enabled. Enable each additional lifecycle phase that you'd like.
Copy file name to clipboardExpand all lines: manage-data/data-store/data-streams/set-up-data-stream.md
+20-6Lines changed: 20 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -33,7 +33,10 @@ For {{fleet}} and {{agent}}, refer to [](/reference/fleet/data-streams.md). For
33
33
34
34
While optional, we recommend using {{ilm-init}} to automate the management of your data stream’s backing indices. {{ilm-init}} requires an index lifecycle policy.
35
35
36
-
To create an index lifecycle policy in {{kib}}, open the main menu and go to **Stack Management > Index Lifecycle Policies**. Click **Create policy**.
36
+
To create an index lifecycle policy in {{kib}}:
37
+
38
+
1. Go to the **Index Lifecycle Policies** management page using the navigation menu or the [global search field](/explore-analyze/find-and-organize/find-apps-and-objects.md).
39
+
1. Click **Create policy**.
37
40
38
41
You can also use the [create lifecycle policy API](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-ilm-put-lifecycle).
39
42
@@ -104,8 +107,10 @@ If you’re unsure how to map your fields, use [runtime fields](../mapping/defin
104
107
105
108
::::
106
109
110
+
To create a component template in {{kib}}:
107
111
108
-
To create a component template in {{kib}}, open the main menu and go to **Stack Management > Index Management**. In the **Index Templates** view, click **Create component template**.
112
+
1. Go to the **Index Management** page using the navigation menu or the [global search field](/explore-analyze/find-and-organize/find-apps-and-objects.md).
113
+
1. In the **Index Templates** tab, click **Create component template**.
109
114
110
115
You can also use the [create component template API](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-cluster-put-component-template).
111
116
@@ -157,7 +162,10 @@ Use your component templates to create an index template. Specify:
157
162
* Any component templates that contain your mappings and index settings.
158
163
* A priority higher than `200` to avoid collisions with built-in templates. See [Avoid index pattern collisions](../templates.md#avoid-index-pattern-collisions).
159
164
160
-
To create an index template in {{kib}}, open the main menu and go to **Stack Management > Index Management**. In the **Index Templates** view, click **Create template**.
165
+
To create an index template in {{kib}}:
166
+
167
+
1. Go to the **Index Management** page using the navigation menu or the [global search field](/explore-analyze/find-and-organize/find-apps-and-objects.md).
168
+
1. In the **Index Templates** tab, click **Create template**.
161
169
162
170
You can also use the [create index template API](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-indices-put-index-template). Include the `data_stream` object to enable data streams.
163
171
@@ -202,7 +210,7 @@ You can also manually create the stream using the [create data stream API](https
202
210
PUT _data_stream/my-data-stream
203
211
```
204
212
205
-
After it's been created, you can view and manage this and other data streams from the **Stack Management > Index Management** view. Refer to [Manage a data stream](./manage-data-stream.md) for details.
213
+
After it's been created, you can view and manage this and other data streams from the **Index Management** view. Refer to [Manage a data stream](./manage-data-stream.md) for details.
206
214
207
215
## Secure the data stream [secure-data-stream]
208
216
@@ -224,7 +232,10 @@ POST _data_stream/_migrate/my-time-series-data
224
232
225
233
## Get information about a data stream [get-info-about-data-stream]
226
234
227
-
To get information about a data stream in {{kib}}, open the main menu and go to **Stack Management > Index Management**. In the **Data Streams** view, click the data stream’s name.
235
+
To get information about a data stream in {{kib}}:
236
+
237
+
1. Go to the **Index Management** page using the navigation menu or the [global search field](/explore-analyze/find-and-organize/find-apps-and-objects.md).
238
+
1. In the **Data Streams** tab, click the data stream’s name.
228
239
229
240
You can also use the [get data stream API](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-indices-get-data-stream).
230
241
@@ -235,7 +246,10 @@ GET _data_stream/my-data-stream
235
246
236
247
## Delete a data stream [delete-data-stream]
237
248
238
-
To delete a data stream and its backing indices in {{kib}}, open the main menu and go to **Stack Management > Index Management**. In the **Data Streams** view, click the trash icon. The icon only displays if you have the `delete_index`[security privilege](elasticsearch://reference/elasticsearch/security-privileges.md) for the data stream.
249
+
To delete a data stream and its backing indices in {{kib}}:
250
+
251
+
1. Go to the **Index Management** page using the navigation menu or the [global search field](/explore-analyze/find-and-organize/find-apps-and-objects.md).
252
+
1. In the **Data Streams** view, click the trash icon. The icon only displays if you have the `delete_index`[security privilege](elasticsearch://reference/elasticsearch/security-privileges.md) for the data stream.
239
253
240
254
You can also use the [delete data stream API](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-indices-delete-data-stream).
Copy file name to clipboardExpand all lines: manage-data/ingest/transform-enrich/example-parse-logs.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -24,7 +24,7 @@ The logs you want to parse look similar to this:
24
24
25
25
These logs contain a timestamp, IP address, and user agent. You want to give these three items their own field in {{es}} for faster searches and visualizations. You also want to know where the request is coming from.
26
26
27
-
1. In {{kib}}, open the main menu and click **Stack Management**> **Ingest Pipelines**.
27
+
1. In {{kib}}, go to the **Ingest Pipelines**management page using the navigation menu or the [global search field](/explore-analyze/find-and-organize/find-apps-and-objects.md).
Copy file name to clipboardExpand all lines: manage-data/ingest/transform-enrich/ingest-pipelines.md
+9-7Lines changed: 9 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -29,7 +29,9 @@ You can create and manage ingest pipelines using {{kib}}'s **Ingest Pipelines**
29
29
30
30
## Create and manage pipelines [create-manage-ingest-pipelines]
31
31
32
-
In {{kib}}, open the main menu and click **Stack Management > Ingest Pipelines**. From the list view, you can:
32
+
In {{kib}}, go to the **Ingest Pipelines** management page using the navigation menu or the [global search field](/explore-analyze/find-and-organize/find-apps-and-objects.md).
33
+
34
+
From the list view, you can:
33
35
34
36
* View a list of your pipelines and drill down into details
35
37
* Edit or clone existing pipelines
@@ -457,7 +459,7 @@ PUT _ingest/pipeline/my-pipeline
457
459
}
458
460
```
459
461
1. All processors in this pipeline will use the `classic` access pattern.
460
-
2. The logic for resolving field paths used by processors to read and write values to ingest documents is based on the access pattern.
462
+
2. The logic for resolving field paths used by processors to read and write values to ingest documents is based on the access pattern.
461
463
462
464
### Classic field access pattern [access-source-pattern-classic]
463
465
@@ -503,7 +505,7 @@ POST /_ingest/pipeline/_simulate
503
505
1. Explicitly declaring to use the `classic` access pattern in the pipeline. This is the default value.
504
506
2. We are reading a value from the field `foo.bar`.
505
507
3. We are writing its value to the field `a.b.c.d`.
506
-
4. This document uses nested json objects in its structure.
508
+
4. This document uses nested json objects in its structure.
507
509
5. This document uses dotted field names in its structure.
508
510
509
511
```console-result
@@ -514,7 +516,7 @@ POST /_ingest/pipeline/_simulate
514
516
"_id": "id",
515
517
"_index": "index",
516
518
"_version": "-3",
517
-
"_source": {
519
+
"_source": {
518
520
"foo": {
519
521
"bar": "baz" <1>
520
522
},
@@ -551,14 +553,14 @@ POST /_ingest/pipeline/_simulate
551
553
2. The value from the `foo.bar` field is written to a nested json structure at field `a.b.c.d`. The processor creates objects for each field in the path.
552
554
3. The second document uses a dotted field name for `foo.bar`. The `classic` access pattern does not recognize dotted field names, and so nothing is copied.
553
555
554
-
If the documents you are ingesting contain dotted field names, to read them with the `classic` access pattern, you must use the [`dot_expander`](elasticsearch://reference/enrich-processor/dot-expand-processor.md) processor. This approach is not always reasonable though. Consider the following document:
556
+
If the documents you are ingesting contain dotted field names, to read them with the `classic` access pattern, you must use the [`dot_expander`](elasticsearch://reference/enrich-processor/dot-expand-processor.md) processor. This approach is not always reasonable though. Consider the following document:
555
557
556
558
```json
557
559
{
558
560
"event": {
559
561
"tags": {
560
562
"http.host": "localhost:9200",
561
-
"http.host.name": "localhost",
563
+
"http.host.name": "localhost",
562
564
"http.host.port": 9200
563
565
}
564
566
}
@@ -623,7 +625,7 @@ POST /_ingest/pipeline/_simulate
Copy file name to clipboardExpand all lines: manage-data/ingest/transform-enrich/logstash-pipelines.md
+4-2Lines changed: 4 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -12,7 +12,7 @@ products:
12
12
13
13
This content applies to: [](../../../solutions/search.md)[](../../../solutions/observability.md)[](../../../solutions/security/elastic-security-serverless.md)
14
14
15
-
In **{{project-settings}} → {{manage-app}} → {{ls-pipelines-app}}**, you can control multiple {{ls}} instances and pipeline configurations.
15
+
On the **{{ls-pipelines-app}}** management page, you can control multiple {{ls}} instances and pipeline configurations.
2. To add a new pipeline, go to **{{project-settings}} → {{manage-app}} → {{ls-pipelines-app}}** and click **Create pipeline**. Provide the following details, then click **Create and deploy**.
34
+
1. To add a new pipeline, go to the **{{ls-pipelines-app}}** management page using the navigation menu or the [global search field](/explore-analyze/find-and-organize/find-apps-and-objects.md).
35
+
1. Click **Create pipeline**.
36
+
1. Provide the following details, then click **Create and deploy**.
35
37
36
38
Pipeline ID
37
39
: A name that uniquely identifies the pipeline. This is the ID that you used when you configured centralized pipeline management and specified a list of pipeline IDs in the `xpack.management.pipeline.id` setting.
Copy file name to clipboardExpand all lines: manage-data/lifecycle/data-stream/tutorial-update-existing-data-stream.md
+10-7Lines changed: 10 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -17,7 +17,7 @@ Follow these steps to configure or remove data stream lifecycle settings for an
17
17
18
18
Note that these steps are for data stream lifecycle only. For the steps to configure {{ilm}}, refer to the [{{ilm-init}} documentation](/manage-data/lifecycle/index-lifecycle-management.md). For a comparison between the two, refer to [](/manage-data/lifecycle.md).
19
19
20
-
## Set a data stream’s lifecycle [set-lifecycle]
20
+
## Set a data stream’s lifecycle [set-lifecycle]
21
21
22
22
To add or to change the retention period of your data stream you can use the **Index Management** tools in {{kib}} or the {{es}} [lifecycle API](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-indices-put-data-lifecycle).
23
23
@@ -29,7 +29,8 @@ To add or to change the retention period of your data stream you can use the **I
29
29
30
30
To change the data retention settings for a data stream:
31
31
32
-
1. Go to **Stack Management > Index Management** and open the **Data Streams** tab.
32
+
1. Go to the **Index Management** page using the navigation menu or the [global search field](/explore-analyze/find-and-organize/find-apps-and-objects.md).
33
+
1. Open the **Data Streams** tab.
33
34
1. Use the search tool to find the data stream you're looking for.
34
35
1. Select the data stream to view its details.
35
36
1. In the data stream details pane, select **Manage > Edit data retention** to adjust the settings. You can do any of the following:
@@ -70,7 +71,7 @@ To change the data retention settings for a data stream:
70
71
:::
71
72
:::::
72
73
73
-
The changes in the lifecycle are applied on all backing indices of the data stream.
74
+
The changes in the lifecycle are applied on all backing indices of the data stream.
74
75
75
76
You can see the effect of the change in {{kib}} or using the {{es}} [explain API](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-indices-explain-data-lifecycle):
76
77
@@ -80,7 +81,8 @@ You can see the effect of the change in {{kib}} or using the {{es}} [explain API
80
81
:sync: kibana
81
82
To check the data retention settings for a data stream:
82
83
83
-
1. Go to **Stack Management > Index Management** and open the **Data Streams** tab.
84
+
1. Go to the **Index Management** page using the navigation menu or the [global search field](/explore-analyze/find-and-organize/find-apps-and-objects.md).
85
+
1. Open the **Data Streams** tab.
84
86
1. Use the search tool to find the data stream you're looking for.
85
87
1. Select the data stream to view its details. The flyout shows the data retention settings for the data stream. Note that if the data stream is currently managed by an [{{ilm-init}} policy](/manage-data/lifecycle/index-lifecycle-management.md), the **Effective data retention** may differ from the retention value that you've set in the data stream, as indicated by the **Data retention**.
86
88
@@ -144,9 +146,9 @@ The response will look like:
144
146
:::
145
147
:::::
146
148
147
-
## Remove the lifecycle for a data stream [delete-lifecycle]
149
+
## Remove the lifecycle for a data stream [delete-lifecycle]
148
150
149
-
To remove the lifecycle of a data stream you can use the **Index Management** tools in {{kib}} or the {{es}} [delete lifecycle API](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-indices-delete-data-lifecycle).
151
+
To remove the lifecycle of a data stream you can use the **Index Management** tools in {{kib}} or the {{es}} [delete lifecycle API](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-indices-delete-data-lifecycle).
150
152
151
153
152
154
:::::{tab-set}
@@ -156,7 +158,8 @@ To remove the lifecycle of a data stream you can use the **Index Management** to
156
158
157
159
To remove a data stream's lifecycle:
158
160
159
-
1. Go to **Stack Management > Index Management** and open the **Data Streams** tab.
161
+
1. Go to the **Index Management** page using the navigation menu or the [global search field](/explore-analyze/find-and-organize/find-apps-and-objects.md).
162
+
1. Open the **Data Streams** tab.
160
163
1. Use the search tool to find the data stream you're looking for.
161
164
1. Select the data stream to view its details.
162
165
1. In the data stream details pane, select **Manage > Edit data retention**.
Copy file name to clipboardExpand all lines: manage-data/lifecycle/data-tiers.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -428,7 +428,7 @@ When data reaches the `cold` or `frozen` phases, it is automatically converted t
428
428
429
429
9. Delete the searchable snapshots by following these steps:
430
430
431
-
1. Open Kibanaand navigate to Management > Data > Snapshot and Restore >Snapshots (or go to `<kibana-endpoint>/app/management/data/snapshot_restore/snapshots`)
431
+
1. Open Kibana, go to the **Snapshot and Restore** management page using the navigation menu or the [global search field](/explore-analyze/find-and-organize/find-apps-and-objects.md), and go to the **Snapshots** tab. (Alternatively, go to `<kibana-endpoint>/app/management/data/snapshot_restore/snapshots`.)
432
432
2. Search for`*<ilm-policy-name>*`
433
433
3. Bulk selectthe snapshots and delete them
434
434
@@ -494,7 +494,7 @@ This setting will not unallocate a currently allocated shard, but might prevent
494
494
495
495
### Automatic data tier migration [data-tier-migration]
496
496
497
-
{{ilm-init}} automatically transitions managed indices through the available data tiers using the [migrate](elasticsearch://reference/elasticsearch/index-lifecycle-actions/ilm-migrate.md) action. By default, this action is automatically injected in every phase.
497
+
{{ilm-init}} automatically transitions managed indices through the available data tiers using the [migrate](elasticsearch://reference/elasticsearch/index-lifecycle-actions/ilm-migrate.md) action. By default, this action is automatically injected in every phase.
498
498
499
499
### Disable data tier allocation [data-tier-allocation]
500
500
You can explicitly disable data allocation fordata tier migrationin an ILM policy with the following setting:
@@ -520,7 +520,7 @@ For example:
520
520
},
521
521
```
522
522
523
-
Defining the `migrate` action with `"enabled": false`for a data tier [disables automatic {{ilm-init}} shard migration](elasticsearch://reference/elasticsearch/index-lifecycle-actions/ilm-migrate.md#ilm-disable-migrate-ex). This is useful if, for example, you’re using the [allocate action](elasticsearch://reference/elasticsearch/index-lifecycle-actions/ilm-allocate.md) to manually specify allocation rules.
523
+
Defining the `migrate` action with `"enabled": false`for a data tier [disables automatic {{ilm-init}} shard migration](elasticsearch://reference/elasticsearch/index-lifecycle-actions/ilm-migrate.md#ilm-disable-migrate-ex). This is useful if, for example, you’re using the [allocate action](elasticsearch://reference/elasticsearch/index-lifecycle-actions/ilm-allocate.md) to manually specify allocation rules.
524
524
525
-
#### Important Note:
525
+
#### Important Note:
526
526
Do not disable automatic {{ilm-init}} migration without manually defining {{ilm-init}} allocation rules. If data migration is disabled without allocation rules defined, this can prevent data from moving to the specified data tier, even though the data has successfully moved through the {{ilm-init}} policy with a status of `complete`.
0 commit comments