Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AWS] Add dimensions to S3 Storage Lens #6583

Merged
merged 6 commits into from
Jun 28, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions packages/aws/changelog.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,9 @@
# newer versions go on top
- version: "1.45.4"
changes:
- description: Set dimension fields for S3 Storage Lens.
type: enhancement
link: https://github.com/elastic/integrations/pull/6583
- version: "1.45.3"
changes:
- description: Remove aws.dimensions.* from package-fields.yml
Expand Down
5 changes: 5 additions & 0 deletions packages/aws/data_stream/s3_storage_lens/fields/ecs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@
name: cloud
- external: ecs
name: cloud.account.id
dimension: true
- external: ecs
name: cloud.account.name
- external: ecs
Expand All @@ -14,6 +15,7 @@
name: cloud.provider
- external: ecs
name: cloud.region
dimension: true
- external: ecs
name: ecs.version
- external: ecs
Expand Down Expand Up @@ -60,3 +62,6 @@
name: container.labels
- external: ecs
name: container.name
- name: agent.id
external: ecs
dimension: true
8 changes: 8 additions & 0 deletions packages/aws/data_stream/s3_storage_lens/fields/fields.yml
Original file line number Diff line number Diff line change
Expand Up @@ -100,27 +100,35 @@
fields:
- name: configuration_id
type: keyword
dimension: true
description: The dashboard name for the S3 Storage Lens configuration reported in the metrics.
- name: metrics_version
type: keyword
dimension: true
description: The version of the S3 Storage Lens metrics. The metrics version has a fixed value of 1.0.
- name: organization_id
type: keyword
dimension: true
description: The AWS Organizations ID for the metrics.
- name: aws_account_number
type: keyword
dimension: true
description: The AWS account that's associated with the metrics.
- name: aws_region
type: keyword
dimension: true
description: The AWS Region for the metrics.
- name: bucket_name
type: keyword
dimension: true
description: The name of the S3 bucket that's reported in the metrics.
- name: storage_class
type: keyword
dimension: true
description: The storage class for the bucket that's reported in the metrics.
- name: record_type
type: keyword
dimension: true
description: The granularity of the metrics such as ORGANIZATION, ACCOUNT, BUCKET.
- name: aws.cloudwatch.namespace
type: keyword
Expand Down
1 change: 1 addition & 0 deletions packages/aws/docs/s3_storage_lens.md
Original file line number Diff line number Diff line change
Expand Up @@ -186,6 +186,7 @@ An example event for `s3_storage_lens` looks as following:
| Field | Description | Type |
|---|---|---|
| @timestamp | Event timestamp. | date |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword |
| aws.\*.metrics.\*.\* | Metrics that returned from Cloudwatch API query. | object |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword |
| aws.dimensions.aws_account_number | The AWS account that's associated with the metrics. | keyword |
Expand Down
2 changes: 1 addition & 1 deletion packages/aws/manifest.yml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
format_version: 1.0.0
name: aws
title: AWS
version: 1.45.3
version: 1.45.4
license: basic
description: Collect logs and metrics from Amazon Web Services (AWS) with Elastic Agent.
type: integration
Expand Down