Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AWS Kinesis] Add metric type to fields #5866

Merged
merged 4 commits into from
May 22, 2023
Merged
Show file tree
Hide file tree
Changes from 3 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions packages/aws/changelog.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,9 @@
# newer versions go on top
- version: "1.34.0"
changes:
- description: Add support for TSDB on kinesis data stream (metric type).
type: enhancement
link: https://github.com/elastic/integrations/pull/5866
- version: "1.33.3"
changes:
- description: Add number_of_workers and latency to all CloudWatch Logs based integrations.
Expand Down
27 changes: 27 additions & 0 deletions packages/aws/data_stream/kinesis/fields/fields.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,131 +7,158 @@
- name: StreamName
type: keyword
description: The name of the Kinesis stream. All available statistics are filtered by StreamName.

- name: kinesis.metrics
type: group
fields:
- name: GetRecords_Bytes.avg
type: double
metric_type: gauge
description: >
The average number of bytes retrieved from the Kinesis stream, measured over the specified time period.

- name: GetRecords_IteratorAgeMilliseconds.avg
type: double
metric_type: gauge
description: >
The age of the last record in all GetRecords calls made against a Kinesis stream, measured over the specified time period. Age is the difference between the current time and when the last record of the GetRecords call was written to the stream.

- name: GetRecords_Latency.avg
type: double
metric_type: gauge
description: >
The time taken per GetRecords operation, measured over the specified time period.

- name: GetRecords_Records.sum
type: long
metric_type: gauge
description: >
The number of records retrieved from the shard, measured over the specified time period.

- name: GetRecords_Success.sum
type: long
metric_type: gauge
description: >
The number of successful GetRecords operations per stream, measured over the specified time period.

- name: IncomingBytes.avg
type: double
metric_type: gauge
description: >
The number of bytes successfully put to the Kinesis stream over the specified time period. This metric includes bytes from PutRecord and PutRecords operations.

- name: IncomingRecords.avg
type: double
metric_type: gauge
description: >
The number of records successfully put to the Kinesis stream over the specified time period. This metric includes record counts from PutRecord and PutRecords operations.

- name: PutRecord_Bytes.avg
type: double
metric_type: gauge
description: >
The number of bytes put to the Kinesis stream using the PutRecord operation over the specified time period.

- name: PutRecord_Latency.avg
type: double
metric_type: gauge
description: >
The time taken per PutRecord operation, measured over the specified time period.

- name: PutRecord_Success.avg
type: double
metric_type: gauge
description: >
The percentage of successful writes to a Kinesis stream, measured over the specified time period.

- name: PutRecords_Bytes.avg
type: double
metric_type: gauge
description: >
The average number of bytes put to the Kinesis stream using the PutRecords operation over the specified time period.

- name: PutRecords_Latency.avg
type: double
metric_type: gauge
description: >
The average time taken per PutRecords operation, measured over the specified time period.

- name: PutRecords_Success.avg
type: long
metric_type: gauge
description: >
The total number of PutRecords operations where at least one record succeeded, per Kinesis stream, measured over the specified time period.


- name: PutRecords_TotalRecords.sum
type: long
metric_type: gauge
description: >
The total number of records sent in a PutRecords operation per Kinesis data stream, measured over the specified time period.

- name: PutRecords_SuccessfulRecords.sum
type: long
metric_type: gauge
description: >
The number of successful records in a PutRecords operation per Kinesis data stream, measured over the specified time period.

- name: PutRecords_FailedRecords.sum
type: long
metric_type: gauge
description: >
The number of records rejected due to internal failures in a PutRecords operation per Kinesis data stream, measured over the specified time period.

- name: PutRecords_ThrottledRecords.sum
type: long
metric_type: gauge
description: >
The number of records rejected due to throttling in a PutRecords operation per Kinesis data stream, measured over the specified time period.

- name: ReadProvisionedThroughputExceeded.avg
type: long
metric_type: gauge
description: >
The number of GetRecords calls throttled for the stream over the specified time period.

- name: SubscribeToShard_RateExceeded.avg
type: long
metric_type: gauge
description: >
This metric is emitted when a new subscription attempt fails because there already is an active subscription by the same consumer or if you exceed the number of calls per second allowed for this operation.

- name: SubscribeToShard_Success.avg
type: long
metric_type: gauge
description: >
This metric records whether the SubscribeToShard subscription was successfully established.

- name: SubscribeToShardEvent_Bytes.avg
type: long
metric_type: gauge
description: >
The number of bytes received from the shard, measured over the specified time period.

- name: SubscribeToShardEvent_MillisBehindLatest.avg
type: long
metric_type: gauge
description: >
The difference between the current time and when the last record of the SubscribeToShard event was written to the stream.

- name: SubscribeToShardEvent_Records.sum
type: long
metric_type: gauge
description: >
The number of records received from the shard, measured over the specified time period.

- name: SubscribeToShardEvent_Success.avg
type: long
metric_type: gauge
description: >
This metric is emitted every time an event is published successfully. It is only emitted when there's an active subscription.

- name: WriteProvisionedThroughputExceeded.avg
type: long
metric_type: gauge
description: >
The number of records rejected due to throttling for the stream over the specified time period. This metric includes throttling from PutRecord and PutRecords operations.

Expand Down
Loading