[Metricbeat] [AWS] Add DynamoDB AWS light module

metricbeat/docs/fields.asciidoc

@@ -1586,6 +1586,12 @@ type: object
 
 --
 
+[float]
+=== dynamodb
+
+`dynamodb` contains the metrics that were scraped from AWS CloudWatch which contains monitoring metrics sent by AWS DynamoDB.
+
+
 [float]
 === ebs
 

metricbeat/docs/modules/aws.asciidoc

@@ -153,6 +153,8 @@ The following metricsets are available:
 
 * <<metricbeat-metricset-aws-cloudwatch,cloudwatch>>
 
+* <<metricbeat-metricset-aws-dynamodb,dynamodb>>
+
 * <<metricbeat-metricset-aws-ebs,ebs>>
 
 * <<metricbeat-metricset-aws-ec2,ec2>>
@@ -175,6 +177,8 @@ include::aws/billing.asciidoc[]
 
 include::aws/cloudwatch.asciidoc[]
 
+include::aws/dynamodb.asciidoc[]
+
 include::aws/ebs.asciidoc[]
 
 include::aws/ec2.asciidoc[]

metricbeat/docs/modules/aws/dynamodb.asciidoc

@@ -0,0 +1,24 @@
+////
+This file is generated! See scripts/mage/docs_collector.go
+////
+
+[[metricbeat-metricset-aws-dynamodb]]
+=== aws dynamodb metricset
+
+beta[]
+
+include::../../../../x-pack/metricbeat/module/aws/dynamodb/_meta/docs.asciidoc[]
+
+This is a default metricset. If the host module is unconfigured, this metricset is enabled by default.
+
+==== Fields
+
+For a description of each field in the metricset, see the
+<<exported-fields-aws,exported fields>> section.
+
+Here is an example document generated by this metricset:
+
+[source,json]
+----
+include::../../../../x-pack/metricbeat/module/aws/dynamodb/_meta/data.json[]
+----

metricbeat/docs/modules_list.asciidoc

@@ -16,8 +16,9 @@ This file is generated! See scripts/mage/docs_collector.go
 |<<metricbeat-module-appsearch,App Search>>  beta[]   |image:./images/icon-no.png[No prebuilt dashboards]    |  
 .1+| .1+|  |<<metricbeat-metricset-appsearch-stats,stats>> beta[]  
 |<<metricbeat-module-aws,aws>>     |image:./images/icon-yes.png[Prebuilt dashboards are available]    |  
-.11+| .11+|  |<<metricbeat-metricset-aws-billing,billing>> beta[]  
+.12+| .12+|  |<<metricbeat-metricset-aws-billing,billing>> beta[]  
 |<<metricbeat-metricset-aws-cloudwatch,cloudwatch>>   
+|<<metricbeat-metricset-aws-dynamodb,dynamodb>> beta[]  
 |<<metricbeat-metricset-aws-ebs,ebs>>   
 |<<metricbeat-metricset-aws-ec2,ec2>>   
 |<<metricbeat-metricset-aws-elb,elb>> beta[]  

x-pack/metricbeat/module/aws/dynamodb/_meta/docs.asciidoc

@@ -0,0 +1,52 @@
+The `dynamodb` metricset of aws module allows you to monitor your AWS SNS topic. `dynamodb` metricset fetches a set of values from
+https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/metrics-dimensions.html[Amazon DynamoDB Metrics].
+For all other DynamoDB metrics, the aggregation granularity is five minutes.
+
+[float]
+=== Configuration example
+[source,yaml]
+----
+- module: aws
+  period: 300s
+  metricsets:
+    - sns
+  # This module uses the aws cloudwatch metricset, all
+  # the options for this metricset are also available here.
+----
+
+[float]
+=== Metrics
+Please see more details for each metric in
+https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/metrics-dimensions.html[Amazon DynamoDB Metrics].
+
+|===
+|Metric Name|Statistic Method
+|SuccessfulRequestLatency | Average
+|OnlineIndexPercentageProgress | Average
+|ProvisionedWriteCapacityUnits | Average
+|ProvisionedReadCapacityUnits | Average
+|ConsumedReadCapacityUnits | Average
+|ConsumedWriteCapacityUnits | Average
+|ReplicationLatency | Average
+|TransactionConflict | Average
+|AccountProvisionedReadCapacityUtilization | Average
+|AccountProvisionedWriteCapacityUtilization | Average
+|SystemErrors | Sum
+|ConsumedReadCapacityUnits | Sum
+|ConsumedWriteCapacityUnits | Sum
+|ConditionalCheckFailedRequests | Sum
+|PendingReplicationCount | Sum
+|TransactionConflict | Sum
+|ReadThrottleEvents | Sum
+|ThrottledRequests | Sum
+|WriteThrottleEvents | Sum
+|SuccessfulRequestLatency | Maximum
+|ReplicationLatency | Maximum
+|AccountMaxReads | Maximum
+|AccountMaxTableLevelReads | Maximum
+|AccountMaxTableLevelWrites | Maximum
+|AccountMaxWrites | Maximum
+|MaxProvisionedTableReadCapacityUtilization | Maximum
+|MaxProvisionedTableWriteCapacityUtilization | Maximum
+|===
+

x-pack/metricbeat/module/aws/dynamodb/_meta/fields.yml

@@ -0,0 +1,6 @@
+- name: dynamodb
+  type: group
+  description: >
+    `dynamodb` contains the metrics that were scraped from AWS CloudWatch which contains monitoring metrics sent by AWS DynamoDB.
+  release: beta
+  fields:

x-pack/metricbeat/module/aws/dynamodb/dynamodb_integration_test.go

@@ -0,0 +1,24 @@
+// Copyright Elasticsearch B.V. and/or licensed to Elasticsearch B.V. under one
+// or more contributor license agreements. Licensed under the Elastic License;
+// you may not use this file except in compliance with the Elastic License.
+
+// +build integration
+
+package dynamodb
+
+import (
+	"testing"
+
+	mbtest "github.com/elastic/beats/metricbeat/mb/testing"
+	"github.com/elastic/beats/x-pack/metricbeat/module/aws/mtest"
+)
+
+func TestData(t *testing.T) {
+	config, info := mtest.GetConfigForTest("dynamodb", "300s")
+	if info != "" {
+		t.Skip("Skipping TestData: " + info)
+	}
+
+	metricSet := mbtest.NewFetcher(t, config)
+	metricSet.WriteEvents(t, "/")
+}

x-pack/metricbeat/module/aws/dynamodb/dynamodb_test.go

@@ -0,0 +1,21 @@
+// Copyright Elasticsearch B.V. and/or licensed to Elasticsearch B.V. under one
+// or more contributor license agreements. Licensed under the Elastic License;
+// you may not use this file except in compliance with the Elastic License.
+
+package dynamodb
+
+import (
+	"os"
+
+	"github.com/elastic/beats/metricbeat/mb"
+
+	// Register input module and metricset
+	_ "github.com/elastic/beats/x-pack/metricbeat/module/aws"
+	_ "github.com/elastic/beats/x-pack/metricbeat/module/aws/cloudwatch"
+)
+
+func init() {
+	// To be moved to some kind of helper
+	os.Setenv("BEAT_STRICT_PERMS", "false")
+	mb.Registry.SetSecondarySource(mb.NewLightModulesSource("../../../module"))
+}

x-pack/metricbeat/module/aws/dynamodb/manifest.yml

@@ -0,0 +1,42 @@
+default: true
+input:
+  module: aws
+  metricset: cloudwatch
+  defaults:
+    metrics:
+      - namespace: AWS/DynamoDB
+        statistic: ["Average"]
+        name:
+          - SuccessfulRequestLatency
+          - OnlineIndexPercentageProgress
+          - ProvisionedWriteCapacityUnits
+          - ProvisionedReadCapacityUnits
+          - ConsumedReadCapacityUnits
+          - ConsumedWriteCapacityUnits
+          - ReplicationLatency
+          - TransactionConflict
+          - AccountProvisionedReadCapacityUtilization
+          - AccountProvisionedWriteCapacityUtilization
+      - namespace: AWS/DynamoDB
+        statistic: ["Sum"]
+        name:
+          - SystemErrors
+          - ConsumedReadCapacityUnits
+          - ConsumedWriteCapacityUnits
+          - ConditionalCheckFailedRequests
+          - PendingReplicationCount
+          - TransactionConflict
+          - ReadThrottleEvents
+          - ThrottledRequests
+          - WriteThrottleEvents
+      - namespace: AWS/DynamoDB
+        statistic: ["Maximum"]
+        name:
+          - SuccessfulRequestLatency
+          - ReplicationLatency
+          - AccountMaxReads
+          - AccountMaxTableLevelReads
+          - AccountMaxTableLevelWrites
+          - AccountMaxWrites
+          - MaxProvisionedTableReadCapacityUtilization
+          - MaxProvisionedTableWriteCapacityUtilization

x-pack/metricbeat/module/aws/module.yml

@@ -5,3 +5,4 @@ metricsets:
   - usage
   - billing
   - sns
+  - dynamodb