Skip to content
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.

Commit 578e9b8

Browse files
authoredMar 18, 2020
[Metricbeat] Add googlecloud compute overview dashboard (#16819)
* Add googlecloud compute overview dashboard
1 parent c06c106 commit 578e9b8

File tree

6 files changed

+977
-1
lines changed

6 files changed

+977
-1
lines changed
 

‎CHANGELOG.next.asciidoc

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -241,6 +241,7 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d
241241
- Align fields to ECS and add more tests for the azure module. {issue}16024[16024] {pull}16754[16754]
242242
- Add additional cgroup fields to docker/diskio{pull}16638[16638]
243243
- Add PubSub metricset to Google Cloud Platform module {pull}15536[15536]
244+
- Add overview dashboard for googlecloud compute metricset. {issue}16534[16534] {pull}16819[16819]
244245
- Add Prometheus remote write endpoint {pull}16609[16609]
245246
- Release STAN module as GA. {pull}16980[16980]
246247
- Release ActiveMQ module as GA. {issue}17047[17047] {pull}17049[17049]
Loading

‎metricbeat/docs/modules/googlecloud.asciidoc

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -70,6 +70,24 @@ Google Cloud Platform pricing depends of the number of requests you do to their
7070

7171
For example, if Compute Metricset fetches 14 metrics (which is the number of metrics fetched in the early beta version). Each of those metrics will attempt an API call to Compute API to retrieve also their metadata. Because you have 20 different instances, the total number of API calls that will be done on each refresh period are: 14 metrics + 20 instances = 34 API requests every 5 minutes if that is your current Period. 9792 API requests per day with one zone. If you add 2 zones more with the same amount of instances you'll have 19584 API requests per day (9792 on each zone) or around 587520 per month for the Compute Metricset. This maths must be done for each different Metricset with slight variations.
7272

73+
[float]
74+
== Metricsets
75+
Currently, we have `compute`, `loadbalancing`, and `pubsub` metricset in
76+
`googlecloud` module.
77+
78+
[float]
79+
=== `compute`
80+
Compute Metricset to fetch metrics from https://cloud.google.com/compute/[Compute Engine]
81+
Virtual Machines in Google Cloud Platform. The `compute` metricset contains some of the
82+
metrics exported from the https://cloud.google.com/monitoring/api/metrics_gcp#gcp-compute[Stackdriver API].
83+
Extra labels and metadata are also extracted using the https://cloud.google.com/compute/docs/reference/rest/v1/instances/get[Compute API].
84+
This is enough to get most of the info associated with a metric like compute
85+
labels and metadata and metric specific Labels.
86+
87+
The `compute` metricset comes with a predefined dashboard:
88+
89+
image::./images/metricbeat-googlecloud-compute-overview.png[]
90+
7391

7492
[float]
7593
=== Example configuration

‎metricbeat/docs/modules_list.asciidoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -106,7 +106,7 @@ This file is generated! See scripts/mage/docs_collector.go
106106
|<<metricbeat-module-golang,Golang>> |image:./images/icon-yes.png[Prebuilt dashboards are available] |
107107
.2+| .2+| |<<metricbeat-metricset-golang-expvar,expvar>>
108108
|<<metricbeat-metricset-golang-heap,heap>>
109-
|<<metricbeat-module-googlecloud,Google Cloud Platform>> beta[] |image:./images/icon-no.png[No prebuilt dashboards] |
109+
|<<metricbeat-module-googlecloud,Google Cloud Platform>> beta[] |image:./images/icon-yes.png[Prebuilt dashboards are available] |
110110
.3+| .3+| |<<metricbeat-metricset-googlecloud-compute,compute>> beta[]
111111
|<<metricbeat-metricset-googlecloud-loadbalancing,loadbalancing>> beta[]
112112
|<<metricbeat-metricset-googlecloud-pubsub,pubsub>> beta[]

‎x-pack/metricbeat/module/googlecloud/_meta/docs.asciidoc

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -59,3 +59,21 @@ A recommended `period` value between fetches is between 5 and 10 minutes, depend
5959
Google Cloud Platform pricing depends of the number of requests you do to their API's. Here you have some information that you can use to make an estimation of the pricing you should expect. For example, imagine that you have a Compute Metricset activated and you don't want to exclude labels. You have a total of 20 instances running in a particular GCP project, region and zone.
6060

6161
For example, if Compute Metricset fetches 14 metrics (which is the number of metrics fetched in the early beta version). Each of those metrics will attempt an API call to Compute API to retrieve also their metadata. Because you have 20 different instances, the total number of API calls that will be done on each refresh period are: 14 metrics + 20 instances = 34 API requests every 5 minutes if that is your current Period. 9792 API requests per day with one zone. If you add 2 zones more with the same amount of instances you'll have 19584 API requests per day (9792 on each zone) or around 587520 per month for the Compute Metricset. This maths must be done for each different Metricset with slight variations.
62+
63+
[float]
64+
== Metricsets
65+
Currently, we have `compute`, `loadbalancing`, and `pubsub` metricset in
66+
`googlecloud` module.
67+
68+
[float]
69+
=== `compute`
70+
Compute Metricset to fetch metrics from https://cloud.google.com/compute/[Compute Engine]
71+
Virtual Machines in Google Cloud Platform. The `compute` metricset contains some of the
72+
metrics exported from the https://cloud.google.com/monitoring/api/metrics_gcp#gcp-compute[Stackdriver API].
73+
Extra labels and metadata are also extracted using the https://cloud.google.com/compute/docs/reference/rest/v1/instances/get[Compute API].
74+
This is enough to get most of the info associated with a metric like compute
75+
labels and metadata and metric specific Labels.
76+
77+
The `compute` metricset comes with a predefined dashboard:
78+
79+
image::./images/metricbeat-googlecloud-compute-overview.png[]

0 commit comments

Comments
 (0)