Consume AWS metrics (EC2, ELB)

[panda87]

It will be great to add plugin to consume metrics from AWS CloudWatch, mainly the ELB and EC2 metrics.

[sparrc]

👍

[JulienChampseix]

👍

[jcmartins]

👍

[sparrc]

Definitely looks possible, there's this library: https://github.com/goamz/goamz that appears to provide most capabilities

[panda87]

This is correct, but you don't prefer using this library: https://github.com/aws/aws-sdk-go?
I saw that this project: https://github.com/bosun-monitor/bosun/blob/master/cmd/scollector/collectors/aws.go implemented part of metrics with the library above.
What do you think?

[sparrc]

oops, that's the one I meant to link, thanks @panda87

[harpreet-sawhney]

Any progress on this?

I happy to take this on.

[webratz]

👍

[dirkaholic]

Hi, I was thinking about this as well. Thought it would be a nice idea to implement a Kinesis connector similar to this one https://github.com/awslabs/cloudwatch-logs-subscription-consumer that is built in Java and has elasticsearch + kibana as target. It would have the huge advantage that you don't have to build a consumer for all the AWS services but you just need the Kinesis stream consumer and additionally you can already filter on AWS side which Cloudwatch logs you want to forward to this Kinesis stream using these subscription filters http://docs.aws.amazon.com/AmazonCloudWatch/latest/DeveloperGuide/Subscriptions.html. What do you think ?

[sparrc]

Kinesis consumer would also be good 👍

[webratz]

I guess this are two different tasks then: One would be the CloudWatch metrics consumer, one would be the Kinesis consumer

[sparrc]

closed by #935

[tdi]

For all of you still interested in it. Grafana can use AWS CloudWatch as a source.