Skip to content

Commit

Permalink
CEPHSTORA-498 Add doc for elk6x integration
Browse files Browse the repository at this point in the history
Add doc on how to collect metrics from ceph nodes and clusters using
elk_6x.
  • Loading branch information
mvollman committed Nov 28, 2018
1 parent f3026ed commit 630bf6b
Showing 1 changed file with 92 additions and 0 deletions.
92 changes: 92 additions & 0 deletions elk_6x_integration/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,92 @@
# Integrating rpc-ceph with elk_metrics_6x

You can collect metrics from Ceph nodes using [elk_metrics_6x](https://github.com/openstack/openstack-ansible-ops/tree/master/elk_metrics_6x) via metricbeat.
Metricbeat will be used to collect host metrics from the Ceph nodes and the prometheus plugin for metricbeat
will be used to collect Ceph metrics from the Prometheus plugin for the Ceph Mgr service.


## Install Metricbeats on Ceph Nodes

### Add Ceph Nodes to OSA Inventory

If you do not already have a inventory group setup to manage your Ceph cluster you will need to create one.

```
# cat <<EOF > /etc/openstack_deploy/env.d/ceph.yml
---
component_skel:
ceph-ext:
belongs_to:
- ceph_ext_all
container_skel:
ceph-ext_container:
belongs_to:
- ceph-ext_containers
contains:
- ceph-ext
properties:
is_metal: true
physical_skel:
ceph-ext_containers:
belongs_to:
- all_containers
ceph-ext_hosts:
belongs_to:
- hosts
EOF
```

```
# cat <<EOF > /etc/openstack_deploy/conf.d/ceph.yml
ceph-ext_hosts:
ceph-perf-stor-1:
ip: 172.20.58.41
ceph-perf-stor-2:
ip: 172.20.58.42
ceph-perf-stor-3:
ip: 172.20.58.43
ceph-perf-stor-4:
ip: 172.20.58.44
ceph-perf-stor-5:
ip: 172.20.58.45
ceph-perf-stor-6:
ip: 172.20.58.46
EOF
```

### Configure Metricbeat Prometheus Module

Configure the container or node that will be using metricbeats to collect metrics from Ceph via the
Prometheus plugin for the Ceph Mgr service by providing the list of Ceph Mgr node IPs for the **br-mgmt**
network. In the example below we are using the elastic-logstash containers to collect metrics from
Ceph. The below config goes in `/etc/openstack_deploy/conf.d/elk.yml`.

```
elastic-logstash_hosts:
logging01:
ip: 172.20.52.16
container_vars:
prometheus_enabled: true
prometheus_config:
- hosts:
- "172.20.52.41:9283"
- "172.20.52.42:9283"
- "172.20.52.43:9283"
namespace: ceph
```


### Install Metricbeats

When you install metricbeat limit it the ceph nodes you want to deploy to. In the above config we used
`ceph_ext_all` as the ceph node group. If your inventory differs be sure to update the group name.
Similiarly if you choose to collect metrics from Ceph using a different group than `elastic-logstash_hosts`
replace that here as well.

```
# cd /opt/openstack-ansible-ops/elk_metrics_6x/
# openstack-ansible installMetricbeat.yml --limit elastic-logstash_hosts,ceph_ext_all --skip-tags setup
```

0 comments on commit 630bf6b

Please sign in to comment.