-
Notifications
You must be signed in to change notification settings - Fork 14
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
CEPHSTORA-498 Add doc for elk6x integration
Add doc on how to collect metrics from ceph nodes and clusters using elk_6x.
- Loading branch information
Showing
1 changed file
with
92 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,92 @@ | ||
# Integrating rpc-ceph with elk_metrics_6x | ||
|
||
You can collect metrics from Ceph nodes using [elk_metrics_6x](https://github.com/openstack/openstack-ansible-ops/tree/master/elk_metrics_6x) via metricbeat. | ||
Metricbeat will be used to collect host metrics from the Ceph nodes and the prometheus plugin for metricbeat | ||
will be used to collect Ceph metrics from the Prometheus plugin for the Ceph Mgr service. | ||
|
||
|
||
## Install Metricbeats on Ceph Nodes | ||
|
||
### Add Ceph Nodes to OSA Inventory | ||
|
||
If you do not already have a inventory group setup to manage your Ceph cluster you will need to create one. | ||
|
||
``` | ||
# cat <<EOF > /etc/openstack_deploy/env.d/ceph.yml | ||
--- | ||
component_skel: | ||
ceph-ext: | ||
belongs_to: | ||
- ceph_ext_all | ||
container_skel: | ||
ceph-ext_container: | ||
belongs_to: | ||
- ceph-ext_containers | ||
contains: | ||
- ceph-ext | ||
properties: | ||
is_metal: true | ||
physical_skel: | ||
ceph-ext_containers: | ||
belongs_to: | ||
- all_containers | ||
ceph-ext_hosts: | ||
belongs_to: | ||
- hosts | ||
EOF | ||
``` | ||
|
||
``` | ||
# cat <<EOF > /etc/openstack_deploy/conf.d/ceph.yml | ||
ceph-ext_hosts: | ||
ceph-perf-stor-1: | ||
ip: 172.20.58.41 | ||
ceph-perf-stor-2: | ||
ip: 172.20.58.42 | ||
ceph-perf-stor-3: | ||
ip: 172.20.58.43 | ||
ceph-perf-stor-4: | ||
ip: 172.20.58.44 | ||
ceph-perf-stor-5: | ||
ip: 172.20.58.45 | ||
ceph-perf-stor-6: | ||
ip: 172.20.58.46 | ||
EOF | ||
``` | ||
|
||
### Configure Metricbeat Prometheus Module | ||
|
||
Configure the container or node that will be using metricbeats to collect metrics from Ceph via the | ||
Prometheus plugin for the Ceph Mgr service by providing the list of Ceph Mgr node IPs for the **br-mgmt** | ||
network. In the example below we are using the elastic-logstash containers to collect metrics from | ||
Ceph. The below config goes in `/etc/openstack_deploy/conf.d/elk.yml`. | ||
|
||
``` | ||
elastic-logstash_hosts: | ||
logging01: | ||
ip: 172.20.52.16 | ||
container_vars: | ||
prometheus_enabled: true | ||
prometheus_config: | ||
- hosts: | ||
- "172.20.52.41:9283" | ||
- "172.20.52.42:9283" | ||
- "172.20.52.43:9283" | ||
namespace: ceph | ||
``` | ||
|
||
|
||
### Install Metricbeats | ||
|
||
When you install metricbeat limit it the ceph nodes you want to deploy to. In the above config we used | ||
`ceph_ext_all` as the ceph node group. If your inventory differs be sure to update the group name. | ||
Similiarly if you choose to collect metrics from Ceph using a different group than `elastic-logstash_hosts` | ||
replace that here as well. | ||
|
||
``` | ||
# cd /opt/openstack-ansible-ops/elk_metrics_6x/ | ||
# openstack-ansible installMetricbeat.yml --limit elastic-logstash_hosts,ceph_ext_all --skip-tags setup | ||
``` | ||
|