When running the Lustre filesystem not as a scratch file system,
at some point it can happen that new files are not created on a combination of MDT+OST.
This use case is intended to check all possible combinations of file creations between MDTs and OSTs.
Furthermore Cyclone also supports transfering those metrics to the Prometheus monitoring system.
To accomplish this the worker processes send the check results to an Prometheus Pushgateway client within Cyclone.
That Pushgateway client collects those metrics and will push them bulk-wise into a Prometheus Pushgateway.
The following screenshot shows a dashboard in Grafana:
Example config file for the task generator
| Name | Type | Value | Description |
|---|---|---|---|
| local_mode | String | yes/no, on/off, true/false and 1/0 | Specifies if local or productive mode is enabled |
| measure_interval | Int | n>=0 | Specifies the task creation time in seconds |
| Name | Type | Value | Description |
|---|---|---|---|
| task_file | String | Path | Path to task config file |
| task_name | String | Name | Name of task to load |
| Name | Type | Value | Description |
|---|---|---|---|
| lfs_bin | String | Path | Path to Lustre lfs binary |
| target | String | Name | Target name of Lustre filessytem |
| ost_select_list | RangeSet | 0>=n | List of decimal OST indexes comma separated and ranges defined with hyphen. Leave empty for all available OSTs. |
Example config file for the task
| Name | Type | Value | Description |
|---|---|---|---|
| ost_idx | Int | - | Placeholder, filled during runtime |
| lfs_target | String | Name | Lustre filesystem name |
| target_base_dir | String | Path | Path to base directory for testing on Lustre |
| target_mdt_sub_dir | String | Name | Sub directory name for each MDT to test |
| mdt_index_rangeset | RangeSet | n>=0 | List of decimal MDT indexes comma separated and ranges defined with hyphen. |
| pushgateway_client_name | String | Host | Specifies hostname/IP of the Pushgateway client |
| pushgateway_client_port | Int | Port | Specifies the port number of the Pushgateway client |
| pushgateway_client_timeout | Int | n>0 | Specifies the timeout in seconds for connecting to the Pushgateway client |
Example config file for the Pushgateway Client
| Name | Type | Value | Description |
|---|
[control] pid_file = ./Runtime/pushgateway-client.pid
[push] interval = 60 url = http://localhost:9091/metrics/job/cyclone timeout = 15
[comm] target = * port = 5888 poll_timeout = 2
[log] filename = ./Runtime/pushgateway-client.log