Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fd_limit in the check_arakoon_fd healthcheck #442

Closed
matthiasdeblock opened this issue Mar 14, 2018 · 3 comments
Closed

fd_limit in the check_arakoon_fd healthcheck #442

matthiasdeblock opened this issue Mar 14, 2018 · 3 comments
Assignees
Milestone

Comments

@matthiasdeblock
Copy link
Contributor

On the Nuvolat and GIG environments we receive a lot of warning messages regarding the filedescriptors for the arakoon clusters:

[WARNING] Number of TCP connections exceeded the 95% warning threshold for Arakoon cluster cachebackend03-nsm_06 on node 10.210.3.61, (155/30)

I've noticed that the limit was set to 30. Is there any reason why the limit was set to 30?

https://github.com/openvstorage/openvstorage-health-check/blob/e4854917c2f00792316bb39f3383843deda829be/ovs/extensions/healthcheck/arakoon_hc.py#L471

For example, if you have 2 proxies per node in a cluster of 4 volumedrivernodes that are pointing to that arakoon cluster, you already have a possible connection size of 80 as all the proxies have a max connection pool size of 10.

@wimpers
Copy link

wimpers commented Apr 23, 2018

Maybe something we can pickup with #422

@JeffreyDevloo
Copy link
Contributor

Fixed by #447
Packaged in: openvstorage-health-check_3.7.0-dev.1525250711.8ba3b6b-1_amd64.deb

Usage:

Usage: healthcheck_cli.py arakoon file-descriptors-test [OPTIONS]

  Verify the number of File Descriptors on every Arakoon does not exceed the
  limit

Options:
  --fd-limit INTEGER  Threshold for the number number of tcp connections for
                      which to start logging warnings
  --help              Show this message and exit.
root@jef-node01:~# 

@JeffreyDevloo JeffreyDevloo self-assigned this May 2, 2018
@wimpers wimpers added this to the M milestone May 2, 2018
@JeffreyDevloo
Copy link
Contributor

Released in https://github.com/openvstorage/openvstorage-health-check/releases/tag/3.7.0
Packaged in openvstorage-health-check_3.7.0-1_amd64.deb

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants