High CPU usage

[vkolomiets]

Hello.
Maybe someone faced the problem of high CPU load? I observe a situation when, upon reaching a certain value of the load of requests per second, wave-like loads on the CPU occur up to 100 percent, and at this time the performance of the web server decreases. When I reinstall nginx without a module, everything works stably and the server holds many more requests.
Perhaps someone has experience with a similar situation and have tips on optimizing or avoiding this behavior?

[aminvakil]

I don't see this on latest tag (https://github.com/vozlt/nginx-module-vts/releases/tag/v0.1.18).

[vkolomiets]

@aminvakil HI. I am using the latest version. How many requests per second do you have on nginx and what server hardware are you using? In my case it is 80k/s with 2 processors (Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20 GHz).
), 32 GB of RAM leads to high CPU usage. Without the module, it's 150k+/s and I see a performance margin.

[aminvakil]

I'm using it in different situations, different loads, different RPS, etc.
But on some servers, we have 1000-2000 requests per second and everything is very smooth.
It's Xeon 2620 v2 and 64GB Memory.

[testn]

Can you try to pprof it?

[dwMiguelM]

Hey folks,

Giving more attention to this issue, due to the exact same fact, but let me show you in real-environment.

This test was made by generating 500kr/s (500.000 connections per second), the connections were generated using 15k unique IPs.
Currently, the VTS configuration has 17 filter keys.
Be aware, those filter keys catch everything that happens in the web server, they are heavily updated.

Heavy load without VTS: https://prnt.sc/_M-8xNbPPTk1
Heavy load with VTS: https://prnt.sc/PEQYLxSi5vE6

The VTS configurations/keys and further detailed information about this performance impact caused by the VTS can be provided to a VTS contributor/developer in a private conversation.

I hope we can work together to optimize this :)

Best Regards!

[testn]

It's quite difficult to fix it if you cannot provide pprof result so that we can pinpoint the location of the problem.

[dwMiguelM]

Can we get some kind of Real-Time chatting? Such as Telegram or Discord? So together we can go more dig into this issue? Thank you in advance!