You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I found in the db and fortune test that the number of client connections is not enough to measure the highest performance of some frameworks (especially the frameworks at the top of the list). I downloaded the latest results of tfb and plotted a chart for each of the above tests. as follows:
Obviously, as long as the concurrency of the test is increased, we can get higher performance of some frameworks(Those frameworks whose qps curve is still rising rapidly). so my suggustion is add new tests for `db` and `fortune` with 1024 and 2048 connections.
The text was updated successfully, but these errors were encountered:
A lot of frameworks drop about 128 or less concurrent connections, so a lot of hours wasted.
but ...
A benchmark need to measure performance and scalabilty
The good solution will be to have a graph to see the data table, in all tests.
But that need more work.
Another fast implementation, will be to add a ⬆️ and 🔽 .
#reqs ⬆️ to indicate that still scale
#reqs 🔽 to indicate that didn't scale to 512 concurrent connections
a lot of frameworks are faster with 128 or 256 concurrent and slower with 512.
But still show faster than others fws scaling better with 512 in the benchmark.
The benchmark only show the faster, when others frameworks scale better and are faster with 512 or more concurrent connections.
A simple change in the fortunes or db, showing only the req/s at 512 concurrency, like do with multiple query and updates, the ranking will change completely .
Perhaps will be good to have this option, show only faster and faster at 512 concurrency. Or show both.
I found in the
db
andfortune
test that the number of client connections is not enough to measure the highest performance of some frameworks (especially the frameworks at the top of the list). I downloaded the latest results of tfb and plotted a chart for each of the above tests. as follows:Obviously, as long as the concurrency of the test is increased, we can get higher performance of some frameworks(Those frameworks whose qps curve is still rising rapidly). so my suggustion is add new tests for `db` and `fortune` with 1024 and 2048 connections.
The text was updated successfully, but these errors were encountered: