19

I'm trying to stress test my Spring Boot application, but when I run the following command, what ab is doing is that trying to give out a result the the maximum my application could holds. But what I need is to check whether my application could hold at a specific request per second. 

ab -p req.json -T application/json -k -c 1000 -n 500000 http://myapp.com/customerTrack/v1/send

The request per second given from above command is 4000, but actually, a lot of records are buffered in my application which means it can't hold that much rps. Could anyone tell me how to set a specific request per second in ab tools? Thanks!

Machavity
  • 30,841
  • 27
  • 92
  • 100
KAs
  • 1,818
  • 4
  • 19
  • 37

2 Answers2

14

I don't think you can get what you want from ab. There are a lot of other tools out there.

Here's a simple one that might do exactly what you want.

https://github.com/rakyll/hey

For rate limiting to 100 requests per second the below command should work.

hey -D req.json -T application/json -c 1000 -q 100 -n 500000 http://myapp.com/customerTrack/v1/send

Jazzepi
  • 5,259
  • 11
  • 55
  • 81
  • From the docs: "-q Rate limit, in queries per second (QPS) **per worker**", "-c Number of workers to run concurrently". So the command in this answer runs 1000 workers with 100 QPS per each worker, that is total 100000 RPS. I doubt it's what most people want. :) Probably the best strategy is to set Concurrency level to desired RPS and Rate limit to 1 request per second per worker. E.g. for 500 RPS `-c 500 -q 1`. – Ruslan Stelmachenko Feb 12 '23 at 17:50
3

Apache Bench is single threaded program that can only take advantage of one processor on your client’s machine. In extreme conditions, the tool could misrepresent results if the parameters of your test exceed the capabilities of the environment the tool is running in. Accorading to your description, the rps has already reach your hardware limitation.

A lot of records are buffered in my application which means it can't hold that much rps

It is very hard to control request per second in single machine. You can find better performacne testing tools from here HTTP(S) Benchmark Tools

If you have budget you can try goad, which is an AWS Lambda powered, highly distributed, load testing tool built in Go for the 2016 Gopher Gala. Goad allows you to load test your websites from all over the world whilst costing you the tiniest fractions of a penny by using AWS Lambda in multiple regions simultaneously.

howie
  • 2,587
  • 3
  • 27
  • 43