Questions tagged [concurrency-limits]

3 questions
11
votes
1 answer

gunicorn uvicorn worker.py how to honor limit_concurrency setting

FastAPI uses gunicorn to launch uvicorn workers as described in https://www.uvicorn.org/settings/ However gunicorn does not allow to launch uvicorn with custom settings as also mentiond in https://github.com/encode/uvicorn/issues/343 The issue…
user670186
  • 2,588
  • 6
  • 37
  • 55
4
votes
1 answer

How to Limit concurrency in a webapp when GC pauses last more than the average response time?

I'm trying to implement a concurrency limiter in a web application where the average response time is 5 ms. I've based my implementation on "Performance Under Load", forking the project concurrency-limits and using the concepts explained in the…
0
votes
1 answer

Using rxjs 6 how can I create a cancellable web request pipeline with a cache, and which limits the number of requests happening at the same time

I hope someone is able to point me in the right direction, because I am struggling with combining concurrency and the ability to cancel queued requests in rxjs. I am going to try and explain this in sequential events. Say we have observable A, which…
eXigiouS
  • 21
  • 4