Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [rate-limiting]

In computer networks, rate limiting is used to control the rate of traffic sent or received on a network interface.

Traffic that is less than or equal to the specified rate is sent, whereas traffic that exceeds the rate is dropped or delayed. Rate limiting is performed by policing (discarding excess packets), queuing (delaying packets in transit) or congestion control (manipulating the protocol’s congestion mechanism). Policing and queuing can be applied to any network protocol. Congestion control can only be applied to protocols with congestion control mechanisms, such as the transmission control protocol (TCP).

244 questions
1
vote
1 answer

Can we prioritize devices connected to a Router

If a number of devices are connected to a router, can we prioritize them (PC - 1, Mobile - 2, Laptops - 3) by giving their MAC addresses. That way if everybody is working, depending upon their priority, overall speed is divided and priority 1 will…
user311673
  • 13
  • 3
1
vote
2 answers

How to workaround a IP whitelist when consuming a 3rd-party API?

We use a service who's API will reject requests unless the source IP has been previously whitelisted. They only give us 3 slots which is a problem because we have more than 3 machines that need to use the API. What is the most common technique to…
Tom
  • 4,277
  • 11
  • 42
  • 52
1
vote
2 answers

Rate limit misconfigured bots

We have an Nginx / PHP-FPM behind a load balancer which periodically gets scraped. Many of the scrapers hit our application's 404 page quiet hard. Is there a way in Nginx, possibly with the rate-limiting module or a different module, to block all…
rrehbein
  • 488
  • 4
  • 9
1
vote
0 answers

Rate limiting bots (specific IPs) in NGINX

I would like to rate-limit (but not block) various crawlers. Based on other examples of similar questions, I've come up with this: http { ## 10MB zone, 5 reqs per sec limit_req_zone $limit zone=zone_a:10m rate=5r/s; geo $limited { …
Steve Harris
  • 11
  • 2
1
vote
1 answer

Limit max bandwidth per IP

I have some partners, that uses one of my linux servers as a gateway. The problem is I need to limit bandwidth per client ip address on this gateway. My partners client ip ranges are not known to me. I have been looking at Traffic Control and…
lkmikkel
  • 11
  • 1
1
vote
1 answer

apache rate limit best practice

I have the following business scenario: apache http server load balances client request to application servers via ajp all the resource intensive work is done on application servers for each request requests are application user based, however…
user12145
  • 1,115
  • 6
  • 28
  • 47
1
vote
1 answer

Relax ssh rate-limit rules for certain ip addresses

We've written some tools to automate common development tasks. One tool, for example, ensures all our git repositories are up-to-date. For this to work, our tool needs to connect to our git server and fetch the latest for each repository. We have…
Dane O'Connor
  • 1,269
  • 2
  • 15
  • 20
1
vote
1 answer

Debian exim4 rate limits

I try to limit on exim4 the outgoing mails per day per domain, i found this: acl_check_ratelimit: accept authenticated = * endpass ratelimit = 40 / 1d / per_rcpt / leaky / ${lc:${local_part:$authenticated_id}} …
Neotor
  • 11
  • 2
1
vote
2 answers

How to prevent nginx throttling conflicting with maintenance mode?

We use the HttpLimitReqModule nginx mondule for rate throttling and have found that it conflicts with our "maintenance mode" because both components are using http status code 503. When throttling is activated (via the limit_req directive), nginx…
Tom
  • 4,277
  • 11
  • 42
  • 52
1
vote
1 answer

lighttpd rate limits per directory

I'm creating a site with a large number of small tools. One is a tool which uses a Python cgi-script that interacts with the Natural Language Toolkit (nltk), which is disk and CPU intensive. I have other services that are less intensive. On the…
Brigand
  • 135
  • 5
1
vote
1 answer

Rate Limit Xen DomU Network Traffic

Is there a solid way to rate limit Xen DomU Network I/O Traffic? I found an answer on here using tc but I get this error: Object "qdisk" is unknown, try "tc help". I guess a solution to either of these problems would be excellent.
Der Kommissar
  • 1,153
  • 7
  • 9
1
vote
1 answer

Will traffic control software cause tcp packets to be dropped

I am testing our client-server applications using NetLimiter which is a traffic control software. I found that, when client is receiving files from server and I use NetLimiter to set the download rate to a value such as 50K/S by clicking buttons…
Steve Peng
  • 559
  • 1
  • 8
  • 18
1
vote
2 answers

How to rate limit per MAC address?

I need to rate limit an API server. Is it possible to configure a machine to rate limit requests per MAC address? If not, are there any other viable options? I want to rate limit per MAC, because multiple users could share one IP.
user22711
1
vote
1 answer

ICMP rate-limit on time-exceeded messages

How can I set ICMP rate-limiting in a Cisco router? Here on the manual page they only talk about ICMP unreachable messages: ip icmp rate-limit unreachable [df] [ms] [log [packets] [interval-ms]] Is there anything that also includes other ICMP…
Ricky Robinson
  • 215
  • 1
  • 5
  • 20
1
vote
3 answers

Throttling network speed when copying files to SMB mounted NAS drive

I have a fairly modest Ubuntu box (Jaunty) running as a small webserver. Each night i have a cron job which tar/gzip's important directories and does a simple cp to copy them over to a backup NAS drive which has been SMB mounted locally (effectively…
None
1 2 3
…
16 17