Questions tagged [rate-limiting]

Rate limiting is used to control the rate of traffic sent or received on a network interface.

Traffic that is less than or equal to the specified rate is sent, whereas traffic that exceeds the rate is dropped or delayed. Rate limiting is performed by policing (discarding excess packets), queuing (delaying packets in transit) or congestion control (manipulating the protocol’s congestion mechanism). Policing and queuing can be applied to any network protocol. Congestion control can only be applied to protocols with congestion control mechanisms, such as the transmission control protocol (TCP).

1053 questions
0
votes
0 answers

Turn rate limit (throttle) down for a specific origin in Laravel 5.4

I have a Laravel-made API running in a server and an Angular application running in another server. My Angular app loads a huge JSON file (with more than 500 lines) and tries to insert each line in a database through the api. A request is sent for…
user3010474
  • 23
  • 1
  • 5
0
votes
1 answer

API Rate Limits for IBM Cloudant

For using the IBM Cloudant database through Bluemix Service, REST APIs are available. The documentation does not mention anything about Rate limits on API usage. Are there any such limits, what error does the API throw if the limit is exceeded?
ShwetaJ
  • 462
  • 1
  • 8
  • 32
0
votes
1 answer

Error: connect ETIMEDOUT when scraping

I have a function that: 1. gets an array of 3000 'id' properties from mongoDB documents from collection foo. 2. Creates a GET request for each ID to get 'resp' obj for id, and stores it in another database. router.get('/', (req, res) => { var…
Moshe
  • 2,583
  • 4
  • 27
  • 70
0
votes
0 answers

Spring RateLimiter for GET/POST requests

I found Guava RateLimiter for implementing limitation for GET/Post requests. I called the class in controller and called the object for some get classes. But nothing happens. I can still request get methods multiple times in a…
Eniss
  • 975
  • 2
  • 20
  • 40
0
votes
1 answer

Python Tornado rate limiting AsyncHttpClient fetch

Currently using an API that rate limits me to 3000 requests per 10 seconds. I have 10,000 urls that are fetched using Tornado due to it's asynchronous IO nature. How do I go about implementing a rate limit to reflect the API limit? from tornado…
user3808357
  • 241
  • 1
  • 4
  • 13
0
votes
1 answer

Avoiding twitter's rate limiting

When I do the following : library(twitteR) library("ROAuth") consumer_key <- '' consumer_secret <- '' access_token <- '' access_token_secret <- '' setup_twitter_oauth(consumer_key, consumer_secret, access_token, access_token_secret) potus_user <-…
François M.
  • 4,027
  • 11
  • 30
  • 81
0
votes
1 answer

IP Throttling in ASP.Net

I have an ASP.Net site (uses Web API 2, though that shouldn't matter) hosted in an Azure App Service. I want to implement IP throttling to prevent too many requests coming from a single IP address (sufficiently high to allow for…
Saqib
  • 7,242
  • 7
  • 41
  • 55
0
votes
1 answer

Skyscanner API: Cannot create session via Flights Live Pricing

I'm exactly following this API guide via curl but yet keep getting this messages: {"ValidationErrors":[{"Message":"Rate limit has been exceeded: 0 PerMinute for PricingSession"}]} I'm new there and i'm sure i have never pulled before. Therefore,…
夏期劇場
  • 17,821
  • 44
  • 135
  • 217
0
votes
1 answer

Instagram-API ::: cURL error 18: transfer closed with 3789 bytes remaining to read

I get this error in the middle of data mining from instagram (basically ~8000 images and comments were retrieved correctly and suddenly I receive the following error): cURL error 18: transfer closed with 3789 bytes remaining to read (see…
Mona Jalal
  • 34,860
  • 64
  • 239
  • 408
0
votes
1 answer

Rate limiting pattern for implementing API throttling for a cloud service

I wanted to implement throttling for a set of services provided. Under peak load,I want to limit or deny services to long running users or users sending huge data or other rules that can be configured even at a later stage. I plan to use java and…
arvin_v_s
  • 1,036
  • 1
  • 12
  • 18
0
votes
2 answers

How to implement limited API calls in a multithread environment?

I have a lot of requests to send to a server (Amazon Product Advertising API), however this server doesn't allow me to send more than 1 request each second. I am looking for a free solution, based on C# abilities. I tried to code it like…
Lawi
  • 11
  • 1
0
votes
1 answer

Why does this code result in a NPE while sleeping to avoid rate limit in Twitter4J?

I am using Twitter4j to fetch the followers of a given user. At some point I always hit the rate limit. I am happy for the program to sleep for 15 minutes to over come this. However when it wakes, I get an error. See the following code: protected…
calmcalmuncle
  • 143
  • 1
  • 2
  • 16
0
votes
2 answers

Node Express wrap a POST request with a counter and throw error after x

I am working on a Node Express/Angular Civic project that is integrated with a 3rd party API. Each call costs me $1.00. I am funding a certain portion of it but then I would like the POST request to the 3rd party to stop. The reason is I don't want…
Mihir Patel
  • 2,202
  • 3
  • 23
  • 36
0
votes
1 answer

HAproxy ACL . Block all connection to Haproxy By default and allow only Specific IP

I am trying to solving a scenario now using haproxy. The scenario as below Block all IP by default Allow only connection from a specific IP address If any connections come from a whilelist IP, if should reject if it exceed more than 10 concurrent…
devops
  • 173
  • 4
  • 16
0
votes
1 answer

Haproxy Sticky-Table not updating

i am trying to do http rate limiting using haproxy using sticky-table. But when i try to view sticky-table i am not able to see it My configuraiton here as follows global log 127.0.0.1 local1 notice daemon stats socket…
devops
  • 173
  • 4
  • 16