Questions tagged [rate-limiting]

Rate limiting is used to control the rate of traffic sent or received on a network interface.

Traffic that is less than or equal to the specified rate is sent, whereas traffic that exceeds the rate is dropped or delayed. Rate limiting is performed by policing (discarding excess packets), queuing (delaying packets in transit) or congestion control (manipulating the protocol’s congestion mechanism). Policing and queuing can be applied to any network protocol. Congestion control can only be applied to protocols with congestion control mechanisms, such as the transmission control protocol (TCP).

1053 questions
0
votes
0 answers

Set the blocking queue size in RateLimiter

Is there a way to limit or set the blocking queue size in Google Guava RateLimiter?
Ann Mathews
  • 56
  • 1
  • 8
0
votes
1 answer

Why could Twitter Streaming API limitation track number go up and down?

I'm trying to track how many tweets are sent in real time for some topic. Therefor I am satisfied with counting incoming tweets and adding the value of limit messages to my counter. But despite descriptions in the official API I get numbers of…
0
votes
1 answer

Rate Limit Prevention [Twitter4J]

I am currently implementing a program which requires me to use Twitter4J to collect tweets and store them. However, I do realise that you can only make 180 requests every 15 minutes with Twitter's Developer API. Due to this, I have created a…
John Lewis
  • 139
  • 1
  • 2
  • 15
0
votes
1 answer

knockoutjs global rate-limit

Is there any way how to globally delay any KnockoutJS processing / redrawing as long as I keep changing any observable in the model? Basically, knockout should observe all changes to all observables and if there is no change to any observable for a…
Oldrich Svec
  • 4,191
  • 2
  • 28
  • 54
0
votes
1 answer

Avoiding rate limit error using tweepy

I am trying to get some basic information on all the twitter friends that a particular user is following. I am using a for loop to get this information but if the user has many friends I get a rate limit error. I am trying and struggling to…
Noele
  • 1
  • 2
0
votes
1 answer

how to wait on twitter rate limit

I am trying to write an R program using the package twitteR, but I keep running into the rate limit. I hacked this together to try to sleep until the rate limit was finished. The count<10 was intended to keep the program moving if there were no…
Rilcon42
  • 9,584
  • 18
  • 83
  • 167
0
votes
4 answers

c# Rate Limiting foreach iterations

Basically I'm trying to be able to rate limit the execution of iterations of a list. I really like the idea of using RX as I can build off the top of it, and have a more elegant solution, but it wouldn't have to be done using RX. I've formulated…
Ronnyek
  • 482
  • 5
  • 16
0
votes
1 answer

How can I drop packets using RateLimiter?

I'm trying to use RateLimiter to drop packets at a specific limit per second. final RateLimiter rateLimiter = RateLimiter.create(5000.0); // rate = 5000 permits per second void submitPacket(byte[] packet) { rateLimiter.acquire(packet.length); …
Grammin
  • 11,808
  • 22
  • 80
  • 138
0
votes
2 answers

Opening eventsources while keeping under the rate limit with Nodejs

my api only allows a maximum of 10 requests every second. I am trying to keep under this rate limit with async library. I have tried multiple functions but none of them work. Pauseconnect and connectStream opens an eventstream for each item. let me…
Username
  • 1,950
  • 2
  • 12
  • 21
0
votes
2 answers

Does AWS S3 offer any kind of rate limiting or protection against abuse for publicly accessible files?

I have a web app which serves media files (in other words pretty large) with public access. The files are hosted on S3. I'm wondering if AWS offers any kind of abuse-protection, for example detection or prevention against download hogs via some…
Howiecamp
  • 2,981
  • 6
  • 38
  • 59
0
votes
1 answer

Multiple API connections through Nodejs

I want to connect to theMovieDb api, and fetch a large number of movies. The api limit is 40 calls every 10 seconds and 20 connections per IP. How do I do this in node.js? Right now I have one http request to the api at a time, but anything more…
shiv
  • 383
  • 1
  • 4
  • 17
0
votes
0 answers

Using Celery with Django to access a rate limited RESTful API

Just wondering whether my idea is unnecessarily complicated and if there is an easier/better way. I'm planning on using Celery to send requests and retrieve data from a rate limited RESTful API (10 requests per 10 seconds). This was the solution to…
Nami
  • 1
  • 1
0
votes
1 answer

What is the Reset time for rate limt on Twitter

My appllication uses twitter api to post DM. I want to keep a track of the DM's so that i don't exceed the rate limit(1000 DM per-user/per-app). I want to know what time does the twitter resets the count for rate limit so that I can sync it with my…
0
votes
1 answer

How can I use sleep for cursor method to avoid rate limiting?

I'm trying to get all of a user's follower ids (75K+) without hitting the rate limit. I figured you can put a sleep method on the cursor to prevent over 15 calls per 15 minutes. Any idea how to do that? Thanks in advance. :)
marriedjane875
  • 653
  • 2
  • 10
  • 24
0
votes
1 answer

Caching information from API queries - Limited to 10 per 10s

relatively new to databases here (and dba). I've been recently looking into Riot Games' APIs, however now realising that you're limited to 10 calls per 10 seconds, I need to change my front-end code that was originally just loading all the…
Olly
  • 360
  • 3
  • 20