Questions tagged [exponential-backoff]
76 questions
2
votes
0 answers
WebFlux backoff and multi-threading in a kafka consumer flow
I have a Kafka consumer written in Java and SpringBoot.
I am using WebFlux in order to make a call to trigger some actions on a third party server (and waiting the result of course).
This server has rate limit that is limiting me from making a lot…
Tom Carmi
- 385
- 1
- 5
- 18
2
votes
0 answers
Exponential Backoff policy for spark on azure storage
I have spark jobs on k8s which are reading and writing parquet files from azure storage (blobs). I recently understood that there are environment limits on Azure for the number of transactions/sec and my pipelines is exceeding those limits.
This is…
kitz
- 63
- 4
2
votes
2 answers
Polly RetryForever isn't retrying
I'm, trying to check a simple RetryForever of Polly
class Program
{
public static void Main()
{
int i = 0;
var _retryPolicy = Policy
.Handle()
.RetryForever();
…
K.W
- 123
- 7
2
votes
2 answers
How to Resolve a 403 error: User rate limit exceeded in Google Drive API?
I am getting
"code": 403,
"message": "User Rate Limit Exceeded"
while using Google Drive API in my web app
Although the quota is 10,000 requests per 100 seconds and my average is less than 2:
How can I resolve this error? How to implement…
zamp
- 41
- 1
- 1
- 6
2
votes
0 answers
Dynamically generated schedule interval?
I create a DAG to do monitoring of other applications, when the DAG does not fulfill the monitoring task, it sends an alert email. My DAG has a ten minutes interval scheduler, that is, if the task fails, it sends emails every ten minutes, but what I…
John_B
- 41
- 8
2
votes
1 answer
Twilio API & Exponential Backoff when sending bulk SMS with Node.js
I am working on a bulk SMS application that will send one message to a group of people in case of an emergency. I have reviewed the Twilio Docs and implemented their code, at which point I was getting a 429 error from the API. So I've added the…
Alex
- 23
- 2
2
votes
1 answer
Built in exponential backoff for python api client?
I noticed that in http.py a lot of the methods support num_retries which I believe is an implementation of exponential backoff (in case an API returns an error). Would like to use this rather than coding my own backoff algorithm each time I call an…
Michael
- 1,428
- 3
- 15
- 34
2
votes
1 answer
Backoff Strategy after hitting rate limits
When you hit the rate limits on getstream, the APIs start responding with errors.
What is the recommended approach as a backoff strategy to handle those failures and start recovery after that. I thought about logging them all and send all of them…
Shaharyar
- 12,254
- 4
- 46
- 66
2
votes
1 answer
In Python, is it possible to use 'exponential backoff' per request for batched HTTP requests?
So, here I have written a script that adds students to the courses (Google Classroom API).
students = getStudents('Year10', '10A') # VAR
for student in students:
newStudent = {
# Student Identifier
'userId': student
}
…
Rowan Richards
- 401
- 8
- 20
2
votes
1 answer
FCM: Retry-after and exponential backoff
As I understand, when a message fails to be delivered, the Retry-After header is sometimes included in the response and sometimes not. But what happens if I first receives an error response with Retry-After included, resends the message and receives…
greenPostIt
- 63
- 2
- 6
1
vote
1 answer
Polly DecorrelatedJitterBackoffV2 - how calculate max time required to complete all retries?
We have a listener that receives a message from a Service Bus queue and then sends the body to an API.
We use Polly for resilience in the cloud, namely the DecorrelatedJitterBackoffV2 policy.
Our concern with this policy is that we are unsure of how…
Alasdair Stark
- 1,227
- 11
- 32
1
vote
1 answer
Internal error from Google Pub/Sub when trying to update
I keep getting the following error when trying to update a Pub/Sub subscription's retry policy:
rpc error: code = Internal desc = A service error has occurred. Please retry your request. If the error persists, please report it. [code=e8c0]
Given the…
jmmurillo
- 173
- 6
1
vote
0 answers
How do I retry an aws neptune gremlin ConcurrentModificationException error without having to rebuild the query?
I build up a batch query in variable "gBatchWrite". I try to keep it around 200 operation per Amazon suggestions. Any retries after a "ConcurrentModificationException" fail. It seems that I would have to rebuild the gBatchWrite variable from scratch…
Louis Rebolloso
- 15
- 5
1
vote
0 answers
Unit test for exponential backoff in Golang
I'm currently writing a function that would retry with exponential backoff up to 5 times. How do I write the unit test for testing the wait time is correct or not? Here's my function:
func (OdinClient) GetPrivateKeySigner(materialSet string)…
Charmander
- 109
- 14
1
vote
0 answers
Delayed Restart is not working while using BackoffSupervisor in Akka Classic Actors (Scala)
I'm trying to use BackoffSupervisor to delay the restart. I've given 10.sec as minimum backoff but on Exception it is restarting the actor immediately.
Here is code:
`object Task2Implementation extends App {
val system = ActorSystem("system")
…
Zaryab Ali
- 19
- 3