Stack Overflow
Stack Overflow

Questions tagged [backpressure]

Backpressure refers to the build-up of data at an I/O switch when buffers are full and not able to receive additional data. No additional data packets are transferred until the bottleneck of data has been eliminated or the buffer has been emptied.

Backpressure refers to the build-up of data at an I/O switch when buffers are full and not able to receive additional data. No additional data packets are transferred until the bottleneck of data has been eliminated or the buffer has been emptied.

Source - Techopedia

164 questions
1
vote
1 answer

Why do I get a MissingBackpreasureException while using a backpreasurebuffer?

I want to implement a processing queue in RxJava which downloads some files. The number of files I want to download may be up to around 100. Everything is developed on Android using RxJava 1.1.1 My current implementation looks something like…
Peter Ludvigsen
  • 320
  • 3
  • 12
1
vote
0 answers

How to handle error in generateState in SyncOnSubscribe RxJava?

I am trying to get the hang of creating a SyncOnSubscribe and not quite sure what to do if the generateState method fails during initialization of the state. return Observable.create(new SyncOnSubscribe() { @Override …
Danny G
  • 581
  • 4
  • 16
1
vote
2 answers

RxJava: Drop items? - Backpressure

I use RxJava to observe clicks on several buttons. These subscription will invoke different functions on an object which takes several milliseconds. These functions are synchronized. The problem is that when too many buttons are pressed I get a…
Paul Woitaschek
  • 6,717
  • 5
  • 33
  • 52
1
vote
1 answer

Akka HTTP back-pressured connections

The documentation says that on Http().bindAndHandle() : there is no backpressure being applied to the connections Source, i.e. all connections are being accepted at maximum rate, which, depending on the applications, might present a DoS…
Hunor Kovács
  • 1,062
  • 9
  • 16
1
vote
2 answers

How can I "force" some kind of backpressure to avoid multiple executions in rxjava?

I have a piece of code who's work is to update a local cache. There are two triggers to this cache update: At a fixed interval When requested So here's a basic example on how I did this. forceReloadEvents = new SerializedSubject
Crystark
  • 3,693
  • 5
  • 40
  • 61
1
vote
2 answers

Incorrect Stopping Application After Back Pressing

Logs after back button pressed: 11-07 22:48:08.376: D/AndroidRuntime(5325): Shutting down VM 11-07 22:48:08.376: W/dalvikvm(5325): threadid=1: thread exiting with uncaught exception (group=0x4162d700) 11-07 22:48:08.384: E/AndroidRuntime(5325):…
Alex Ironz
  • 13
  • 7
0
votes
1 answer

How to strip objects inside an array in Spring Webflux in order to get each object through an event

What I want to achieve is to stream the objects under the JSON property "ranges" through flux events in order to apply a backpreasure mechanism. I have a Json string which looks like this: { "name": "the name", "id": "34343", "ranges":…
Horseman
  • 3
  • 3
0
votes
1 answer

how to handle back pressure at sink operator in flink

my flink job pretends to fail at sink operator, which sends data to mqtt. I have tried .setBufferTimeout(0) at the one before sink operator and increase parallelism, as you can see in the pic. But it doesn't work. Can anyone help? Thanks.
DaydreamQ
  • 1
  • 1
0
votes
0 answers

Manage pressure when polling SQS

Note: this is about adaptive scaling SQS poller/subscriber, but I tried to present it in slightly more abstract terms, just a backpressure managment and a mediator. In code, I skipped all lock, critical sections, semaphores, and try/finally blocks…
Milosz Krajewski
  • 1,160
  • 1
  • 12
  • 19
0
votes
0 answers

Nodejs backpressure for createGunzip

Here is my problem I'm trying to read a zipped file and do some async stuff with the data without fully reading the file's content into memory, but as soon as I do some async stuff the backpressure dissapears and before I know it the whole file is…
FaNaT
  • 226
  • 4
  • 15
0
votes
1 answer

Reactor Backpressure - Block Until Pressure Relieved

I'm trying to use a Flux to process records from a database & pass them to a Kinesis stream - this works really well, but can result in unbounded memory usage if my Kinesis clients get "Backed Up" I've changed the backpressure to…
Ben Shoemaker
  • 143
  • 9
0
votes
0 answers

Limiting memory usage with large body requests

I'm running a vertx java web server to handle large body requests. In order to avoid memory overflow, I'm using the vertx backpressure mechanism with a Pump and implementation of the WriteStream interface which works properly to pause/resume the…
Eric
  • 1
0
votes
0 answers

Flux groupBy hangs even when requested unbounded

I am trying to guard groupBy from hanging indefinitely by adding the onBackPressureBuffer method. The following test works for multi = 1, i.e. 30000 groups, but hangs for every value of multi > 1. @Test void groupFluxHangsTest() { …
PeMa
  • 1,559
  • 18
  • 44
0
votes
0 answers

Handling backpressure in custom NodeJS streams

I'm generally new to Node and JS but not to the idea of streams and backpressure. I've been making a Discord bot using discordjs and I'm facing a backpressure issue. I'm recording the User's voice in PCM format and I'm saving it to a…
Alex V.
  • 31
  • 4
0
votes
1 answer

why back pressure occurs with many output streams

my flink job now has 60+ output streams, each stream's implementation is simple。But, why back pressure happens in kafka source operator. enter image description here my job graph enter image description here kafka source back pressure
shijie xu
  • 1
1 2 3
…
10 11