Stack Overflow
Stack Overflow

Questions tagged [throughput]

421 questions
7
votes
1 answer

Kafka Memory requirement

I am a beginner to kafka We are looking for sizing our kafka cluster(a 5 node cluster) for processing 17,000 events/sec with each event at the size of 600bytes. We are planning a replication of 3 and retention of events for a week I read in the…
Suren Baskaran
  • 1,228
  • 1
  • 10
  • 17
7
votes
3 answers

Warming up high throughput Java apps

I recently learned about scenarios which require warming up an app (with high throughput requirement) before they start serving real requests. The logic behind this was to allow JIT to do its performance magic! Is this a norm for Java apps or is…
Aayush Puri
  • 1,789
  • 3
  • 15
  • 19
6
votes
2 answers

Very Low Throughput Using The HornetQ Core Bridge

We are trying to use the HornetQ store and forward mechanism... however forwarding messages from one standalone HornetQ instance to another using the core bridge is very slow. We have not been able to increase the throughput rate above 200 messages…
Gur Kamal Singh Badal
  • 851
  • 4
  • 11
6
votes
2 answers

Quickly degrading stream throughput with chained operations?

I expected that simple intermediate stream operations, such as limit(), have very little overhead. But the difference in throughput between these examples is actually significant: final long MAX = 5_000_000_000L; LongStream.rangeClosed(0, MAX) …
user5537999
6
votes
1 answer

DynamoDB AutoScaling still throttles

I have an application using DynamoDB and I noticed they just implemented autoscaling which is awesome. I love the concept and the timing for my app is pretty perfect. However I am still getting some issues that I wonder if I can't tweak settings…
sfaust
  • 2,089
  • 28
  • 54
6
votes
1 answer

Crawling slows down drastically towards the end

I've got a set of 25,000+ urls that I need to scrape. I'm consistently seeing that after about 22,000 urls the crawl rate drops drastically. Take a look at these log lines to get some perspective: 2016-04-18 00:14:06 [scrapy] INFO: Crawled 0 pages…
HyderA
  • 20,651
  • 42
  • 112
  • 180
6
votes
1 answer

What is the meaning of AmazonDB Free Tier?

In my Android app I use Amazon DynamoDB. I created 10 tables with Read capacity 10 and Write capacity 5. Today I received an email from Amazon. It costs me 11.36$. I don't understand the meaning of free tier. Here is what I read from…
TOP
  • 2,574
  • 5
  • 35
  • 60
6
votes
3 answers

RestSharp: The underlying connection was closed: A connection that was expected to be kept alive was closed by the server

I am using RestSharp as the underlying HTTP client library to make a stress/throughput test client on a black box service. Threadpool and Servicepoint connection limits have been lifted to 5000, but that shouldn't be much of a worry as we are…
icelava
  • 9,787
  • 7
  • 52
  • 74
6
votes
2 answers

Java NIO good for low latency or high throughput?

I am new to Java NIO and have used it a little. I have a general query. If you are designing a ultra low latency app vs high throughput application, which of the two gets clearly benefited by using Non blocking IO? My understanding is that Non…
de.coding.myth
  • 125
  • 1
  • 9
6
votes
1 answer

Choosing/configuring a database for high-throughput, reliable, consistent write throughput, sacrificing latency

I'm working on a real-time application with the following characteristics: Hundreds of clients will be inserting rows/documents at the same time, each inserting a row every couple of seconds. Largely append-only; almost all rows/documents, once…
btown
  • 2,273
  • 3
  • 27
  • 38
5
votes
2 answers

Improving the message throughput of ejabberd-2.1.10

I have installed ejbberd-2.1.10 from the binary installer on my machine(Win7 32bit 2.93GHz Core2Duo 3GB RAM). Since our set-up needs a very high message throughput I have looked through the performance tuning reference and made changes in my…
sandy1510
  • 59
  • 5
5
votes
2 answers

BatchPutItem vs PutItem in DynamoDB

I have a use case where we don't get that many cases where there are list of entries in a single request to be updated and mostly, it is the case where only a single entry is requested to be updated. But in future, this might grow and hence I was…
Gopikrishna K S
  • 129
  • 2
  • 7
5
votes
4 answers

C++ socket programming: maximize throughput/bandwidth on localhost (I only get 3 Gbit/s instead of 23GBit/s)

I want to create a C++ server/client that maximizes the throughput over TCP socket communication on my localhost. As a preparation, I used iperf to find out what the maximum bandwidth is on my i7…
Christian
  • 447
  • 1
  • 6
  • 10
5
votes
4 answers

Does min.insync.replica configuration affect Kafka producer throughput?

From kafka documentation When a producer sets acks to "all" (or "-1"), this min.insync.replica configuration specifies the minimum number of replicas that must acknowledge a write for the write to be considered successful. It says when the…
Markiv
  • 317
  • 1
  • 5
  • 13
5
votes
1 answer

Graph Throughput Algorithm

I have the task to calculate the maximum throughput in a graph. The easiest way to describe the graph is as int[][]. The inner array is the nodes in graph and the outer array is the distance connecting each node in the graph, e.g.: new int[][] { …
user7433212
  • 51
  • 2
1
2
3
…
28 29