Stack Overflow
Stack Overflow

Questions tagged [high-load]

All aspects of high-loaded systems development and maintenance.

All aspects of high-loaded systems development and maintenance: design, algorithms, architecture, technologies, development, testing, databases, storage, support, hardware, hosting, management.

154 questions
3
votes
6 answers

Patterns and technologies for a system capable of processing 40,000 messages per second

We need to build a system capable of processing 40,000 messages per second. No messages can be lost in case of any software or hardware failures. Each message size is about 2-4Kb. Processing of a message consists of validating the message, doing…
Konstantin Spirin
  • 20,609
  • 15
  • 72
  • 90
3
votes
4 answers

How much every character occurs in the given string

I need to calculate how many times every character occurs in the given string. I need to do it on C or C++, I can use any library. The problem is that I am not a C/C++ developer, so I am not sure that my code is optimal. I want to get the best…
Dmitrii Tarasov
  • 414
  • 2
  • 13
3
votes
1 answer

What would happen if deploy PostgreSQL with HDFS as filesystem in high-load scenario?

It's a deliberately stupid question. But I'm just curious - what would happen if I mount HDFS using FUSE binding as a volume and launch PostgreSQL with a cluster stored on this HDFS volume and start writing massive amounts of data and/or do…
Gill Bates
  • 14,330
  • 23
  • 70
  • 138
3
votes
2 answers

Erlang high volume logging

For my erlang application, I have used both sasl logger and log4erl and both are giving poor performance when the number of events sending to them is around 1000 per second. log4erl was giving better performance but after some time its mailbox…
Arunmu
  • 6,837
  • 1
  • 24
  • 46
3
votes
2 answers

Short unique IDs

I'm designing a HTTP-service, with capacity of up to 500 million requests per day (served by more than one independent machine). For each request I have to generate unique ID and return it to user. ID must be 100% unique within a window of 10…
Alexander Gladysh
  • 39,865
  • 32
  • 103
  • 160
3
votes
0 answers

Search engine reindex in high load environment

May be somebody can share his experience how to solve such issues. Would be glad to learn from you. In short: we have a huge Rails app with ReactJS frontend and Solr as a search engine (gem Sunspot). So our problem is when you update some entity and…
Ivan Schneider
  • 1,145
  • 1
  • 11
  • 20
3
votes
3 answers

MySql slow data fetching

I have MySql table with a huge ammount of rows. I m doing the simple request and it works pretty fast. The only one problem fetching the data to client is terribly slow for about 150 secs when the request itself takes only 0.3 sec. I am using php…
Timur Stash
  • 31
  • 1
  • 3
2
votes
0 answers

Netty not closing channels normaly

I'm new with Netty. Now migrating my server, cause of high loads. I read lots of mans, doing everything like in examples, but have a bug: CPU load grows in time and very fast. Analyzing heap and logs shows me, that channels, which throws exceptions…
Eirenliel
  • 345
  • 4
  • 14
2
votes
4 answers

Moving the mysql query out of the loop

i have the following code function cron_day_counts() { $subids = get_subids(); array_push($subids, ''); $from = '2011-10-19'; $to = '2011-10-20'; $days = days_interval($from, $to); $result_array = array(); foreach…
mintobit
  • 2,363
  • 2
  • 15
  • 15
2
votes
3 answers

Design considerations for web application with 5 GB/day transfer volume?

I have to build a web application that's similar to a "branch/store locater". A user types in his address and the web application will plot nearby stores on a map. One of the requirements is: "The web application must support 100 simultaneous users…
John
  • 32,403
  • 80
  • 251
  • 422
2
votes
7 answers

Hints for a high-traffic web service, c# asp.net sql2000

I'm developing a web service whose methods will be called from a "dynamic banner" that will show a sort of queue of messages read from a sql server table. The banner will have a heavy pressure in the home pages of high traffic sites; every time the…
ila
  • 4,706
  • 7
  • 37
  • 41
2
votes
1 answer

Need help to design fast and scalable server architecture for SaaS chat

I want to develop a SaaS chat that users will be able to embed on their website and also there will be a desktop chat client. Something similar to Live Chat. The problem is that I've never developed server or database programs. Also I'm new to Java…
Poma
  • 8,174
  • 18
  • 82
  • 144
2
votes
1 answer

Process netbeans.exe (NetBeans 7.0) consuming high amount of CPU usage

I had Netbeans 6.8 installed on my PC a day back... I uninstalled Netbeans 6.8 completely and then installed NetBeans IDE 7.0 (Build 201104080000)... Now the process netbeans.exe consumes high amount of CPU usage varying from 30% to 95%... This…
user646093
  • 1,495
  • 3
  • 15
  • 20
2
votes
1 answer

High load image processing architecture for web

I have to implement the following high-load application: Users send images to a web-server via browsers. Server should process images and send results (several strings) to user's browsers back. Results should appear in 10 seconds and Html-UI should…
Andrew Florko
  • 7,672
  • 10
  • 60
  • 107
2
votes
1 answer

Throughput in spring boot netty web application

I would like to improve throughput in my web-server. But I don't understand what is really happening when I am testing it with high load (jmeter). I run spring boot webflux app (spring boot 2.0.2, netty) on a computer with 8 core cpu. I created a…
pevgen
  • 151
  • 2
  • 12
1 2
3
…
10 11