Stack Overflow
Stack Overflow

Questions tagged [high-load]

All aspects of high-loaded systems development and maintenance.

All aspects of high-loaded systems development and maintenance: design, algorithms, architecture, technologies, development, testing, databases, storage, support, hardware, hosting, management.

154 questions
2
votes
2 answers

Out of memory with low CPU consumption

I'm trying to tune some kind of hi-load application, which streaming data from one cloud to other with some preprocessing. The specific of my application is extensive memory usage and low CPU consumption. I monitored the app with jconsole and…
Silk0vsky
  • 941
  • 1
  • 18
  • 34
2
votes
0 answers

nginx-upload-module for large amount of small size data

Quick question, I have lost of average 2-3k data to upload, may be 2000 request/second, two options: Use nginx-upload-module to save file to disk and then read file in java Just send all data to java directly, java save data to file if cannot…
Xilang
  • 1,513
  • 3
  • 18
  • 36
2
votes
1 answer

Tarantool: limit/offset in index.indexName:pairs call

I need to fetch some records from space users. This space has a secondary index category_status_rating. I need select users with category=1, status=1, rating<=123456789: for _, user in box.space.users.index.category_status_rating:pairs({ 1, 1,…
Levintsev Aleksandr
  • 112
  • 1
  • 7
2
votes
0 answers

Database with high throughput, efficient random access and queries on secondary index

We have ~1Tb of user profiles and need to perform two types operations on them: random reads and writes (~20k profile updates per second) queries on predefined dimensions (e.g. for reporting) For example, if we encounter user in a transaction, we…
ffriend
  • 27,562
  • 13
  • 91
  • 132
2
votes
4 answers

WorkManager and a high workload

I'm working on an application which interacts with hundreds of devices across a network. The type of work being committed requires a lot of the concurrent threads (mostly because each of them requires network interaction and does so separately, but…
Yon
  • 1,023
  • 4
  • 13
  • 23
2
votes
1 answer

Improving the latency of server response under high-volme traffic

I have an e-commerce application and it works perfectly when 5 to 10 users are using it. But it becomes really slow when it is used by 50-60 people. Currently I am using MySQL & PHP. I am calling .php file which has MySQL connectivity code. And…
user3997016
2
votes
1 answer

Logstash/Elasticsearch/Kibana resource planning

How to plan resources (I suspect, elasticsearch instances) according to load: With load I mean ≈500K events/min, each containing 8-10 fields. What are the configuration knobs I should turn? I'm new to this stack.
inteloid
  • 747
  • 1
  • 7
  • 19
2
votes
0 answers

Occasional exception org.hibernate.QueryException: could not resolve property

Issue: In our web application under high load sometimes, when there are two simultaneous Hibernate queries in different threads (in same millisecond), we have two exceptions (in both threads): "org.hibernate.QueryException: could not resolve…
eupakhomov
  • 21
  • 3
2
votes
1 answer

Data consistency for NoSQL + Distributed Cache in very concurrent environment

On the slide you can see very rough architecture of booking system. It's very concurrent environment, where many users at once may try to book the same hotel/room. At bottom we have NoSQL database, for quick response/request there is distributed…
VB_
  • 45,112
  • 42
  • 145
  • 293
2
votes
4 answers

lowest latency, least overhead app server?

I'm designing an application which will have a network interface for feeding out large numbers of very small metadata requests. The application code itself is very fast, basically looking up data cached in memory and sending it to the…
Mark Harrison
  • 297,451
  • 125
  • 333
  • 465
2
votes
1 answer

Cost of creating exception compared to cost of logging it

Just wonder how much cost to raise a java exception (or to call native fillInStackTrace() of Throwable) compared to what it cost to log it with log4j (in a file, with production hard drive)... Asking myself, when exceptions are raised, does it worth…
Sebastien Lorber
  • 89,644
  • 67
  • 288
  • 419
2
votes
2 answers

Postgres Tuning and scaling

We have currently a Postgres database with a 100 of tables 20 of them with more than 5 000 000 rows, the master DB server runs on Debian 32MB RAM 8 Processors. Additionaly to the master DB we have a Slave DB replicated using Slony. Our application…
SPC
  • 21
  • 1
  • 2
2
votes
2 answers

APC User-Cache suitable for high load environments?

We try to deploy APC user-cache in a high load environment as local 2nd-tier cache on each server for our central caching service (redis), for caching database queries with rarely changing results, and configuration. We basically looked at what…
ak2
  • 457
  • 1
  • 5
  • 17
1
vote
1 answer

Server resets new connections but cpu/network load is low

I have written java server app, it can accept 3800-4000 network connections simultaneously and cpu/network load is low(<40%) But after this threshold it reject new connection or accept it by killing old one, so live connections count is about…
Rage
  • 121
  • 1
  • 6
1
vote
2 answers

Grabbing\spider protection

There is a site\resource that offers some general statistic information as well as an interface to search facilities. This search operations are costly, so I want to restrict frequent and continuous (i.e. automatic) search requests (from people,…
Roman Bodnarchuk
  • 29,461
  • 12
  • 59
  • 75
1 2 3
…
10 11