Questions tagged [high-load]

All aspects of high-loaded systems development and maintenance.

All aspects of high-loaded systems development and maintenance: design, algorithms, architecture, technologies, development, testing, databases, storage, support, hardware, hosting, management.

154 questions
0
votes
1 answer

High Load System and Multithreading

Can anyone tell me , What is architectural pattern or way the best for using multi threading in High Load System? I have read about Multiplexing approach, Is there something else? Thanks.
jitm
  • 2,569
  • 10
  • 40
  • 55
0
votes
2 answers

How to process multiple requests using the same PHP running instance?

As we know, PHP works in the "share nothing" phylosophy. It therefore is bound with serious performance limitations. While a compiled script can be accelerated by some caching extensions we cannot avoid very heavy initialization (for example, we…
0
votes
3 answers

Weighted pick with filters

I have a list of elements with weights: { id1, weight1 }, { id2, weight2 }, ... { idN, weightN } Weights are small integers (say, less than 1000, often less than 50). Total number of ids in the list is less than 1000 as well. (Each id is listed…
Alexander Gladysh
  • 39,865
  • 32
  • 103
  • 160
0
votes
1 answer

How to scale http requests horizontally?

Ok, say I have simple web-server instance which always responses "Hello world" and this simple server can handle only 1K connections simultaneously. I have to handle 1M http-requests simultaneously, so I clone 1K nodes with my web-server instance.…
corvax
  • 1,095
  • 1
  • 10
  • 35
0
votes
2 answers

Increasing web server performance

What configuration should I usually set to increase web server performance ? (For example Apache TomCat). I need that my web server process a lot of requests at the same time.
GeT_RiGhT
  • 47
  • 6
0
votes
1 answer

How to use index properly for a large mysql table?

I have a table in MySQL 5.7.13, that has 3 columns (actually more than that, but these three are used for searching) - it has a column company_id, it has a column department_id, and it has column status. Now, usually employees work like this, they…
SPIRiT_1984
  • 2,717
  • 3
  • 29
  • 46
0
votes
1 answer

IIS/Azure IIS - restrict max response time

The web service I develop must respond in 6 seconds max. If web service is unabled to respond in 6 seconds it must respond with some hardcoded data. The web service is kind of proxy which transforms incoming data and makes a request to another…
STO
  • 10,390
  • 8
  • 32
  • 32
0
votes
0 answers

Can I run Laravel Queues from my home PC?

Lets say, I have a production VPS with Laravel app which runs fine. There are some tasks that are processed with queues. The queue driver is set to Database. Can I connect my home PC to production DB and mail (like if my production is connected to…
naneri
  • 3,771
  • 2
  • 29
  • 53
0
votes
1 answer

best way to prepare for digg effect

I have a web site which will be featured in a place which will send a large peak of one-time traffic in a couple of weeks. The server hosting the website also hosts the control panel my customers use. The website part is simple and mostly static.…
Nir
  • 24,619
  • 25
  • 81
  • 117
0
votes
1 answer

Is there any ready solution to communicate between web servers interrally?

I have a bunch of different RESTful services running, and they designed to be as much separate, as possible (physically or logically). But sometimes they need to communicate with each other (if available). A long as they are web servers, I use http…
desertkun
  • 1,027
  • 10
  • 19
0
votes
1 answer

Realtime log parsing

I want to write a tool which parses log files at realtime. Log file can be written very fast, for example ~10k lines per second. I just need to get each line, then execute one regexp and write result to DB. Due to speed, it couldn't be done by…
kopaty4
  • 2,236
  • 4
  • 26
  • 39
0
votes
2 answers

Which database to choose for storing and reading the stats?

Which database to choose for storing and reading events or logs (i.e. ad requests, impressions, etc..)? Approximately 30 new entries per second. Chance growth. It is therefore necessary flexible scaling. Elasticsearch? InfluxDB? Something else?
user2107749
  • 13
  • 1
  • 2
0
votes
1 answer

How provide reliability of ActiveMQ broker?

Is i correct understand that best way provide reliability of queue it is network of master-slave brokers (for example master-slave by using ZooKeeper)? In consumers and producers failover settings we set master's addresses and when one of the…
Hayate
  • 653
  • 1
  • 9
  • 25
0
votes
1 answer

Free resources while waiting for remote gate in (PHP, Apache, Nginx)

My php script waits for remote gate response, normally for ~20 seconds. It causes apache httpd threads to live in memory with opened MySQL connection and finally to exceed MaxClients value. How it can be managed to free idle resources until remote…
Oleg Kubrakov
  • 175
  • 1
  • 1
  • 10
0
votes
0 answers

Can i manage ActiveMQ workers without demonization?

I lookup information about workers in Gearman, ZeroMQ and RabbitMQ and i find, that best practice is using something like Supervisor. I google for ActiveMQ but can't find information about workers managing. Is it the same, or ActiveMQ can start,…
Hayate
  • 653
  • 1
  • 9
  • 25