Questions tagged [high-load]

All aspects of high-loaded systems development and maintenance.

All aspects of high-loaded systems development and maintenance: design, algorithms, architecture, technologies, development, testing, databases, storage, support, hardware, hosting, management.

154 questions
1
vote
1 answer

Common-practice in dealing with high-load tables in MySQL

I have a table in MySQL 5 (InnoDB) that is used as a daemon Processing Queue, thus it is being accessed very often. It is typical to have around 250 000 records inserted per day. When I select records to be processed, they are read using a FOR…
clops
  • 5,085
  • 6
  • 39
  • 53
1
vote
1 answer

Patterns for database functional decomposition?

we have a following problem. Our enterprise application has a database in MySQL, and it seems like it's structure becomes too complex - where are more than 100 tables (it has been developing for 7 years now). However, most tables don't have any…
SPIRiT_1984
  • 2,717
  • 3
  • 29
  • 46
1
vote
2 answers

What's the best way of creation of thousands of controls in scrollable area using WPF

I'm using WPF and C#. I have a problem. I need to create a lot of bindable templated controls in scrollable area (they are all of different types). For example 1000 textboxes, 1000 drop down lists, and 1000 checkboxes. The problem is that when they…
1
vote
0 answers

CommunicationException during a load test

I'm working on a wcf application and I'm started to see an strange timeouts behavior on it. I created a foo application with the same configuration as the real one in order to determine if the problem is wcf related or not. The client application…
Diego
  • 1,531
  • 1
  • 15
  • 27
1
vote
2 answers

How to deliver images effectively using asp.net

My asp.net application creates, stores in memory and shows images to user. Standard HttpHandler gets thread from pool to deliver each image. I think it's not effectively. Can asp.net deliver images more effectively than HttpHandler? Upd: images are…
Andy
  • 766
  • 1
  • 6
  • 16
0
votes
3 answers

Java-mysql highload application crash

I have a problem with my html-scraper. Html-scraper is multithreading application written on Java using HtmlUnit, by default it run with 128 threads. Shortly, it works as follows: it takes a site url from big text file, ping url and if it is…
c1tru55
  • 77
  • 7
0
votes
2 answers

Need to speed up this php script

I'm currently having more than 400k records in my mysql table. The structure is the following: The function i am using: function cron_hour_counts() { $subids = get_subids(); array_push($subids, ''); $from =…
mintobit
  • 2,363
  • 2
  • 15
  • 15
0
votes
0 answers

How to calculate max rps of a microservice

I have micro service deployed on Kubernetes cluster. I want to know the maximum amount request per seconds it can serve. So I want to learn the method, how can I evaluate the max rps, any help welcome I tried locust python lib And postman (but it…
Fedor
  • 19
  • 4
0
votes
2 answers

High-load C++ logging

I’m using spdlog library in my high-load service. Also my service is getting requests from another service by gRPC. At this moment I can’t use streaming gRPC, and every call creates its own connection. As I know I can’t restrict threads count gRPC…
Leonid
  • 75
  • 1
  • 7
0
votes
0 answers

When I am use 'order by Id DESC', query execution time increases more 25 seconds

Hello I am use ClickHouse (so CH) version 21.3.20.1 I have Postgesql database by wegth more 70gb. I am creat table in CH I create table in CH with next command: CREATE TABLE test_una_analytics_service.messages (Id UUID, ChatId UUID, User…
0
votes
0 answers

Pgbouncer how to test usefullness using query

I've got Postgres 13 version and PG-bouncer. How can I using connection and query to database test usefulness of pgbouncer? I mean start query which generate connections or other and at the end of test we see that time of query is lower, or workload…
Gerzzog
  • 95
  • 7
0
votes
1 answer

MySQL high load errors

The server runs php 5.5.38 with apache2.4 and MySQL 5.5.62 there are about 5k-10k read write per minute. And the table of main use was MyISAM and started crashing, saying "in use" instead of stats. The attempts of repair failed. And finally changed…
ja0
  • 37
  • 4
0
votes
1 answer

What are the maximum limits for open files and running processes in CentOS 7?

I am deploying a highly loaded system on a cluster of centos servers. For stable operation of the system, I need to increase the limit of the maximum number of open files and processes. I started searching the forums and saw that some people set the…
0
votes
1 answer

FastAPI + Uvicorn config. Why do some of requests take more than 10 seconds?

I have production version of my config. But some of my request to server can take more than 1, 2, 10, 15 seconds. It is random. 1 of 20 requests are like this. I have had good server: 8RAM, 4CPU. Problem in my code. How do I set it up for…
Alex Poloz
  • 366
  • 7
  • 22
0
votes
1 answer

HAProxy reverse ssl termination: Memory keeps growing. Memory leak?

I have haproxy 2.5.1 in SSL termination config running in a container of a Kubernetes POD, the backend is an Scala App that runs in another container of same POD. I have seen that I can put 500K connections in the setup and the RSS memory usage of…