Questions tagged [high-load]

All aspects of high-loaded systems development and maintenance.

All aspects of high-loaded systems development and maintenance: design, algorithms, architecture, technologies, development, testing, databases, storage, support, hardware, hosting, management.

154 questions
0
votes
1 answer

Which android emulator is suitable for testing the load of third-party services?

We came up with the idea to create software for testing services for android. We need to choose an android emulator. I would like it to be: lightweight in RAM it was possible to change the SIM card there was an external software management…
AdmiraPaw
  • 3
  • 1
0
votes
0 answers

Nginx worker processes

I am using docker nginx as a reverse proxy for my backend rails api application scaled in docker containers also. During the perfomance tests I get such errors: 4048 worker_connections are not enough I found out that I have a default value of…
0
votes
1 answer

Does it make sense to split a huge select query into parts?

Actually, it is the question for an interview of a company which builds high-load service. For example, we have a table with 1TB of records with primary b-tree index. We need to select all records in a range from 5000 to 5000000. We cannot block the…
imissyouso
  • 25
  • 1
  • 5
0
votes
1 answer

How to change way to calculate request time in JMetter?

So, we use JMetter for load testing our application. If I correctly understand, JMetter use trivial logic to calculate time of request executing. It get difference between time of request started and request ended. So, if my processor is very busy…
TemaTre
  • 1,422
  • 2
  • 12
  • 20
0
votes
1 answer

JVM: Using global atom as an application cache storage in Clojure - Is it appropriate?

I have a high load app with many users requesting it with various GET params. Imagine giving different answers to different polls. Save vote, show latest poll results. To mitigate the back pressure issue I was thinking about creating a top-level…
BinaryButterfly
  • 18,137
  • 13
  • 50
  • 91
0
votes
0 answers

High traffic rails application gives random 502s and read timeouts

I have a rails application with an api which receives around 600k to ~ 1000k requests per day. these requests are primarily targeted at a file list and fetch endpoint. The file list endpoint fetches a list of 2000 records which contain file…
user13050796
0
votes
1 answer

Architecture of telegram bot for 150k users simultaneously

I am going to create a telegram bot to handle 150k users simultaneously (per second). I am going to use TDLib (because I do want to face Telegram Bot API limits about 30 messages per second). Previously I always used Telegram Bot Webhook. I…
atygaev.mi
  • 144
  • 2
  • 11
0
votes
0 answers

When high load tomcat threads sudden increase and hanged after few minutes

Tomcat getting hang with high load. Tomcat threads DB connections are showing a sudden increase. ex: tomcat threads reach 1000 from 200 within a minute. normally tomcat thread shows 150 - 250 stable pattern We have checked all application metrics…
0
votes
0 answers

MySQL table design for keeping short life data

Our application deals with different types of data, one of them - data with 15 minutes life cycle. This data is being fetched, placed into db and then every 15 mins items are deleted if they are older then 15 mins. We had no problems until we got…
Andrew
  • 3,165
  • 4
  • 24
  • 29
0
votes
2 answers

High loads causing node to become NotReady?

I'm running several experiments in GCE with a Kubernetes cluster built with KOPS. I can start my experiments, verify that they're running, then close to the end of the run the node responsible for generating the load for my cluster get a state…
Byebye
  • 934
  • 7
  • 24
0
votes
0 answers

How to optimize query to find duplicates by 3 columns with 1.5 billion of rows

I have table with over 1.5 billion of rows, high load project. I want to find duplicates by 3 columns using this query: SELECT v.product_id , v.value_id , COUNT(*) counter FROM ann2_product_value AS v GROUP BY v.product_id ,…
0
votes
1 answer

Storing huge randomized list of similar items in Redis

Redis 2.0.3 I need to store a huge list of items in Redis. Each item is a short string (less than 256 characters). I need to do two operations on the list: Add many (several thousands to a million) identical items. (Several times a day) Remove one…
Alexander Gladysh
  • 39,865
  • 32
  • 103
  • 160
0
votes
1 answer

How to realize load balancing for varnish servers with caching requests to backend(varnish servers)?

Please use this pic to understand it clearly Architecture as I see Need to realize request caching at [balancer] level for VoD service. When reqst1 for file1 is come to balancer it send it by round-robin to varnish1 server and save this request to…
Kein
  • 165
  • 2
  • 15
0
votes
1 answer

Java OOM in High load project

I have problem with OOM Exception in high load multi-thread Java project. I appreciate any help you can give. Delails: Project is build on Java+Mysql as storage. There is no evidence about additional RAM use in moment of application crash(no jumps…
0
votes
1 answer

ASP.NET high CPU load doesn't occur when running the service as a console once?

My environment: Windows Server 2008, IIE 7.0, ASP.NET I developed a Silverlight client. This client gets updates from the ASP.NET host through a WCF web service. We get 100% CPU usage and connection drops when we have a very low number of users…
R4cOOn
  • 2,340
  • 2
  • 30
  • 41