Stack Overflow
Stack Overflow

Questions tagged [high-load]

All aspects of high-loaded systems development and maintenance.

All aspects of high-loaded systems development and maintenance: design, algorithms, architecture, technologies, development, testing, databases, storage, support, hardware, hosting, management.

154 questions
1
vote
1 answer

Understanding SQL connection pool work with Go

I have a rabbit MQ queue which is high load, it may have up to several millions messages. The MQ broker reads messages from queue and writes them to MS SQL DB. I tried to write non-blocking, concurrently, using a goroutine: for m := range msgs…
Олег Сидоров
  • 641
  • 2
  • 8
  • 20
1
vote
0 answers

django.db.utils.OperationalError: could not translate host name "db" to address: Temporary failure in name resolution on highload

I have the django project which works with PostGresql db, both in docker containers. It works Ok, but on highload sometimes gives the django.db.utils.OperationalError: could not translate host name "db" to address: Temporary failure in name…
deadkitten
  • 31
  • 4
1
vote
0 answers

Golang http client - connectex: Only one usage of each socket address (protocol/network address/port) is normally permitted

I`m trying to create a Golang net/http based web service, which takes a JSON input from user, and then it queries a third party web API itselves, to get data and then returns answer to client. I use http.Client{} client.Do() method to query the…
Олег Сидоров
  • 641
  • 2
  • 8
  • 20
1
vote
1 answer

Highload data update architecture

I'm developing a parcels tracking system and thinking of how to improve it's performance. Right now we have one table in postgres named parcels containing things like id, last known position, etc. Everyday about 300.000 new parcels are added to this…
RndGuyFromInternet
  • 13
  • 2
1
vote
1 answer

What is the best solution to execute a load test to simulate 200k - 500k concurrent users?

I'm looking for the best solution to execute a load test to simulate 200k - 500k concurrent users to test the web app. Some scenarios have to do with video viewing, user content pushing (like pictures, video uploading), page viewing. One of the…
Michael Derevyanko
  • 41
  • 6
1
vote
1 answer

Ruby on Rails. Highload. Architecture practice

Please, can you say best books or resources about highload or best architecture practice on Ruby on Rails. And books about best practicies in web architecture design. Thanks.
maxfry
  • 357
  • 1
  • 4
  • 10
1
vote
1 answer

AWS RDS MySQL Instance starts performing same SQL SELECT query much slower under certain loading

I'm running performance testing on my application that lives in AWS environment and I see a weird behavior of the DB after certain loading. When I have more than 1500 queries per second to the RDS MySQL, the queries are performed much slower. The…
Oleh Pylypchak
  • 11
  • 2
1
vote
1 answer

Process 350k requests per seconds and save data to Google Cloud Storage

I need to implement microservice which is fairly simple in terms of logic and architecture, but needs to handle around 305k requests per second. All it's going to do is to ingest JSON data, validate it according to simple rules and record to Google…
Vlad
  • 23
  • 2
1
vote
1 answer

How to make High load Java app in correct way?

I'm working on web project, where I use spring, mysql, hibernate and docker. There is no problem to make a design of relation db, it works. How to verify the db's design is correct? How to foresee the high-load for the project? I know about the…
0x01
  • 29
  • 1
1
vote
1 answer

Browser frontend client - wait or poll?

We are going to write a server side for high load application. A client from browser makes a call, which will be processed for a long time - let's say 1-3 minutes (we call external services during processing, they may be asynchronic etc) What is…
Pavel Bernshtam
  • 4,232
  • 8
  • 38
  • 62
1
vote
2 answers

Concurrent inserts and race condition in MySQL

I have a case, where I should limit rows per user in the table. Now I am doing this via COUNT * FROM table check before insert, and if the count equals/more than allowed, I throw an error. COUNT and INSERT query running in the single transaction.…
LONGMAN
  • 980
  • 1
  • 14
  • 24
1
vote
1 answer

Change string indexes to be ObjectID ones in large MongoDB instance

So, I've git a large production database dump with _id field as strings. Different collections got those string's length different. There're a lot of relations there. I need a way to change string _ids to ObjectId ones. What I've tried already: 1)…
Bogdan Lapchenkov
  • 181
  • 10
1
vote
0 answers

Cassandra3: Exception in thread Thread[ReadRepairStage , Operation timed out - received only 0 responses

when we send lots of request to Cassandra we are getting sometimes ERROR [ReadRepairStage:12] 2018-05-07 10:35:19,056 CassandraDaemon.java:228 - Exception in thread…
goldan
  • 11
  • 5
1
vote
2 answers

Mongoose: handling multiple databases when working with one model

What I want is to have arbitrary databases (50 for example) with the same collections (same schemas, exact models, different data) and 1 nodejs (expressjs + mongoose) web app. Example simplified case: I have: a single web application (expressjs +…
Alex
  • 418
  • 4
  • 13
1
vote
0 answers

Cassandra destination is not a direct buffer

our cassandra nodes reach nearly 90% load without any requests. In the log we can see this exception. Has anybody at least an idea? Our software runs without problems in other environments. INFO [CompactionExecutor:36366] 2017-02-02…
itstata
  • 1,058
  • 7
  • 17
1 2 3
…
10 11