Stack Overflow
Stack Overflow

Questions tagged [system-design]

Systems design is the process of defining the architecture, components, modules, interfaces, and data for a system to satisfy specified requirements. (wikipedia)

Systems design is the process of defining the architecture, components, modules, interfaces, and data for a system to satisfy specified requirements. Systems design could be seen as the application of systems theory to product development. ref

618 questions
2
votes
1 answer

Cache using Nginx vs Redis, Proxy and Load balancing using Nginx

I am interested in widening my knowledge in designing large scale distributed systems. I have come across the topics Cache and Proxy servers. For Proxy servers we are using Nginx for example, and Nginx also has it's own Cache. Now, what is the major…
Nikhilesh A S
  • 169
  • 1
  • 12
2
votes
4 answers

How to design a server monitoring system running on AWS

I am building some form of a monitoring agent application that is running on AWS EC2 machines. I need to be able to send commands to the agent running on a specific EC2 instance and only an agent running on that instance should pick it up and act on…
Tamerlane
  • 2,031
  • 3
  • 21
  • 34
2
votes
1 answer

Kafka S3 Sink Connector - how to mark a partition as complete

I am using Kafka sink connector to write data from Kafka to s3. The output data is partitioned into hourly buckets - year=yyyy/month=MM/day=dd/hour=hh. This data is used by a batch job downstream. So, before starting the downstream job, I need to be…
nish
  • 6,952
  • 18
  • 74
  • 128
2
votes
1 answer

Restrict access to a instance variable to only selected method in that class

I want to restrict or limit update to members palidromes and palidromesFIFO to only one method, say addPalindromeWord, and don't let any other methods to update it. Is there a way to do that? Target is to achieve modularity in handling the addition…
Saurav Sahu
  • 13,038
  • 6
  • 64
  • 79
2
votes
3 answers

Is distributed systems same as horizontal scaling?

Horizontal scaling is distributing the load to multiple physical / virtual machines using a load balancer. Same of distributed systems. The question is is horizontal scaling same as distributed systems ?
Prateek Pande
  • 495
  • 3
  • 12
2
votes
3 answers

How to Fetch Count Based on Filter through Back-end

Let's suppose we have a fairly large database of products for e.g. 50 K Mobile Phone. We store these data in Elastic Search. Now I have a Product Listing page for mobile phone, there I list all mobile 10 at a time using pagination with their basic…
Sanjay Soni
  • 201
  • 1
  • 13
2
votes
2 answers

How do Google check Username availability so fast?

While creating a gmail account, it asks us to enter the username. When we enter the username and password, then we click the Next Button. Within couple of seconds it gives the error like "That username is taken. Try another.". There are billions of…
Aman Shekhar
  • 2,719
  • 1
  • 18
  • 29
2
votes
2 answers

API Gateway: Mixture Of Authenticated and Unauthenticated Endpoints

I have been working on creating a platform utilizing microservices architecture with an API Gateway. One question that I'm stuck on, is how to have the API Gateway handle both authenticated and unauthenticated endpoints. Here is a simplified and…
Ellie Maynard
  • 21
  • 2
2
votes
1 answer

network optimizations while web crawling - using udp and using connection pooling?

I'm looking at donne martin's design for a web crawler. they are suggesting the following network optimization: The Crawler Service can improve performance and reduce memory usage by keeping many open connections at a time, referred to as…
ihadanny
  • 4,377
  • 7
  • 45
  • 76
2
votes
0 answers

Message queue processing with long running task for each message

We have a requirement in our project where there are list of long running tasks to be performed. We have added this list of tasks to a message queue(SQS). Now once we start polling messages from the SQS, each message(task) involves updating huge…
Chandan
  • 394
  • 6
  • 16
2
votes
2 answers

What is the difference between Reverse proxy and Load balancer?

I am trying to understand how reverse proxy and load balancing are different from each other. When its useful to use reverse proxy over load balancing.
Prakhar Gurawa
  • 373
  • 3
  • 13
2
votes
1 answer

System design questions

I am preparing for the system design interview, and since I have little experience with this topic, I bought the "Grokking the system design interview" course from educative.io, which was recommended by several websites. However I read it, I think…
suho
  • 23
  • 2
2
votes
1 answer

How like button is implemented in distributed systems?

I'm wondering is there any good resource with a clear explanation of how like/dislike buttons are actually implemented in modern distributed systems like Instagram/Twitter? I.e. we can assume that such metadata (name, size, resolution,…
Developer87
  • 2,448
  • 4
  • 23
  • 43
2
votes
1 answer

What is the difference between LLD and Object Oriented Design?

What is low level design and object oriented design? Design patterns are part of Object oriented design? Suggest me the best ways to learn about the low level design. what are all the things will come under low level design?
Aathiganesh
  • 21
  • 3
2
votes
1 answer

How is it possible for a Hyperledger Sawtooth Validator node to have 'number of peers greater than the maximum connectivity' in the Sawtooth Network?

Below statement is from this documentation. The network component continues to perform a peer search if its number of peers is less than the minimum connectivity. The network component rejects peering attempts if its number of peers is equal to…
RafiAlhamd
  • 341
  • 2
  • 13
1 2 3
…
41 42