Questions tagged [system-design]

Systems design is the process of defining the architecture, components, modules, interfaces, and data for a system to satisfy specified requirements. (wikipedia)

Systems design is the process of defining the architecture, components, modules, interfaces, and data for a system to satisfy specified requirements. Systems design could be seen as the application of systems theory to product development. ref

618 questions
0
votes
1 answer

Is caching worth it, for huge amount of data?

Assume that we have a key value pair data of 500TB. We can use 2.5TB memory to cache these pairs for future requests. The requests are some how random. The probability of cache hit would be 2.5/500 = 0.5% I know that the hit rate may increase by…
Amr Eladawy
  • 4,193
  • 7
  • 34
  • 52
0
votes
1 answer

Android: use entity class in view

I'm building an android project, I have a database and I create many entity classes (which has all sorts of annotations like @id, @Nullable). Now I need to show the data in my view. I'm wondering if it's ok to use directly entity classes in the view…
hawarden_
  • 1,904
  • 5
  • 28
  • 48
0
votes
1 answer

How can we design system for document search?

I was recently asked a system design question where I needed to "design system for document search" and first thing came in my mind was how elastic search works. So I came up with inverted index approach that is used to support text search. The…
flash
  • 1,455
  • 11
  • 61
  • 132
0
votes
1 answer

Deleting stale data from mapper table

I am working on a design with the following entities with C# and Microsoft sql server for my school project User table - User table that stores user information Product table - Product table that stores Product information Favorites table - User…
user3451476
  • 297
  • 1
  • 4
  • 17
0
votes
0 answers

Design batch job to process multiple files in a FTP folder

I want to design a batch job to process multiple zip files in the folder. Basically, the input zip file contains a directory structure and last directory have CSV file and set of PDFs. The job should take zip file and unzip and upload to an external…
0
votes
1 answer

Building a client-server application for local programming contest system

I am thinking to build a client server system, in which the server can receive user's code and compile it and return the result to the user. This system will be used for a local online programming contest at my university. So basically, the user…
all_by_grace
  • 2,315
  • 6
  • 37
  • 52
0
votes
1 answer

dealing with state data in an incremental migration from a monolithic legacy app

I have a very large monolithic legacy application that I am tasked with breaking into many context-bounded applications on a different architecture. My management is pushing for the old and new applications to work in tandem until all of the legacy…
Will Evers
  • 934
  • 9
  • 17
0
votes
1 answer

Kafka or Java Locks for a bank account / wallet balance update usecase, which-one to choose for better performance?

I am working on a java based usecase ( target is to make an microservice for this ) in which concurrent debits and credits are occurring for a bank account. I want to make this operation thread safe with least possible SLA. In java there are three…
0
votes
0 answers

Writes to geographically distributed database

If we have a database system replicated in geographically separate locations... and we want to allow writes on each of them. What is the best way to do that? For example: A site like expedia.com allows customers around the world to book any…
0
votes
1 answer

Need advice on datastore selection

Requirements Must Have Horizontally Scalable. Fast Sorting on a secondary index. Atomic update on a group of documents(Or simulate atomic update through versioning at table level). It’s very important that a group of documents(from a filter) are…
claudius
  • 1,112
  • 1
  • 10
  • 23
0
votes
1 answer

Why use a long algorith for URL shorteners when I can just use a DB ID

The examples I saw about designing a URL shortened all suggest first to create an sequential ID column in the database, and then use this DB-generated ID to get a shortened URL after converting it for an example to base 62. My question is, why not…
hello_its_me
  • 743
  • 2
  • 19
  • 52
0
votes
1 answer

Class Design of a meeting scheduler using OO principles

What would be the sample class design of Outlook like meeting scheduler? This should help you to schedule a meeting with the rest of the invitees and book a room as we do in offices. Few things I omit purposely,i.e checking meeting room…
Atiq
  • 490
  • 11
  • 28
0
votes
0 answers

How do I process (running any algorithms like BFS etc on) a large graph?

I am trying to think of possible ways to solve such problem where there is a huge graph which can't fit into one machine. How would one run any algorithm like BFS or DFS on such graph.
rgaut
  • 3,159
  • 5
  • 25
  • 29
0
votes
1 answer

kafka for consuming subscription data sent by a webservice

Scenario: I have a north bound web service(say A) and a south bound application(say C). And I am creating a micro service (say B) which transforms data received by A in a format that is readable by C. A can send data any random time intervals, and…
0
votes
1 answer

Which protocol should I use to exchange files between multiple nodes?

I have multiple nodes. Node is just a linux or windows server. Also I have one master node. The master node is manager of process of file sharing. This images shows process of communication: So, I try to choose some protocol for this system, which…