Questions tagged [system-design]

Systems design is the process of defining the architecture, components, modules, interfaces, and data for a system to satisfy specified requirements. (wikipedia)

Systems design is the process of defining the architecture, components, modules, interfaces, and data for a system to satisfy specified requirements. Systems design could be seen as the application of systems theory to product development. ref

618 questions
2
votes
1 answer

Celery creates 3 queues in RabbitMQ message queue

I was using celery as task queue and RabbitMQ as message queue, When pushing my tasks using the delay function to the queue. I see that there were 3 queues created in the rabbit mq. I don't understand what and why do we need these 2 extra queue.…
2
votes
1 answer

Web(GUI) based workflow platform for multi-tenant model

I'm looking at creating a web-based workflow platform that meets the following requirements. A workflow is a DAG of steps available in the user interface and can be stored as a JSON or YAML Steps: Tasks or functions,  can take input as well as…
2
votes
0 answers

Running any scripting language from C++ service

We have a C++ web service that helps manage and run scripts for users. We have to offer 2 APIs: RegisterScript API: Users can register scripts for a variety of languages(Python, Ruby, JavaScript etc.) through this api RunScript API: Users can run…
Jessica
  • 721
  • 1
  • 6
  • 13
2
votes
0 answers

I want to understand high level design of Google Colab and how it works

Can someone explain me the high level design/software architecture of Google Colab or a similar system ? Or any links/blogs where I can read about the same ?
2
votes
0 answers

How database sharding based on timestamp and pkid is better in performance?

I was checking a system design of twitter. Sharding based on UserID: We can try storing all the data of a user on one server. While storing, we can pass the UserID to our hash function that will map the user to a database server where we will store…
hariii
  • 89
  • 8
2
votes
1 answer

How do you design a configuration file system that copes with abrupt shutdown in embedded environment?

I'm designing a software that manages configuration file at application layer in embedded Linux. Generally, it maintains two copies of the configuration file, one in RAM and one in flash memory. As soon as end-users update setting(s) by UI, the…
2
votes
1 answer

How to build sequence diagram with 3 actors?

Overview: This is my activity diagram for the stock management subsystem. I have 3 actors which are the admin, manager, and employee. Question: Can someone explain to me how can I do my sequence diagram with 3 actors? In my sequence diagram, I need…
2
votes
0 answers

REST API - Benefit of adding extra layer

What would be the benefit of adding this "Microservice" extra layer, between Python script and REST API endpoint? The user is running the Python script. And it is given that the Python script is able to access "Cloud REST API" endpoint, and perform…
2
votes
0 answers

paginate a response with two data source

I have two sources of data , I fetch data from both the sources and combine them on basis of date and send as response. Now I am trying to send response as a paginated response but I don't have idea how to do this because there is no way to know how…
2
votes
0 answers

Reasons to use a LIFO cache eviction policy?

On the Wikipedia page about cache replacement policies, there is a small section about LIFO/FILO policy: Last in first out (LIFO) or First in last out (FILO) Using this algorithm the cache behaves in the same way as a stack and opposite way as a…
Ricola
  • 2,621
  • 12
  • 22
2
votes
1 answer

Double Entry Accounting System Using Event Sourcing

How can I go about designing a double entry accounting system using event sourcing? I read that this is a domain where event sourcing is applicable and it seems intuitive to me, storing all the events that affects the ledger and having the ledger…
skrill0
  • 29
  • 2
2
votes
0 answers

How to distribute URL frontier and crawling workers in a distributed web crawler?

I've read some articles about designing distributed web crawlers, but still have some questions related to the architecture, especially for distributing URL frontier and crawling workers. Currently, there're two options in my mind: The URL…
2
votes
2 answers

Does storing host and port data in an app make the server vulnerable?

I recently started development and was wondering. Every frontend application needs a host address and service port to connect to the backend server and the databases. For example when you use fetch in React you cannot avoid addressing the server,…
2
votes
1 answer

How do you design Telegram's "Contact Joined" feature?

How do you design Telegram's feature where you get a notification each time a contact of yours joins the service? what does it look like in terms of a scalable backend architecture? Scenario: Two users, where both have a common contact, join…
adi518
  • 863
  • 1
  • 11
  • 19
2
votes
1 answer

Use single JWT Token with 2 different applications

I have 2 different applications. Let's say A & B. A is being used for login/signup and users related activities. And It is also used for Generating JWT Token and validation as well. Now, the other application B is used for some very specific…
Saurav
  • 55
  • 4