Stack Overflow
Stack Overflow

Questions tagged [distributed-database]

Anything related to distributed databases and the techniques and the tools used to manage them. A distributed database is a database whose information is not stored in a single physical location, but it is spread over various devices, often placed far apart.

Anything related to distributed databases and the techniques and the tools used to manage them. A distributed database is a database whose information is not stored in a single physical location, but it is spread over various devices, often placed far apart.

188 questions
0
votes
1 answer

How to remove all records from a DFS table but keep its schema?

I have defined the DFS table schema and write test data into it. Now, I want to delete all test data but keep my table schema, how? Suppose I have the following DFS table: n=1000000 ID=rand(150, n) dates=2017.08.07..2017.08.11 date=rand(dates,…
Zoey
  • 48
  • 5
0
votes
1 answer

How to perform a table join on two DFS tables and update the left table based on its result?

Two DFS tables, pt and pt1, with the same schema were created in the database dfs://db using the following scripts. n=10000 ID=rand(100, n) dates=2022.08.07..2022.08.11 date=rand(dates, n) vol=rand(1..10 join int(), n) t=table(ID, date,…
Polly
  • 603
  • 3
  • 13
0
votes
0 answers

multi key encryption and decryption

I need some serious suggestions on my protocol, specifically for decryption. So the scenario is Organizations A and B encrypt their employees' records with their own keys and store them in the distributed database. When a User from Organization A…
Laila Tul Badar
  • 1
  • 1
0
votes
0 answers

Scaling a relational DB: Combining sharding and replication

I have been reading Lewis Lin's "The System Design Interview". In the example cases, when designing Twitter, he first talks about sharding the database. Then, to improve availability, he suggests replicating each shard with a main (write) replica…
gonzaleznicolas
  • 51
  • 7
0
votes
1 answer

Creating and migrating a devise-driven User model in a main/replica context

The following main/replica database structure development: primary: <<: *default database: users_development username: deploy_root password: password host: "localhost" migrations_paths: db/user_migrate primary_replica: …
Jerome
  • 5,583
  • 3
  • 33
  • 76
0
votes
0 answers

Does 1 phase commit make sense in distributed systems?

I'm trying to understand what is the difference between 1 and 2-phase commit and why 1phase commited does not make sense distributed systems. From my understanding here they are: In 1 phase commit the coordinator commits the transaction on all…
St.Antario
  • 26,175
  • 41
  • 130
  • 318
0
votes
1 answer

What is system.size_estimates in cassandra and plausible reasons behind high disk consumption

I've been using cassandra on two nodes where one of them ran out of disk space and went down. When I checked, I've observed the size of size_estimates to be ~30GB. I've removed sstable files from my data directories and restarted the node. Was…
PKS
  • 11
  • 1
  • 2
0
votes
1 answer

Failed to add new value partitions to database

My cluster is composed of 3 linux_x64 servers. It contains 1 controller node and 3 data nodes. The server version of DolphinDB is v2.0.1.1. dfsReplicationFactor=2 dataSync=1 The schema of the database is: 2021.09.09 08:42:57.180: execution was…
jinwandalaohu
  • 226
  • 1
  • 7
0
votes
1 answer

How to do query for two different association DFS tables?

How to do query for two different association DFS tables? Does DolphinDB have restrictions on queries of the association DFS tables?
winnie
  • 183
  • 1
  • 6
0
votes
0 answers

Efficient archiving monthly older than 1 year old for distributed Mongo DB

We have a distributed /shared mongo db (5 to 6 replica). I want to back up huge tables data if older than 1 year old (ie). And delete after backup. (I dont want any data loss, so i dont want to delete a collection completely) Source collection is…
Tolga Celik
  • 1
  • 1
0
votes
1 answer

How does the GUI load a partitioned table on remote server in dolphindb?

How does the GUI load a partitioned table on remote server in dolphindb? I run scripts in GUI and want to load a partitoned table which is on the remote server, how to do?
damie
  • 412
  • 2
  • 7
0
votes
1 answer

Citus: Can I view sharded tables of each node on master node?

I am managing my PostgreSQL cluster in docker-compose and I have connected to master(coordinator) node via external client. For a given table(for example companies) and a given node number(for example worker 2 or other identifier), can I view…
Haohan Yang
  • 151
  • 1
  • 11
0
votes
1 answer

Would querying 60 columns from a Snowflake table would cost me more than querying 20 columns?

We are trying to find a less expensive way and more manageable way have our queries being stored and executed. One approach is to retrieve information from 60 columns every time someone queries and the other option is to make do with whatever…
randomuser99887766
  • 1
  • 1
0
votes
2 answers

Which replication mechanism to chose in distributed system?

Having tough time in understanding few things. I have two replicated service host (A & B) (may be scaled to a max 3 in future) behind a gateway. Each service host needs to save some data/state (key-value) of its respective host. To avoid SPOF, the…
Rahul
  • 326
  • 2
  • 10
0
votes
1 answer

What's the recommended way to use pg_dump/ysql_dump with YugabyteDB to export data when a table is still receiving inserts?

When this workload (SqlSecondaryIndex workload from https://github.com/YugaByte/yb-sample-apps/) is still running % java -jar yb-sample-apps.jar --workload SqlSecondaryIndex --nodes 127.0.0.1:5433 --num_threads_read 4 --num_threads_write 2 an…
Ricardo Adam
  • 115
  • 5
1 2 3
…
12 13