Questions tagged [replication]

The use of redundant resources to improve reliability, fault-tolerance, or performance.

Replication is the process of sharing information so as to ensure consistency between redundant resources, such as software or hardware components, to improve reliability, fault-tolerance, or accessibility.

It could be data replication if the same data is stored on multiple storage devices, or computation replication if the same computing task is executed many times.

A computational task is typically replicated in space, i.e. executed on separate devices, or it could be replicated in time, if it is executed repeatedly on a single device.

The access to a replicated entity is typically uniform with access to a single, non-replicated entity. The replication itself should be transparent to an external user. Also, in a failure scenario, a failover of replicas is hidden as much as possible.

More info on Wikipedia

3869 questions
18
votes
1 answer

Apache Solr: Slave replicates 10+ times every time it polls (excessive commits?)

We're using Apache Solr (3.1.0) to index a lot of articles written for multiple sites. We have a master/slave setup (replication config at the bottom), where server 1 indexes the articles, and server 2 replicates the index. The slave should poll the…
18
votes
2 answers

Postgres Hot Standby and Long Running Queries On Slave

Question: Can you have long running queries (30s+) running while having WAL updates applied on the slave (the slave role is as a Reporting DB Server) in a Hot Standby mode? The way it's working now is, either you set the params below to kill long…
user1178516
  • 651
  • 1
  • 6
  • 9
18
votes
2 answers

How can "set timestamp" be a slow query?

My slow query log is full of entries like the following: # Query_time: 1.016361 Lock_time: 0.000000 Rows_sent: 0 Rows_examined: 0 SET timestamp=1273826821; COMMIT; I guess the set timestamp command is issued by replication but I don't understand…
Peder
  • 2,739
  • 3
  • 31
  • 33
17
votes
1 answer

Solr indexing - Master/Slave replication, how to handle huge index and high traffic?

I'm currently facing an issue with SOLR (more exactly with the slaves replication) and after having spent quite a few time reading online I find myself having to ask for some enlightenment. - Does Solr have some limitation in size for its…
Fanny H.
  • 755
  • 1
  • 7
  • 18
17
votes
5 answers

How do I fix a PostgreSQL 9.3 Slave that Cannot Keep Up with the Master?

We have a master-slave replication configuration as follows. On the master: postgresql.conf has replication configured as follows (commented line taken out for brevity): max_wal_senders = 1 wal_keep_segments = 8 On the…
Oleg Dulin
  • 1,379
  • 4
  • 13
  • 23
17
votes
3 answers

Starting over with replica configuration in mongodb

I did a mistake when configuring replica sets in mongodb. I think that what I did wrong is that I did a rs.initialize() on both nodes, which made them confused in some way. I'm not sure. Now all I want to do is start over, but I couldn't find a way…
obeq
  • 675
  • 1
  • 4
  • 14
16
votes
5 answers

Replication vs Redundancy

I am currently reading about Distributed Systems and I am facing two different terms which are described in a similar manner: Replication and Redundancy. Can anyone explain each term in part?
Dina Bogdan
  • 4,345
  • 5
  • 27
  • 56
16
votes
4 answers

How to replicate array to specific length array

I want replicate a small array to specific length array Example: var = [22,33,44,55] # ==> len(var) = 4 n = 13 The new array that I want would be: var_new = [22,33,44,55,22,33,44,55,22,33,44,55,22] This is my code: import numpy as np var =…
delta27
  • 197
  • 1
  • 7
16
votes
2 answers

What is maximum Amazon S3 replication time on file upload?

Background We use Amazon S3 in our project as a storage for files uploaded by clients. For technical reasons, we upload a file to S3 with a temporary name, then process its contents and rename the file after it has been processed. Problem The…
16
votes
2 answers

Mongodb replica set status showing "RECOVERING"

I have setup the replica set over 3 mongo server and imported the 5 GB data. now status of secondary server showing "RECOVERING". Could you let me know what is means for "RECOVERING" and how to solve this issue. Status is as below rs.status() { …
rajub
  • 320
  • 1
  • 5
  • 17
16
votes
6 answers

Efficiently replicate matrices in R

I have a matrix and look for an efficient way to replicate it n times (where n is the number of observations in the dataset). For example, if I have a matrix A A <- matrix(1:15, nrow=3) then I want an output of the form rbind(A, A, A, ...) #n…
16
votes
4 answers

Has anyone figured out how to scale Amazon RDS read replicas?

I've recently set up a read replica to take some of the read load off of my Amazon multi-AZ RDS instance. The Amazon documentation clearly states that it is "up to your application to determine how read traffic is distributed across your read…
TomBomb
  • 3,236
  • 5
  • 31
  • 40
14
votes
5 answers

How do you retrieve the replication factor info in Hdfs files?

I have set the replication factor for my file as follows: hadoop fs -D dfs.replication=5 -copyFromLocal file.txt /user/xxxx When a NameNode restarts, it makes sure under-replicated blocks are replicated. Hence the replication info for the file is…
brain storm
  • 30,124
  • 69
  • 225
  • 393
14
votes
1 answer

Check replication type mysql

I want to check the replication type for my master-slave setup that whether it is row based or statement based.. how can I do this? I am using mysql 5.6
Arry
  • 1,630
  • 9
  • 27
  • 46
14
votes
5 answers

mysql replication skip statement. is it possible?

There is a system with ROW-based replication. Yesterday i have executed a heavy statement on my master accidently and found my slaves far behind master. I have interrupted the query on master, but it was still running on slaves. So i got my slaves…
Volodymyr Linevych
  • 365
  • 1
  • 4
  • 11