Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [sharding]

51 questions
1
vote
0 answers

ElasticSearch not starting properly

On startup, our ElasticSearch server throws aJava exception I can see in the elasticsearch.log: [2019-02-27T15:51:59,908][WARN ][o.e.m.j.JvmGcMonitorService] [KibjtLy] [gc][young][263][19] duration [4.1s], collections [1]/[4.4s], total…
Alexis Dufrenoy
  • 235
  • 1
  • 3
  • 11
1
vote
1 answer

On-prem DBs sync’d across multiple global sites?

My organization has two North American offices that are close enough to share a single web app server and database with minimal latency. However, we’re opening an office in India and that amount of latency is not acceptable. It has to be hosted…
Scott
  • 111
  • 3
1
vote
1 answer

Advice on sharding the Parse Server _User collection?

The out-of-the-box _User collection in Mongo for Parse Server has a unique index on both username and email. Given that, what's the ideal strategy for sharding this collection? My initial plan was to just use _id (not hashed) but obviously that…
andrew.w.lane
  • 11
  • 2
1
vote
2 answers

Is it possible to shard postfix virtual mailboxes database?

I've managed to configure Postfix to read virtual mailboxes list out of a database. But what if my list is distributed among multi databases? Is there any way to set Postfix's database access credentials based on the incoming email's destination…
Mehran
  • 519
  • 1
  • 5
  • 20
1
vote
1 answer

mongo shard has high number of faults, but top shows only 8% of memory used by mongod

I am investigating some performance issues in my mongo setup. I have 3 query controllers and 6 shards. I'm doing a large batch import/update, and on the 3 query controllers, I'm getting around 200 queries per second. However, when investigating…
user1130176
  • 173
  • 1
  • 10
1
vote
0 answers

Merge 7 node mongodb (2.4) cluster into one standalone mongo shard

I'm running a 7 node mongodb sharded cluster (version 2.4...). I would like to merge this into a standalone shard with 7 times the disk-space. I've tried to create the single shard instance and running: db.copyDatabase('dbname', 'dbname',…
Lasse Aagren
  • 11
  • 1
1
vote
2 answers

Rename Mongo Shard

Can I, and if I can, how can I rename a shard in Mongo? Like if I wanted to change the instances of rs0 to rep0 below: mongos> sh.status() --- Sharding Status --- sharding version: { "_id" : 1, "version" : 4, "minCompatibleVersion" :…
HeySteve
  • 23
  • 1
  • 4
1
vote
1 answer

MongoDB Balancer

So I have 2 sharded clusters with 3 servers each.My mongos is running, my config server is running and ive also added test data to 1 of the 2 shard clusters. I am having trouble getting that data to migrate to the other cluster... While looking at…
secure212
  • 228
  • 1
  • 3
  • 10
1
vote
1 answer

Why mongo pecl module looses its connection after Primary stepDown?

I run an Apache 2.2.22-13 with pecl module "mongo 1.4.4". It connects to a MongoDB 2.4.6 sharded cluster. When a stepDown occurs, the mongo module seems to stay on the mongod node which was the primary and says: "PHP Fatal error: Uncaught exception…
Icu
  • 1,425
  • 3
  • 16
  • 25
1
vote
1 answer

ASP.NET, reaching the limits of DFSR, and file storage sharding

We run a popular web app, and our backend file storage exists on a file server, replicated to another file server for failover with DFSR. We are reaching the theoretical limits of DFSR, and therefore need to start looking at sharding our…
Ken Randall
  • 143
  • 1
  • 6
1
vote
1 answer

How to "unshard" an existant collection in mongo?

While setting up some collections in a mongo database to be sharded, I entered the name of one of them wrong (typo letter at the end). When I do db.printShardingStatus(), I see that inexistent collection sitting there and looking dumb. How can I…
Pierre
  • 241
  • 1
  • 2
  • 11
1
vote
1 answer

Multiple databases on Mysql crashes the mysql server often

We are running Mysql on CentOS 5.5. And are using the database sharding approach. As it is an erp app, there are about 300 tables for each new Application/company. At the moment we have around 600 databases in our mysql server. (250 GB, 24 GB Ram)…
Software Mechanic
  • 231
  • 1
  • 9
1
vote
3 answers

How to automatically move specific MySQL tables from one machine to another?

I have a MySQL database with tables in the form of "shard_0", "shard_1", "shard_2", etc. I want to add another DB server and move the even-numbered shards ("shard_0", "shard_2", "shard_4", ...) to the new machine. How do I do that? There are many…
Continuation
  • 3,080
  • 5
  • 30
  • 38
1
vote
5 answers

I have to shard a mysql database. I want to start with 12 shards on 2 machines. What is the best way to move some of them when I want to add a new server?

All tables are InnoDb. I would rather not use mysqldump, because the shard sizes will be about 200 GB (about 700 million rows), and that will take too long. I was hoping to just stop mysql for an hour, copy the data files to a new machine, and…
Tim
  • 71
  • 4
1
vote
0 answers

MongoS refusing connections during network split

I am exploring sharded MongoDB clusters, and I have trouble understanding MongoS's behavior during a network split. My test environment works as expected until I simulate a network split. In the "smallest" network partition, I have: N MongoS…
Nick Turner
  • 11
  • 4
1
2
3 4