Questions tagged [distributed-filesystems]
128 questions
0
votes
0 answers
Any Open Source Linux Distributed Storage Options Which be Deployed inside Rented KVM VPSes Without Additional Virtual Disks?
I am trying to figure out a scalable and HA solution for storing live data under production workloads like DBs, web contents, etc.. Which can be installed and setup on standard rented Linux KVM VPSes. Which only have the virtual disk which it's…
Rickuku
- 344
- 1
- 5
0
votes
1 answer
GlusterFS - Define Failover Cluster
I am currently planning the storage infrastructure for our new application. Since performance is a big and important item on our list, I want to use SSDs for the production environment. We sell a product that generates a lot of data (image/video…
dr-ing
- 1
0
votes
1 answer
Change HDFS replication factor
I've changed replication factor from 3 to 2 for some directories with command:
hdfs dfs -setrep -R 2 /path/to/dir
but my HDFS free space still the same. Should I do something else to free my disks?
John Brown
- 1
- 1
0
votes
2 answers
How can I create or access a remote file as if it were local?
In general, I would like to run local programs on remote files provided to me via a distributed file system (e.g. samba, NFS or whichever you recommend), and I want to access the remote files in a way similar to accessing local files: something…
Tim
- 1,487
- 6
- 28
- 43
-1
votes
1 answer
Availability of big files on multiple servers
I have to handle many (1'000 - 30'000) big files ranging from 200MB up to 2GB. The demand for these files is variable (0 - 300 downloads / file). This is why a single file must saved on 2 or more servers.
My servers are placed in different…
Imises
- 11
- 1
-1
votes
1 answer
When looking for a good network connection speed, why does "bandwidth" not tell the whole story?
While I was listening in on an interesting conversation about distributed systems, I heard people talk about how overhead and "gap" were two important characteristics of distributed systems, and how bandwidth is not a good measure for the speed. Can…
Kaitlyn Mcmordie
- 147
- 6
-2
votes
1 answer
Are there any distributed transactional filesystem implementations that I can actually use?
I've been searching for distributed transactional filesystems so I don't have to make my own subpar implementation.
I've only come across two:
Warp Transactional Filesystem - The website is no longer up, and the source code is not production-ready…
David Callanan
- 121
- 4
-3
votes
1 answer
What file systems are dominantly used in data centers?
I would like to know what file systems are typically used in data centers and how do their performance compare to ext3/4 file system?
Divija Gogineni
- 21
- 2