Any file system that allows access to files from multiple hosts sharing via a computer network making it possible for multiple users on multiple machines to share files and storage resources.
Questions tagged [distributed-filesystem]
56 questions
0
votes
1 answer
Use zookeeper to distribute files over cluster
I have an API which creates a file based on user input. I need to distribute this file over a cluster, such that 1 file should be on 1 node only. Can I use zookeeper to achieve this, and how?
A user may want to delete the file. Which means that…
wittyameta
- 375
- 1
- 3
- 16
0
votes
1 answer
Does virtual file system lie on top of distributed file systems?
In Linux kernel, the virtual file systems lies on top of concrete file systems and device files, to provide a uniform interface to access those lying below it.
Do distributed file systems lie below or above the virtual file system in each computer?…
Tim
- 1
- 141
- 372
- 590
0
votes
1 answer
NAS vs Distributed File Systems
What are the use cases when should we prefer over any distributed file system like HDFS? How to decide which one to use or any other comparable alternative?
ptntialunrlsd
- 794
- 8
- 23
0
votes
1 answer
std::ifstream accesses network files in mac osx
How can I open a network shared file in OSX? I tried with and without "cifs:". also tried "192.168.xxx.xxx" but not working. thanks.
const std::string path_name("cifs://netshare.local/data/config.txt");
std::ifstream file( path_name.c_str(),…
kc2
- 207
- 3
- 12
0
votes
2 answers
Distributedfilesystem class use local instead of distributed classes
I have this line in my code:
DistributedFileSystem.get(conf).delete(new Path(new URI(otherArgs[1])), true);
otherArgs[1] has this value: hdfs://master:54310/input/results
I receive this exception:
Exception in thread "main"…
user259632
- 101
- 5
0
votes
1 answer
LVM versus Lustre File System
We have to build a large scalable filesystem.
Since LVM and Lustre both can provide dynamic scaling of file system size,
I wanted to know the relative advantages and disadvantages of LVM vs Lustre File system.
Thanks in advance.
hrs
- 487
- 5
- 18
0
votes
1 answer
Ceph: mount failed: Numerical argument out of domain
Due to this problem, my friend found the Open Fusion repo that included the ceph.
ceph-fuse is installed without problem:
# ceph -v
ceph version 0.27.1 (commit:44900d4c13f02913b3347cac3e1dc33632d5b8ff)
You have new mail in /var/spool/mail/root
But…
quanta
- 3,960
- 4
- 40
- 75
0
votes
1 answer
Compiling Ceph on CentOS 5: `doc_DATA' is used but `docdir' is undefined?
Has anyone sucessfully compiled Ceph on the CentOS 5?
[user@host ceph-0.56.4]# make
...
checking boost/spirit.hpp usability...
src/Makefile.am:1115: `doc_DATA' is used but `docdir' is undefined
make: *** [Makefile.in] Error 1
make: *** Waiting for…
quanta
- 3,960
- 4
- 40
- 75
0
votes
1 answer
How Kosmos File System (KFS) handle reflection?
Happy Easter!
I am writing an distributed file system in C++. And, for control it fully, I wrote my own RPC. The last pending question for this RPC framework is reflection, as C++ doesn't provide it.
I know KFS is a DFS written in c++, but I don't…
eltonsky
- 367
- 2
- 11
-1
votes
1 answer
Spark reading from distributed file system?
Say I have data(user events) stored in distributed file system like S3 or HDFS. User events are stored in a directory date wise.
Case 1
Consider that spark job need to read the data for a single day.
My understanding is that single spark job will…
user3198603
- 5,528
- 13
- 65
- 125
-1
votes
2 answers
Fast distributed file system for small file
Our company has five million users. We store user's code files. Users can edit and add their files, just like web IDE, the web IDE list users's file. We use PHP functions to implement these operations, such as readdir, file_get_contents and…
Huangby
- 11
- 3