For programming questions about Microsoft's Distributed File System (DFS). (For questions about depth-first search, use the [depth-first-search] tag.)
Questions tagged [microsoft-distributed-file-system]
176 questions
1
vote
1 answer
Unexpected behavior when opening a file stream in a PowerShell script
I am trying to create a script that appends (or creates, then appends) to an existing file. This file is being interfaced to from another system, so in order to avoid a situation where the file is being read while I'm appending to it, I'm creating a…

Cpu1
- 77
- 8
1
vote
1 answer
DFS Locking ASP.Net DLL's through FTP
I am having an ongoing situation where when I try to upload files via FTP that I get an error that the DLL is locked and currently cannot be overwritten. This is only DLLs that this is happeneing to and normal files (aspx, ascx, css etc) can be…

Chris Lomax
- 137
- 2
- 12
1
vote
1 answer
Hadoop HDFS: How to set hostname:9000 instead of localhost:9000
How can I set the IP address that Hadoop HDFS should listen on? Currently, when I run netstat I see its on 127.0.0.1:9000. This makes access HDFS impossible from another node in the cluster. I get connection refused error when running application.
I…

nikk
- 2,627
- 5
- 30
- 51
1
vote
0 answers
Cannot access file because it is being used by another process : DFSR
I’m getting an error with my single thread C# 4.0 desktop application.
When I try to save a file, I’m getting the following error :
The process cannot access the file because it is being used by another
process.
We have turned off DFSR in order…

chocoporto
- 69
- 5
1
vote
1 answer
HDFS block creation
I would like to how does a block gets created. Does it create 64MB blocks by default on the filesystem or creates based on the file transfer activity
Assume i have setup a 10 node cluster setup. I am installing hadoop on all the nodes. how does…

Karthi
- 708
- 1
- 19
- 38
1
vote
0 answers
Error while stating hadoop namenode in windows for command hadoop namenode -format
I got error while executing this command to start the namenode.
c:\hadoop-2.3.0\bin>hadoop namenode -format
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
Exception in thread…

ddd
- 13
- 5
1
vote
2 answers
Can I use DFS with the new Azure File Storage
From on-premises DFS, can I include a share from the new Azure File Storage?

Dave
- 1,822
- 2
- 27
- 36
1
vote
1 answer
DFS Used%: 100.00% Slave VMs down in Hadoop
My slave VMs went down and I guess it's because DFS used is 100%. Can you please give a systematic approach as how to solve this problem? Is it a firewall problem? capacity problem or what could cause it and how can be fixed?
ubuntu@anmol-vm1-new:~$…

Mona Jalal
- 34,860
- 64
- 239
- 408
1
vote
2 answers
Exception in createBlockOutputStream java.io.IOException: Bad connect ack with firstBadLink
Any idea why I am getting this error? 10.0.1.193 is one of my slave VMs.
ubuntu@anmol-vm1-new:/home/hadoop/yarnpp$ hadoop fs -put tez-0.4.1-incubating/* /apps/tez-0.4.1-incubating
15/11/30 02:53:28 WARN util.NativeCodeLoader: Unable to load…

Mona Jalal
- 34,860
- 64
- 239
- 408
1
vote
0 answers
Memcached clustering with zero downtime
I am having problems in applying memcached clustering in my multi-tenant system. Actually I have applied memcached as my first phase of project - the result is my system is has been supported by two tomcat instances, if one fails second tomcat…

Shraddha Seth
- 11
- 2
1
vote
0 answers
Permission denied when starting hadoop
I'm trying to run Hadoop 2.7.1 on Centos 7.
When I'm invoking script start-dfs.sh, I'm getting following error:
localhost: starting datanode, logging to /usr/bin/hadoop/logs/hadoop-hadoop- datanode-localhost.localdomain.out
localhost: nice:…

bongo
- 11
- 5
1
vote
2 answers
get DFS/UNC info progromatically - Java
Ok I'll try and keep this short.
First let me explain exactly what I am trying to get. If you open Windows Explorer and go to a network drive there is a DFS tab there(must have DFS enabled VIA the servers on the network so it may not be there).
In…

reddragon72
- 191
- 1
- 3
- 16
1
vote
1 answer
Publishing DFS replication to a Namespace
I'm creating a chef cookbook which runs on 2 Windows boxes
Turns on DFS Windows feature
Creates a folder and sets it up for replication
Creates a Replication Group and registers it to the ActiveDirector
The recipes are calling PowerShell commands…

Adam Ocsvari
- 8,056
- 2
- 17
- 30
1
vote
1 answer
Is Cassandra suitable enough for storing logs in term of disk space usage?
I've a problem storing 50Gb of logs each day in a distributed environment. I looked at Hadoop HDFS but because it has problems running on Windows infrastructure, lack of multi language filesystem API it doesn't suit me very well. Cassandra on the…

sha1dy
- 980
- 2
- 11
- 27
1
vote
2 answers
Why this DFS code is not working in some cases?
According to above picture DFS should be: 0 1 3 5 4 2 but it's returning 0 1 3 5 2 (This is happening only for one case. What I am doing wrong here?)
code:
import java.util.Stack;
public class DFSDetectCycleSelf {
static int arr[][] = {
{…

Amit Pal
- 10,604
- 26
- 80
- 160