For programming questions about Microsoft's Distributed File System (DFS). (For questions about depth-first search, use the [depth-first-search] tag.)
Questions tagged [microsoft-distributed-file-system]
176 questions
1
vote
0 answers
how can I script a loop through DFS folders and delete files in a "temp" folder?
I am trying to come up with a script to loop through all of the folders in my DFS environment and if the folder name is "Temp" then I want the script to delete all files in that folder older than 5 days of age.
This is what I was trying thus far…
BSanders
- 295
- 1
- 6
- 29
1
vote
0 answers
How to view corrupted files Hadoop?
I have some corrupted files on my Hadoop machine and I want to transfer them to another computer and see what is in them.
I tried to do hadoop fsck -copyToLocal /dir1/ /dir2/. It gives nothing. When I do hadoop fs -copyToLocal /dir1/ /dir2/ or…
Oleg
- 11
- 1
1
vote
2 answers
Read a properties file from HDFS
I'm trying to read a Java properties file that is on HDFS like this:
try {
properties.load(new FileInputStream("hdfs://user/hdfs/my_props.properties"));
} catch (IOException e) {
throw new RuntimeException("Properties file not…
user2727704
- 625
- 1
- 10
- 21
1
vote
1 answer
java eclipse hadoop map reduce program unable to access my files stored in hdfs
My java eclipse hadoop map reduce program is displaying an error unable to locate the input file. I had copied the files to hadoop directory via terminal using hadoop commands. I can see the files in java eclipse dfs location. And also using the…
Roshan V Jose
- 21
- 4
1
vote
1 answer
How to maintain values in recursive calls?
Let us su[ppose,we have a bidirectional graph as shown below
Now, it's DFS Traversal from source 8 will be 8 1 2 3 6 7 4 5.
The recursive implementation
vector v[10001];
bool visited[10001];
void DFS(int s)
{
visited[s]=true;
cout<
techriften
- 421
- 2
- 16
1
vote
0 answers
hadoop dfsadmin -report not giving all the datanodes
I have a hdoop cluster of 6 nodes.
I node is a master nodes. All the nodes, including master node, are running TaskTracker & DataNode.
The command
hadoop dfsadmin -report
Return only 3 data nodes including the DataNode running at master node.…
Tariq
- 2,274
- 4
- 24
- 40
1
vote
1 answer
Running Yarn in Managed Mode
I am trying to run the simple-yarn-app at https://github.com/hortonworks/simple-yarn-app in the Managed Mode.
I have copied the jar from local to hdfs like
$ hadoop fs -copyFromLocal simple-yarn-app-1.0-SNAPSHOT.jar…
Prasanna
- 2,593
- 7
- 39
- 53
1
vote
0 answers
How can I get a WCF service to copy a file to a destination on another domain?
We have a WCF service that is meant to copy an existing file from its host server to a folder on another server on a different domain (using a UNC path). We were able to do this using delegation (using LogonUser() imported from ADVAPI32.dll).
The…
yelxe
- 186
- 1
- 7
1
vote
1 answer
DFS-R RemoveDeletedFiles property cannot be set from Powershell
Using Powershell v4.0 as included in Windows Server 2012 R2 it is possible for me to setup DFS-R except for one detail. I cannot get the RemoveDeletedFiles property to become True. No error or warning is reported by the cmdlet, but it does not seem…
Basdoorn
- 11
- 1
1
vote
0 answers
Find active unc path for a DFS target with NetDfsGetInfo
I'm using the NetDfsGetInfo example from pinvoke.net! to find the active unc path for a DFS target. If I call the sub DFSInfo with a DFS path which has two targets I get back that both targets are active. I have searched the internet and found a…
user3557816
- 11
- 3
1
vote
1 answer
Hadoop showing old version despite latest version installation
I am trying to install hadoop in my ubuntu OS. I followed each and every step exactly from this link Hadoop Install Tutorial and everything was going as expected until i tried to run
$ start-dfs.sh and $ hadoop jar…
userRandom
- 160
- 2
- 13
1
vote
0 answers
Web Server Accessing DFS Share
I'm using the following code in a VB6 DLL (Middleware on an ASP Classic Site) to create a drive mapping to a network share in order to copy files to and fro:
Set ws = CreateObject("WScript.Network")
ws.MapNetworkDrive strDrive, strPath, False,…
TrevorBest
- 71
- 2
1
vote
1 answer
Visual Studio 2012 Freezes while adding a new ASP.NET MVC Controller
My MVC 4 project is located on Distributed File System (DFS). Everything works like a charm, but recently I found that creating a controller (right click on Controllers -> Add - > Controller...) freezes VS. After a while popup shows "VS is busy..."…
Kenan Zahirovic
- 1,587
- 14
- 24
1
vote
1 answer
File sync or replication
What is the easiest way to sync or replicate files over a network? I am running a few servers in a rack for load balancing and wish to mirror content.
For example, I have Server 1 where I do my FTP uploads to. Server 2 is another node. The manual…
darnpunk
- 415
- 1
- 5
- 13
1
vote
2 answers
How to create a new DFS folder without any targets using PowerShell
I'm trying to create a folder hierarchy for my projects using Powershell. The main project folder will not be connected to a target. The subfolders will be connected to targets on four different servers.
\\domain\production…
user2917291
- 21
- 1
- 3