How to Delete a directory from Hadoop cluster which is having comma(,) in its name?

Question

I have uploaded a Directory to hadoop cluster that is having "," in its name like "MyDir, Name" when I am trying to delete this Directory by using rmr hadoop shell command as following

hadoop dfs -rmr hdfs://host:port/Navi/MyDir, Name

I'm getting the following messages rmr: cannot remove hdfs://host:port/Navi/MyDir,: No such file or directory. rmr: cannot remove Name: No such file or directory.

However I have successfully deleted other Directories from the same location, using the same command i.e.

hadoop dfs -rmr hdfs://host:port/dir_path

any solutions to delete such kind of Directories.

It's not the comma, it's the space character beind it. Placing your argument inside quotes will help. — rsp, Nov 23 '12 at 15:36
yes @rsp there was space too after comma, i have used the following command to delete this directory successfully "hadoop dfs -rmr hdfs://host:port/Navi/MyDir\,\ Name" it works. — java_dev, Nov 24 '12 at 05:41
The `\` in the command line escape the comma (unnecessary) and the space. Using quotes will escape any character needed, both will work. — rsp, Nov 24 '12 at 09:25

score 96 · Accepted Answer · edited Aug 10 '18 at 14:26

96

Have you tried :

hadoop dfs -rmr hdfs://host:port/Navi/MyDir\,\ Name?

edited Aug 10 '18 at 14:26

HISI

4,557
4
35
51

answered Nov 23 '12 at 13:15

gega

984
7
3

42

this is deprecated it should be " hadoop fs -rm -r " – Hasan Al-Natour Jul 08 '15 at 19:04
28

or shorter `hdfs dfs -rm -r ` – Romain Feb 15 '18 at 07:43

score 79 · Answer 2 · edited Feb 23 '16 at 05:43

79

Or if you dont know the url, you can use

hadoop fs -rm -r -f /user/the/path/to/your/dir

edited Feb 23 '16 at 05:43

prasun

7,073
9
41
59

answered Sep 26 '14 at 11:43

Jeyhun Karimov

1,295
19
27

2

do you mean hadoop fs -rmr -f /user/the/path/to/your/dir? – Avinash Feb 03 '15 at 07:19
10

"-rmr" is deprecated in Hadoop 2.6. The answer stating "-rm -r" is alright. – ffarquet Mar 20 '15 at 13:37

score 24 · Answer 3 · answered Dec 10 '16 at 09:40

24

hdfs dfs -rm -r /path/to/directory

answered Dec 10 '16 at 09:40

koders

5,654
1
25
20

score 9 · Answer 4 · answered Oct 16 '18 at 04:39

9

Run the command in the terminal

$hadoop fs -rm -r /path/to/directory

answered Oct 16 '18 at 04:39

Arefe

11,321
18
114
168

Ani Menon · Answer 5 · 2017-11-30T06:03:44.213

5

In hadoop1.0:

hadoop fs -rmr /PATH/ON/HDFS

In hadoop2.0:

hdfs dfs -rm -R /PATH/ON/HDFS

Use \ to escape , in path

edited Nov 30 '17 at 06:03

answered Dec 19 '16 at 10:10

Ani Menon

27,209
16
105
126

score 4 · Answer 6 · edited Feb 23 '16 at 05:46

4

Here you can find all hadoop shell commands:

deleting: rmr Usage: hadoop fs -rmr URI [URI …]

Recursive version of delete.

Example:

hadoop fs -rmr /user/hadoop/dir
hadoop fs -rmr hdfs://nn.example.com/user/hadoop/dir

Exit Code:

Returns 0 on success and -1 on error.

edited Feb 23 '16 at 05:46

prasun

7,073
9
41
59

answered Feb 08 '14 at 12:53

user2531037

126
3

score 2 · Answer 7 · edited Feb 23 '16 at 05:44

2

Try hadoop dfs -rm -r hdfs://host:port/Navi/MyDir\,\ Name now

edited Feb 23 '16 at 05:44

prasun

7,073
9
41
59

answered Apr 17 '15 at 19:34

Akarsh

389
5
15

score 1 · Answer 8 · edited Feb 23 '16 at 05:42

1

$ hadoop fs -rmdir {directory_name}

edited Feb 23 '16 at 05:42

prasun

7,073
9
41
59

answered Feb 21 '16 at 02:33

Candice

181
5

Moshih Hsü · Answer 9 · 2018-10-01T21:15:30.103

1

Or you can: hadoop fs -rm -r PATH

Hint: if you enter: hadoop fs -rmr PATH you would mostly get:Please use 'rm -r' instead.

edited Oct 01 '18 at 21:15

answered Sep 30 '18 at 18:00

Moshih Hsü

11
4

How to Delete a directory from Hadoop cluster which is having comma(,) in its name?

9 Answers9