Is there a way to copy data from Gateway node in Cluster1 directly to HDFS of Cluster 2 when in same network.Currently I am doing scp to gateway node of Cluster 2 and uploading data to HDFS.
Thanks,
Asked
Active
Viewed 1,044 times
1 Answers
1
You could try something like this:
hadoop fs -put [local_file] hdfs://[namenode2]:[namenode2_port]/[path]
Assuming:
- [local_file] is the file in gateway node in cluster 1
- [namenode2] is the namenode of cluster 2
- [namenode2_port] is the namenode port of cluster 2
- [path] is the path in hdfs to put the file
Ashrith
- 6,745
- 2
- 29
- 36
-
Currently I am getting connection refused when I use the above command. Is there a different command to run this? – darkknight444 Nov 11 '14 at 08:16
-
:hadoop fs -ls hdfs://[namenode2]:[port]/ . So, I get a Connection refused message when I do this command. – darkknight444 Nov 11 '14 at 17:49
-
Could you telnet for the port,and check whether the port is open – Subash May 03 '18 at 23:38