How to import MySQL data to Hadoop file system?

Question

In my system I have database in Mysql. I want to import that to hadoop file system. I found something about Sqoop, but i'm not getting command to do that.

Here is the answer on other thread.: http://stackoverflow.com/questions/10631957/save-data-into-mysql-from-hive-hadoop-through-sqoop/34019965#34019965 — Durga Viswanath Gadiraju, Dec 03 '15 at 11:21

Akash Garg · Accepted Answer · 2015-12-03T11:58:57.903

2

sqoop import --connect jdbc:mysql://mysql-server-name/db_name --username user --password password --table table_name --target-dir target_directory_name -m1

Hope it helps..

edited Dec 03 '15 at 11:58

answered Dec 03 '15 at 09:05

Akash Garg

46
1
1
7

score 0 · Answer 2 · edited May 23 '17 at 12:16

0

You need to install mysql jdbc/java connector and run sqoop command.

sudo yum install mysql-connector-java
ln -s /usr/share/java/mysql-connector-java.jar /var/lib/sqoop/mysql-connector-java.jar

You can run sqoop command from Save data into mysql from hive hadoop through sqoop?

edited May 23 '17 at 12:16

Community

1
1

answered Dec 03 '15 at 11:26

Durga Viswanath Gadiraju

3,896
2
14
21

score 0 · Answer 3 · answered Dec 03 '15 at 13:28

1) Install & configure MySQL first. Create database in MySQL

2) sqoop import --connect jdbc:mysql://localhost/databasename --username $USER_NAME --password $PASSWORD$ --table tablename --m 1 command will import data.

e.g.

sqoop import --connect jdbc:mysql://localhost/testDb --username root --password hadoop123 --table student --m 1

In above command, values of various parameters database:‘testDb’ , username: ‘root’, password: ‘hadoop123’, and table student.

Have a look at this article 1 and article 2 for better understanding in step-by-step manner

How to import MySQL data to Hadoop file system?

3 Answers3