Stack Overflow
Stack Overflow

Questions tagged [sqoop2]

SQOOP2 is the 2nd generation version of SQOOP. DO NOT USE this tag for SQOOP questions. Use the sqoop tag instead. SQOOP2 was designed to fix the tight coupling that SQOOP has with Hadoop. But as of Nov 2017 is no longer actively maintained.

From Upgrading Sqoop 2 from an Earlier CDH 5 Release

Note: Sqoop 2 is being deprecated. Cloudera recommends using Sqoop 1.

References

176 questions
2
votes
2 answers

Sqoop Installation with hadoop 2.2.0?

I am trying to install all apache hadoop components in my system. I installed hadoop-2.2.0, hive-0.11.0, pig-0.12.0, hbase-0.96.0, now its time to install sqoop. So please suggest me installation steps of sqoop which is compatable with hadoop-2.2.0…
Sai Pavan
  • 73
  • 1
  • 9
2
votes
2 answers

What is the syntax for starting a sqoop2 job?

i've set up a sqoop2 job, and i'm trying to start it like so: ~]$ sqoop2 Sqoop home directory: /usr/lib/sqoop2 Sqoop Shell: Type 'help' or '\h' for help. sqoop:000> submission start Exception has occurred during processing command Unknown command:…
blueberryfields
  • 45,910
  • 28
  • 89
  • 168
1
vote
0 answers

sqoop2 job run error that Table 'api_open_platform.input_data' doesn't exist

I use sqoop2 to extract data from MySQL. I have set the Schema name when I create a job, but when I run the job, sqoop2 uses the first Schema name in MySQL rather than I set. this is the setting when I create a job Schema name:…
L.Ming
  • 71
  • 1
  • 1
  • 7
1
vote
0 answers

is there any way to import all tables not views from RDBMS to hive using sqoop

I m trying to import 800 tables from SQL server to hive using sqoop import-all command, i have some views and some tables in SQL database i want to import only tables not views in hive using sqoop also when i m doing it with import all command if…
Rahul
  • 11
  • 1
1
vote
1 answer

How to send beeline output to sqoop

I am struggling to send beeline output to apache sqoop tool. I guess Apache sqooop can read data from where data sits on Hadoop cluster.But beeline can query data and output the data into where hadoop client is running. Is it possible to send…
UtpMahesh
  • 410
  • 10
  • 25
1
vote
0 answers

Why sqoop incremental job not saving last updated value in metastore?

I am using sqoop to import data from Oracle to HDFS. I am importing around 30 tables on daily basis(Incremental). Today I just found that my sqoop job is not saving last updated value in metastore. It is daily using save column value for incremental…
Raj
  • 429
  • 2
  • 6
  • 26
1
vote
1 answer

Oozie solution to execute a query and get results back from sql & Hive

I am trying to solve the below problem using oozie. Any suggestions about solution are much appreciated. Back ground : I had developed a code to import data from SQL database using (oozie - Sqoop import) and done some transformation and loaded the…
vinu.m.19
  • 495
  • 2
  • 8
  • 16
1
vote
0 answers

How to add two extra custom column in Sqoop Export

I am exporting records from S3 to Aurora and while exporting i need to add custom value to the Aurora tables . Current data time Name of the file from which data is loaded in the table . For example i have below record coming from File1.txt then…
Atharv Thakur
  • 671
  • 3
  • 21
  • 39
1
vote
1 answer

Sqoop Eval to run multiple queries?

Can we run multiple sql queries using Sqoop eval function? For example: sqoop eval -D mapreduce.job.queuename=NONP.XXXX --connect "jdbc:sqlserver://ee-dev/cloud.net:1433;database=sqlserver1" --username XXXX --password ABC --query 'drop table if…
Sai
  • 97
  • 1
  • 2
  • 17
1
vote
1 answer

SQOOP Export to MySQL

Trying to do sqoop export from HDFS to MYSQL. Getting mapper error because of different date format between input file vs MySQL. Input file have data in mm/dd/yyyy format where in SQL it is date. I guess MySQL is yyyy-mm-dd. Because of same getting…
Amit
  • 11
  • 2
1
vote
1 answer

How to capture the count of processed records from Sqoop import?

To replicate the data from my DB to S3 I am using below command. sqoop import -D mapreduce.job.name= xxx-D mapred.job.queue.name=user -Dhadoop.security.credential.provider.path= -Dfs.s3a.server-side-encryption-algorithm=--options-file…
LUZO
  • 1,019
  • 4
  • 19
  • 42
1
vote
1 answer

SQOOP Server started but getting an error command not found

I am using ubuntu version 16.04 harsha@ubuntu:~$ lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 16.04.3 LTS Release: 16.04 Codename: xenial I was able to start sqoop server and sqoop shell but in the…
Harsha
  • 11
  • 3
1
vote
1 answer

Import the all tables from RDBMS using sqoop

I am trying to import data from testing mysql database to hadoop using sqoop. But in some tables having primary and some tables does not have primary key. $sqoop import-all-tables --connect jdbc:mysql://192.168.0.101/mysql -username test -P…
DevPerson
  • 137
  • 1
  • 4
  • 12
1
vote
1 answer

Sqoop error on data fetch from Oracle Database using Oracle wallet

sqoop import -D mapred.map.child.java.opts='-Doracle.net.tns_admin=. -Doracle.net.wallet_location=.' -files $HOME/wallet/cwallet.sso,$HOME/wallet/ewallet.p12,$HOME/wallet/sqlnet.ora,$HOME/wallet/tnsnames.ora --connect jdbc:oracle:thin:@TEST2 --table…
onlyvinish
  • 435
  • 1
  • 5
  • 20
1
vote
1 answer

sqoop2 not finding log4j2 from hadoop

I am trying to install sqoop2 (1.99.7) on my ubuntu server. I am trying to follow the instructions provided on the apache website here. I have a working hadoop installation and I have downloaded and extracted the sqoop file to the /usr/local/sqoop…
cdeterman
  • 19,630
  • 7
  • 76
  • 100
1 2
3
…
11 12