Stack Overflow
Stack Overflow

Questions tagged [sqoop2]

SQOOP2 is the 2nd generation version of SQOOP. DO NOT USE this tag for SQOOP questions. Use the sqoop tag instead. SQOOP2 was designed to fix the tight coupling that SQOOP has with Hadoop. But as of Nov 2017 is no longer actively maintained.

From Upgrading Sqoop 2 from an Earlier CDH 5 Release

Note: Sqoop 2 is being deprecated. Cloudera recommends using Sqoop 1.

References

176 questions
0
votes
0 answers

Sqoop import count differs (source vs destination)

while sqooping (import) if the source table is getting updated, then does sqooped output row count is source table count at t=sqoop_start or t=sqoop_end I am running shell script to verify if the data is properly sqooped from source table. But I see…
dsl1990
  • 1,157
  • 5
  • 13
  • 25
0
votes
1 answer

sqoop trying to connect to yarn even when running on MRv1

I have a cloudera cluster version 5.3.x and when running sqoop client using following command sqoop import --connect jdbc:mysql://HOST/myapplication --username myuser --direct -table=mytable -m 1 --hive-import --append --hive-table…
user2023507
  • 1,153
  • 12
  • 23
0
votes
1 answer

Running sqoop on remote client machine

I am trying to run sqoop import from a client machine using java. I'll be following sqoop client api file. I had the following query The machine from which I am running the client java class need not have hadoop installed on it I have cloudera…
Hardik Gupta
  • 4,700
  • 9
  • 41
  • 83
0
votes
2 answers

Error : sqoop to add records in hdfs

My scenario : I will get daily 100 records in hdfs through sqoop at particular time. But, yesterday i got only 50 records for that particular time today i need to get 50+100 records in hdfs through sqoop for that particular time. Please help me.…
user2707767
  • 21
  • 6
0
votes
0 answers

sqoop import query error "Operand should contain 1 column(s)"

I am trying to pull data from a MySQL database into Impala with the following sqoop command. sqoop import --connect jdbc:mysql://:3306/mydb --username user --password pass --fetch-size -2147483648 --query 'select (id,action,object,time) from…
jiveturkey
  • 2,484
  • 1
  • 23
  • 41
0
votes
1 answer

Programming Sqoop: v1.4.x or v1.99.x

I'm using Cloudera Quickstart VM CDH 5.5.0 and I'm trying to do some custom Java code for Sqoop in a Maven project. However, I'm a bit confused about the two versions of Maven dependencies: org.apache.sqoop …
oikonomiyaki
  • 7,691
  • 15
  • 62
  • 101
0
votes
1 answer

Oozie Shared Lib: where to place jars

I have installed Cloudera CDH QuickStart VM 5.5, and I'm running a Sqoop action in my Oozie workflow. I encountered an error that says MySQL JDBC driver is missing and I came across to a SO answer here that says the mysql-connector-java.jar should…
oikonomiyaki
  • 7,691
  • 15
  • 62
  • 101
0
votes
1 answer

Sqoop import --validate log the row count validation results

sqoop import --connect abc.com --table test --validate On Executing above import statement, Where does sqoop import --validate log the row count validation results ? In logs folder ?
ramanathan Arunachalam
  • 37
  • 1
  • 9
0
votes
0 answers

Sqoop Reading 0 records while doing a full load

PROBLEM DESCRIPTION: I was trying to sqoop data but the sqoop returns zero records without any error. But when I try to retrieve records using a certain limit it gets the data , but once i proceed further with a greater limit it does not…
sampat kumar
  • 31
  • 5
0
votes
3 answers

How to import MySQL data to Hadoop file system?

In my system I have database in Mysql. I want to import that to hadoop file system. I found something about Sqoop, but i'm not getting command to do that.
ketankk
  • 2,578
  • 1
  • 29
  • 27
0
votes
1 answer

Incremental import using Sqoop2

I would like to import data from MySQL table into HDFS. I have everything configured and I am able to create simple job in sqoop-shell that is copying data. However I would like to copy each time only new records, but I am not sure how to achieve…
Cob
  • 171
  • 10
0
votes
1 answer

Runtime exception while executing sqoop job

I am trying to execute sqoop job in biginsights. I am importing data from oracle db to hdfs. Below is the sqoop command which starts executing mapper and stops after sometime. sudo sqoop import --connect "jdbc:oracle:thin:@(DESCRIPTION = (ADDRESS =…
Cast_A_Way
  • 472
  • 5
  • 19
0
votes
3 answers

sqoop exec job in oozie is not working

I am running a 3 node HDP 2.2 cluster. Oozie version is 4.1.0.2.2 and Sqoop version is 1.4.5.2.2. I am using Sqoop job to do incremental imports from RDBMS into HDFS as shown below, sqoop job –create JOB1 –meta-connect…
nah
  • 91
  • 6
0
votes
1 answer

Configuring embedded Derby in Sqoop2

I want to set up Sqoop2. But there is some problem in configuring it. When I start the server by sqoop2-server start it does not give any errors on console but it fails to start and it shows errors in the log. Console output: Sqoop home directory:…
ZZZZ
  • 81
  • 1
  • 4
0
votes
2 answers

Unable to import data from Oracle to Accumulo using sqoop2

I am trying to import data from Oracle to Accumulo using the below command. sqoop import --connect jdbc:oracle:thin:hr/hr1234@bhucloud05.ad.abcsoftware.com:1521 --username hr --password hr1234 --accumulo-user kaar --accumulo-password password…
AccumuloUser
  • 1
  • 1
1 2 3
…
11 12