Stack Overflow
Stack Overflow

Questions tagged [sqoop2]

SQOOP2 is the 2nd generation version of SQOOP. DO NOT USE this tag for SQOOP questions. Use the sqoop tag instead. SQOOP2 was designed to fix the tight coupling that SQOOP has with Hadoop. But as of Nov 2017 is no longer actively maintained.

From Upgrading Sqoop 2 from an Earlier CDH 5 Release

Note: Sqoop 2 is being deprecated. Cloudera recommends using Sqoop 1.

References

176 questions
0
votes
2 answers

How --direct mode is working in sqoop?

The sqoop uses the table primary key or --split-by to transfer from RDBMS to HDFS and I think the default number of mappers is four. However, by --direct the transfer can be faster without using the mapper. My question is if no mapper is…
ARASH
  • 418
  • 2
  • 6
  • 18
0
votes
0 answers

Connecting oracle with ssl without oracle wallet

Am trying in all the ways possible to make a ssl connection with Oracle server without using Oracle wallet. All i found this doc to make ssl with wallet and could find no posts explains in step-by-step to achieve without wallet. Please help me to…
onlyvinish
  • 435
  • 1
  • 5
  • 20
0
votes
1 answer

sqoop into more parts with small sizes

I have sqoop stmt with 10 mappers. Entire data is going into 10 parts in hadoop with each part exceeding 1GB. I want to divide the data into multiple files of smaller parts, needless to say more than 10, something like 50 files of 200MB each.…
Pavan Ebbadi
  • 852
  • 1
  • 13
  • 26
0
votes
0 answers

Sqoop export issue: parsing input data

I am trying to use Sqoop to load files on HDFS into Oracle database: Here is my input data: Input data: 100|John|Miller|3.10 200|Sam|Madden|4.0 Here is the Sqoop command: sqoop export --connect …
user3803714
  • 5,269
  • 10
  • 42
  • 61
0
votes
1 answer

SQOOP:customize input data before exporting into postgress DB

I want to export input data from hdfs into postgress db through sqoop. I am able to achieve this when my input data is in proper format with postgress table. But i want to perform some operation on my input data before exporting it into db like…
Ranjan Swain
  • 75
  • 1
  • 9
0
votes
4 answers

sqoop integration with hadoop throw ClassNotFoundException

I am new in word of hadoop and sqoop. I installed hadoop 2.7.3 (pseudo mode) and its working fine on my system. I want integration with sqoop. I am using sqoop sqoop-1.99.7-bin-hadoop200. 1) I extract tar file and move extracted content into…
sawai singh
  • 57
  • 8
0
votes
1 answer

Stratio Sqoop complains of missing hadoop library

I have pulled stratio sqoop docker containers as documented here: https://stratio.atlassian.net/wiki/display/SQOOP0X2/Example+mysql+to+kafka but when start the process of creating link between mysql and kafka. The step "create link -c…
Vaibhav Khanduja
  • 131
  • 10
0
votes
1 answer

Unable to find hadoop Configuration classes when starting Sqoop2 server (1.99.7)

I'm working on testing out using Hadoop with the latest version of Sqoop2 (1.99.7), and when running the sqoop2-server, I get the following error: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration at…
Brian
  • 857
  • 2
  • 12
  • 25
0
votes
0 answers

is it possible that calling mysql stored procedure through Java API in sqoop2(1.99.7)?

is it possible that calling mysql stored procedure through Java API in sqoop2(1.99.7)?? i could found anything related calling stored-procedure in sqoop2.. anyone know that?
rura6502
  • 365
  • 2
  • 15
0
votes
0 answers

issue in exporting from hive to vertica

I am trying to export the data from mapr hive to Vertica. For this I have used the following sqoop command. sqoop export --driver com.vertica.jdbc.Driver --connect "jdbc:vertica://*****:5433/dbName" --username "******" --password "*****" …
Bhaskar
  • 271
  • 7
  • 20
0
votes
3 answers

passing mysql properties via sqoop eval

sqoop eval command : sqoop eval --connect 'jdbc:mysql://' --driver com.mysql.jdbc.Driver --query "select max(rdate) from test.sqoop_test" gives me output: Warning: /usr/hdp/2.3.2.0-2950/accumulo does not exist! Accumulo imports…
Nishikant Jain
  • 129
  • 2
  • 10
0
votes
1 answer

Sqoop2 Rest API Link Creation

I need your help! 3 days i can't create link by Sqoop Rest API. Sqoop2 Server installed on the Hadoop cluster of claudera I send post request with body: { "link" : { "id" : -1, "enabled" : true, "update-date" :…
Константин Попков
  • 31
  • 5
0
votes
3 answers

sqoop to import data to hive

i am trying to import data to hive table using sqoop2. I am using --hive-import but it is not working Code: sqoop import --connect jdbc:sqlserver://192.168.x.xxx:11xx --username user --password user --table xxxx.NOTIFICATION…
animal
  • 994
  • 3
  • 13
  • 35
0
votes
1 answer

How to load and update changing data using SQOOP?

I tried with increment import but I have to specify either append or lastmodified. I need all changes, both modified and new records.
Nathon
  • 165
  • 1
  • 4
  • 13
0
votes
1 answer

How to enable datanode to access beyond its private network?

In my cluster CDH5.4, I have a gateway node which is on the private and public network. The cluster is on a private network. I want to use sqoop to get data out of a database server that is on the public network. When I issue the command the map…
scott
  • 235
  • 4
  • 12
1 2 3
…
11 12