Stack Overflow
Stack Overflow

Questions tagged [sqoop2]

SQOOP2 is the 2nd generation version of SQOOP. DO NOT USE this tag for SQOOP questions. Use the sqoop tag instead. SQOOP2 was designed to fix the tight coupling that SQOOP has with Hadoop. But as of Nov 2017 is no longer actively maintained.

From Upgrading Sqoop 2 from an Earlier CDH 5 Release

Note: Sqoop 2 is being deprecated. Cloudera recommends using Sqoop 1.

References

176 questions
0
votes
0 answers

sqoop2 import very large postgreSQL table failed

I am trying to use sqoop transfer from cdh5 to import large postgreSQL table to HDFS. The whole table is about 15G. First, I tried to import just use the basic information, by entering schema and table name, it didn't work. I always get GC…
user3714023
  • 21
  • 5
0
votes
2 answers

what's the correct way to pipe input to a program's internal command line?

I'm trying to automate the installation of Sqoop 2. Suppose the sqoop-server is installed in the ip address 1.2.3.4. On the sqoop-client I want to set that server's ip. Manually, to do so, I would: sqoop2 sqoop:000> set server --host 1.2.3.4 how…
cybertextron
  • 10,547
  • 28
  • 104
  • 208
0
votes
1 answer

Getting data from vertica using Hue sqoop 2

I have installed CDH Hue and it is fully running , I'm trying to get data from vertica using hue sqoop2. To make a new connection sqoop hue ask me for some parameters, setting it as follow Name: Vertica Connector: generic-jdbc-connector JDBC Driver…
user2069713
  • 1
  • 1
0
votes
1 answer

Sqoop export update only specified columns

As far as I know, we can update database using "--udate-key" argument. Which updates whole record for that key. we can either insert or update with "--update-mode allowinsert" or "--update-mode updateonly". For example I have a file which consists…
Y.Prithvi
  • 1,221
  • 3
  • 14
  • 27
0
votes
1 answer

exporting from hive to sqlsrver using sqoop

im trying to export data from hive into an mssql server, i know that sqoop and the sql server are OK as I can export another table without issue. The error that Im getting is: 14/06/19 14:48:37 INFO mapreduce.Job: Task Id :…
Kevin Wincott
  • 25
  • 1
  • 6
0
votes
2 answers

how can i import from HDFS using sqoop and combine two columns of the table while importing?

Can I combine two or more columns while importing or exporting suppose i have 3 columns in DBMS ID, FIRST_NAME, LAST_NAME and i want to load it as ID,NAME only two columns. So how can I do that?
Sumeet
  • 43
  • 5
0
votes
1 answer

Sqoop import from JAVA API using delimiters and escape chars

I am trying to import data from RDBMS(Mysql) to HDFS. I did some reading on Sqoop tutorials and found few helpful links. http://devslogics.blogspot.com/2013/09/sqoop-java-client.html?showComment=1399588094791#c7484088811270691337 I am able to…
sean
  • 21
  • 3
0
votes
2 answers

Which Maven version I need to build Sqoop2

Please help to build Sqoop2 from source. I use Maven 3.2.1 on CentOS 6.5. When I try to compile Sqoop2 with command: mvn compile I get exception resulting from: missing org.apache.sqoop:sqoop-core:test-jar:tests:2.0.0-SNAPSHOT When I try to build…
dokondr
  • 3,389
  • 12
  • 38
  • 62
0
votes
1 answer

RDMS data archiving in Hadoop

We are exploring options to archive data in warehouse or RDMS to Hadoop. As matter of fact I have to use sqoop to load data in to HDFS and probably have to compress it. Then delete the rows which are to be archived. Trouble is when I have foreign…
sathish reddy
  • 119
  • 1
  • 9
-1
votes
1 answer

Can Apache Spark be used in place of Sqoop

I have tried connecting spark with JDBC connections to fetch data from MySQL / Teradata or similar RDBMS and was able analyse the data. Can spark be used to store the data to HDFS? Is there any possibility for spark outperforming the activities of…
BARATH
  • 364
  • 2
  • 17
-1
votes
1 answer

sqoop import from vertica failed

I am trying to import dataset from Vertica to HDFS using sqoop2. I a running following query on sqoop machines to import data into hdfs from Vertica v6.0.1-7 sqoop import -m 1 --driver com.vertica.jdbc.Driver --connect…
roy
  • 6,344
  • 24
  • 92
  • 174
1 2 3
…
11
12