Stack Overflow
Stack Overflow

Questions tagged [sqoop2]

SQOOP2 is the 2nd generation version of SQOOP. DO NOT USE this tag for SQOOP questions. Use the sqoop tag instead. SQOOP2 was designed to fix the tight coupling that SQOOP has with Hadoop. But as of Nov 2017 is no longer actively maintained.

From Upgrading Sqoop 2 from an Earlier CDH 5 Release

Note: Sqoop 2 is being deprecated. Cloudera recommends using Sqoop 1.

References

176 questions
0
votes
1 answer

Extract from Datastax Cassandra and load into HBase using Sqoop

I have 3 physical nodes running DSE 4.5. On the same 3 nodes I have HDP 2.2 running as well. Using Sqoop (either dse sqoop or sqoop provided by HortonWorks), how can I extract data from a Cassandra table and load into Hbase? I have searched on the…
Rajiv
  • 1
  • 2
0
votes
1 answer

migrating complex stored procedures to hive / Hbase or any other hadoop eco system

We have ORACLE stored procedures like below:(psuedo code) CREATE STOREDPROCEDURE(PARAMETERS) BEGIN SELECT STATMENTS; CALLING CURSORS AND THEN DOING INSERTS INTO ANOTHER TABLE; CALLING OTHER STORED PROCEDURES; END; We are having many stored…
shanker valipireddy
  • 1
  • 2
0
votes
0 answers

sqoop job getting failed

Hi I have executed sqoop import from sql server. I am able to unload many a tables but this table is throwing error. I am using 8 mappers and using CDH 5.2. My 7 mappers are completed successfully but showing below message in the log. Container…
user3858193
  • 1,320
  • 5
  • 18
  • 50
0
votes
2 answers

Hive and Sqoop partition

I have sqoopd data from Netezza table and output file is in HDFS, but one column is a timestamp and I want to load it as a date column in my hive table. Using that column I want to create partition on date. How can i do that? Example: in HDFS data…
kumar s
  • 1
  • 2
0
votes
1 answer

Difference between Sqoop1.4.4 and 1.4.5

I am using Sqoop1.4.5. I need the difference between sqoop 1.4.4 and sqoop 1.4.5. Please Help me to know the characteristics between these two versions.
Harini Muralidharan
  • 41
  • 9
0
votes
1 answer

Connection failure to SAP HANA from Sqoop SAP DBTech JDBC: [414]: user is forced to change password

Though the User id and password is correct, I am getting below error message. Please let me know if you have any solution. In SAP HANA - HIVE Table. Warning: /apps/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/sqoop/../accumulo does…
user3858193
  • 1,320
  • 5
  • 18
  • 50
0
votes
2 answers

error setting linkConfig.connectionString on sqoop 1.99.4

I followed https://sqoop.apache.org/docs/1.99.4/RESTAPI.html for trying out sqoop2. But Iam getting error "Exception in thread "main" org.apache.sqoop.common.SqoopException: MODEL_011:Input do not exist - Input name: linkConfig.connectionString" on…
dinoop
  • 13
  • 4
0
votes
2 answers

Oozie cant able to find JDBC drivers in Sqoop

Refrence to the previously asked question Oozie + Sqoop: JDBC Driver Jar Location 1 but not able to find jar in HDFS /user/oozie/share/lib/sqoop location. I have also tried to put driver jars at my workFlow app Lib. Still Drivers not found error…
Suet
  • 41
  • 1
  • 8
0
votes
1 answer

Sqoop2 import job from Oracle to HDFS(Text format) inserting string 'null' into HDFS

I am trying to import data from Oracle DB to HDFS using Sqoop2. I realized that sqoop2 is inserting a string 'null' value rather than non-string NULL value. Is there an alternative to skip this from happening? I know there is an alternative in…
sean
  • 21
  • 3
0
votes
1 answer

Export hive data to oracle using sqoop

I was trying to export hive/hdfs data to oracle using sqoop on a kerberos cluster, but was unable to submit the job, and I'm not sure why. I'm getting the following error: 2014-09-23 11:11:05 IST: FAILURE_ON_SUBMIT Exception:…
Anoop Vishwanathan
  • 1
0
votes
1 answer

error when running sqoop2 server on Amazon EMR with yarn

I'm trying to install sqoop 2 (version 1.99.3) on an Amazon EMR cluster (AMI version 3.2.0 / Hadoop version 2.4.0). When I start the sqoop server, I see this error in localhost.log: Sep 10, 2014 4:55:56 PM org.apache.catalina.core.StandardContext…
Mike W.
  • 131
  • 2
  • 9
0
votes
1 answer

Making Sqoop1 work with Hadoop2

I have had a hard time making sqoop1 work on hadoop2. I always run int Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.Tool error which suggests that sqoop1 is trying to use hadoop1. But i had downloaded the sqoop1 jar with…
Pratik Khadloya
  • 12,509
  • 11
  • 81
  • 106
0
votes
1 answer

Dynamic Sqoop Query and scheduling

My Sqoop query is stored in a DB. I need to fetch that query and execute it. Intern that query will archieve the oracle tables and store in the HDFS. Can anyone please let me know how can I retrieve the row from the DB(containing sqoop query) and…
safiuz
  • 9
  • 7
0
votes
1 answer

can we use any other metastore other than the default HSQLDB in sqoop 1.4.2?

can we use any other metastore(like MYSQL) other than the default HSQLDB in sqoop 1.4.2 .If yes,the HOW?
Sudeep
  • 1
  • 1
0
votes
2 answers

Configure Sqoop2 TEXT_FILE Output Format

I'm using Sqoop2 (Sqoop 1.99.3-cdh5.1.0) to import data from a postgresql database. The job successfully completes and creates text files in HDFS. The output files are CSV with single quotes, I would like to configure the output to be tab separated…
Vander Rice
  • 161
  • 1
  • 10
1 2 3
…
11
12