0

I am trying to get JDBC jars recognized by Sqoop2 (CDH 4.4.0), but no matter where I place them, they do not seem to be recognized.

I have followed advice:

  1. here,

  2. here,

  3. and asked a similar question here.

Can someone please provide a definitive answer to this?

Community
  • 1
  • 1
tchakravarty
  • 10,736
  • 12
  • 72
  • 116

1 Answers1

2

I would strongly recommend to follow the official installation guide for your Hadoop distribution and it's associated version. It seems that you are using CDH 4.4.0, but looking into CDH 4.2.1 installation instructions. Whereas in CDH 4.2.1 the JDBC driver jar files were expected in /usr/lib/sqoop2, since CDH 4.3.0 they are expected in /var/lib/sqoop2 instead (documentation).

Jarek Jarcec Cecho
  • 1,736
  • 1
  • 10
  • 13
  • I eventually placed the driver in both the locations, but that is not what solved my problem. I did have to edit the `sqoop2-server` file in `/opt/cloudera/parcels/CDHxxxxxxxxxxx/etc/default` since I use MRv1 rather than YARN. – tchakravarty Oct 30 '13 at 14:55
  • I do not understand why did you had to change the sqoop2-server file, you are using parcels and therefore you are also using Cloudera Manager to manage your cluster - this kind of changes (MR1 vs. MR2) are automatically configured by CM when starting the services. Are you by any chance starting the Sqoop2 server on CM managed cluster without CM? – Jarek Jarcec Cecho Oct 31 '13 at 16:02
  • Nope. Used CM to start up Sqoop2, and couldn't spot a configuration to switch from the CM between MRv1 and YARN. had to go in and manually change the sqoop2-server file, and restart the service. Do you know where that configuration is in CM (a screenshot maybe)? – tchakravarty Oct 31 '13 at 16:43
  • Thanks for your interest btw. I anticipate many more Sqoop questions, and your help will be highly useful. – tchakravarty Oct 31 '13 at 16:45
  • You're welcome sir. CM is not exposing configuration to change MR implementation as that option is kind of given - CM already knows what implementation you are using, so there is no need for user to specify it again. – Jarek Jarcec Cecho Oct 31 '13 at 21:35