1

I am using Terraform to create a dataproc cluster that uses a GCP cloudsql instance as the hivemetastore, the terrafrm project creates the cluster and all its prerequisites (network, service account, cloudsql instance & user, etc).
cloud-sql-proxy.sh is provided to assist with this however I can't get it to work, when the cluster is created cloud-sql-proxy.sh fails with error:

nc: connect to localhost port 3306 (tcp) failed: Connection refused

I've banged my head against the wall trying to figure out why but can't get to the bottom of it so am hoping someone here can help.

I've hosted the terraform project at https://github.com/jamiekt/democratising-dataproc. Reproducing the problem is very easy, follow these steps:

  1. Install terraform if you haven't already
  2. Install gcloud if you haven't already
  3. Create a new GCP project
  4. Enable the Cloud Dataproc API for your new project
  5. gcloud auth application-default login #creates a file containing credentials that terraform will use
  6. git clone git@github.com:jamiekt/democratising-dataproc.git && cd democratising-dataproc
  7. export GCP_PROJECT=name-of-project-you-just-created
  8. make init
  9. make apply

That should successfully spin up a network, subnetwork, cloudsql instance, a couple of storage buckets (one of them containing cloud-sql-proxy.sh), a service account, a firewall then fail when attempting to create the dataproc cluster.

if anyone could take a look and tell me why this is failing I'd be very grateful.

jamiet
  • 10,501
  • 14
  • 80
  • 159
  • 1
    Did you try to follow [this](https://cloud.google.com/solutions/using-apache-hive-on-cloud-dataproc) article on how to configure Hive Metastore to use Cloud SQL on Dataproc? – Igor Dvorzhak Mar 03 '19 at 03:17
  • thank you @IgorDvorzhak, your responses helped. Please see my answer. – jamiet Mar 06 '19 at 11:36

2 Answers2

1

It seems that you are not using the latest version of cloud-sql-proxy.sh script in the cloud-sql-proxy.sh.tmpl template (diff).

You may want to try to update your template with latest script version from Dataproc Cloud SQL I/O and Hive Metastore initialization action.

Igor Dvorzhak
  • 4,360
  • 3
  • 17
  • 31
1

There were a number of problems here that have now been solved:

The state of the repo at the time of posting this message will work as intended (i.e. create, using Terraform, a dataproc cluster that uses a shared hive metastore).

Thank you @igor-dvorzhak for your responses, your link to the article on configuring Hive Metastore to use Cloud SQL put me on the right track..

jamiet
  • 10,501
  • 14
  • 80
  • 159