AWS Glue Python Shell script timing out

Question

I am trying to connect to and read an on-premise data source using an AWS Glue Python Shell job. I am using Pygresql (which comes bundled on Glue) and Pandas. Everything works locally.

But when I push this job up to Glue, the database connections all timeout. Why is this happening? Do I need to do something magic with VPCs?

What is the error that you are facing? – Prabhakar Reddy Sep 10 '19 at 15:08 — Prabhakar Reddy, Sep 10 '19 at 15:08

score 1 · Answer 1 · answered Sep 10 '19 at 11:07

1

I guess you need to create a Glue connection with your VPC settings and attach it to the Glue job.

answered Sep 10 '19 at 11:07

pdanchenko

204
2
7

score 0 · Answer 2 · answered Sep 10 '19 at 17:18

0

Note that pygresql SQL query doesn't work in python shell. Recommended is postgresql

answered Sep 10 '19 at 17:18

Sandeep Fatangare

2,054
9
14

AWS Glue Python Shell script timing out

2 Answers2