how to configure aws lambda to be able to access services on the emr master node?

Question

My AWS Lambda function can't access the hive server running on the master node. It times out -- the same behavior as if you try to access the node from a non white-listed IP. Obviously adding the Lambda function as a whitelisted IP is a non starter.

How do I configure AWS Lambda so that it can access services on the EMR master node?

score 8 · Accepted Answer · answered Mar 14 '19 at 10:24

8

Make your lambda run in private subnets of the same VPC as that of your EMR cluster.

In the EMR security group, add an inbound rule with the port that needs to be accessed with the lambda security group as source security group id. This will allow all lambda requests.

See if this helps !!

answered Mar 14 '19 at 10:24

omuthu

5,948
1
27
37

YOU DA REAL MVP – Walrus the Cat Mar 14 '19 at 20:19
1

Thank you !! Please award the bounty to the answer !! – omuthu Mar 15 '19 at 07:13

how to configure aws lambda to be able to access services on the emr master node?

1 Answers1