cloudformation glue job type python shell

Question

I am struggling to find how to create a python shell (not spark) glue job via cloudformation, i am unable to find what property defines that.

Only one that would make sence is jobcommand name, but its limited to glueetl as per https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-glue-job-jobcommand.html

score 5 · Accepted Answer · answered Mar 13 '19 at 05:32

5

Even though cloudformation page states that the only accepted value is glueetl, glue documentation states that pythonshell is an option aswell. https://docs.aws.amazon.com/glue/latest/dg/add-job-python.html

answered Mar 13 '19 at 05:32

Agukov

91
6

score 0 · Answer 2 · answered Mar 21 '19 at 16:16

0

You have to use pythonshell for python and should not specify dpus.

answered Mar 21 '19 at 16:16

Sandeep Fatangare

2,054
9
14

score 0 · Answer 3 · answered Oct 16 '20 at 09:31

0

Use `pythonshell' in Name property of Command, as explained in docs.

PythonShellJob:
  Type: AWS::Glue::Job
  Properties:
    Command:
      Name: pythonshell
      ScriptLocation: "s3://my-glue-scripts//my-script-file.py"
    Role: !Ref MyJobRole

answered Oct 16 '20 at 09:31

Krzysztof Słowiński

6,239
8
44
62

cloudformation glue job type python shell

3 Answers3