How do I create a parameter in the console of AWS Data Pipeline

Question

I'd like to define some parameters in the console of AWS DataPipeline, but am not able to do so. The parameters are going to be called in a SqlActivity, so when I try to refer to them in the in-line SQL script and save the pipeline, I'm getting error messages saying that no such parameters exist. The parameters page is blank and I can't find the button to make one. Google results are all showing me how to create parameterized pipelines, which is not what I'm exactly looking for

score 4 · Answer 1 · answered Jun 15 '15 at 21:19

4

At the moment, you cannot create parameter objects from the AWS Datapipeline console. Please use aws cli to create a pipeline definition with parameter objects.

answered Jun 15 '15 at 21:19

Ramkumar

41
1

3

Five years later, in 2020, this is still not supported... – jmng Aug 11 '20 at 10:30
Wow really? If I remember correctly, you can do it by uploading a JSON file to create a pipeline but have no idea if that functionality has been removed/deprecated. – simplycoding Aug 11 '20 at 20:07

score 0 · Answer 2 · answered Sep 03 '21 at 11:59

I found a workaround for "adding" parameters to your pipeline by creating another one almost identical.

Go to your pipeline definition and click Export. Copy paste the json content to a file on your local machine. In the last rows of the json, find the parameters, here is where you will add as many params as you wish. I will leave a snippet:

    "parameters": [
    {
      "description": “Description example“,
      "id": “myVar1”,
      "myComment": “Comment“,
      "type": "String"
    }
    ],
    "values": {
      “myVar1": “data”
    }

Next time you create the pipeline: Create pipeline -> Source -> Import a definition -> <your_json_definition>

How do I create a parameter in the console of AWS Data Pipeline

2 Answers2