I am trying to perform dynamic /programmatic ETL jobs in glue with basic mapping and Transformations.
Scenarios are below,
- new files comes in particular S3 bucket, job should trigger and to load in another s3 location.
- how to handle dynamic mapping and transformation (Using config file).
- how to create dynamic / programmatic Glue workflow to handle point 1 and 2.