Stack Overflow
Stack Overflow

Questions tagged [matillion]

Matillion is a product which transforms businesses' data, across its various locations and forms, into cloud data warehouses to enable informed decision making.

Matillion is a product which transforms businesses' data, across its various locations and forms, into cloud data warehouses to enable informed decision making. https://www.matillion.com/

79 questions
1
vote
2 answers

Matillion ETL- Multiple Table joins

I am trying to join multiple tables using the gui. However, I am not seeing any options available. It's primarily allowing joining of two tables. In case we would like to join multiple tables, there's a SQL Task "SQL Component" available where we…
Srikant
  • 38
  • 6
1
vote
1 answer

Creating spectrum table in matillion for csv file with comma inside quotes

I have a scenario for creating spectrum table in redshift using matillion. my CSV file data is like this:- column1,column2,column3 abc,"qwety,pqr",xyz but in spectrum table i am seeing data as column1 column2 column3 abc qwerty pqr Matillion is…
Babbi
  • 65
  • 1
  • 2
  • 11
1
vote
2 answers

Is it possible to write "proper" Python code in Matillion?

For those who don't know, Matillion is an ETL/ELT tool that can be used to handle Snowflake data flows (among other). One interesting feature is that we can write script tasks in either bash or python. I had a similar experience in the past with SQL…
Eric Mamet
  • 2,681
  • 2
  • 13
  • 43
1
vote
1 answer

How to import an Environment in Matillion

I am new to Matilion (Even Matillion is a new tool). I am able to export an existing environment into a JSON file using REST API. But I observed that there is no REST API endpoint for importing an environment. Rather there is an option for updating…
Neeraj Kumar
  • 215
  • 3
  • 13
1
vote
2 answers

Differences between matillion and apache airflow

I want to use an ETL service, but i am stuck between Apache Airflow and Matillion. Are they the same? What are the main differences?
eflorespalma
  • 325
  • 1
  • 2
  • 8
1
vote
1 answer

How to use SUBSTRING() inside of a SQL Component in Matillion Flow?

I am trying to use SUBSTRING() to a filename environment variable in the SQL Component in Matillion. Is there a different syntax, or is it not allowed in Matillion? I need to update values in a column with year which I can get using SUBSTRING() on…
Harsh Goswami
  • 33
  • 8
1
vote
1 answer

Use Salesforce Incremental Load component in Matillion for an existing table

Salesforce incremental load component asks for a target table with prefix. But what if I want to use this component for an existing table. It gives us a support to add table prefix, but I need to add an existing table. The expectation is that, I…
Manav Veer Gulati
  • 81
  • 1
  • 8
1
vote
1 answer

Why is matillion not loading data from S3?

I have a simple S3 load with all the correct information. There are no validation errors but and the package executes without a problem. It's just that there is no data in the table. Any tips from someone that is knowledgeable about Matillion?
Mheller
  • 11
  • 3
1
vote
2 answers

Matillion for Amazon Redshift support for job monitoring

I am working on Amazon Matillion for Redshift and we have multiple jobs running daily triggered by SQS messages. Now I am checking the possibility of creating a UI dashboard for stakeholders which will monitor live progress of jobs and will show…
MrNeilP
  • 349
  • 1
  • 5
  • 19
0
votes
1 answer

Load data from DynamoDB to Snowflake using Matillion

I am trying to load data from dynamo Db to snowflake using matillion (DynamoDB Query Compoenent) Our client Matillion is hosted on one AWS account(XYZ) and Dynamo DB is in another Aws account(ABC). I need help to connect matillion cross account…
Raghu
  • 33
  • 4
0
votes
1 answer

Error Max LOB size (16777216) exceeded, actual size of parsed column is xxx, loading data to Snowflake via Matillion

I am trying to load data to a snowflake table using Matillion Database Query component. It gives the error "Error Max LOB size (16777216) exceeded, actual size of parsed column is xxx" while loading a JSON string to a Variant column in snowflake. Is…
Sreekanth Mohan
  • 340
  • 4
  • 29
0
votes
1 answer

I need steps and advice on updating a very old instance of Matillion ETL

I am managing an AWS instance of Matillion ETL for a client. They have no real IT or AWS engineers, and I am not experienced as an AWS admin. Following Matillion instructions, I installed the AMI with version 1.59.8 a few years ago. We have been…
Cgr
  • 11
  • 1
0
votes
0 answers

Orchestration metadata in Matillion

Is there any way I can get some information about an orchestration in Matillion expl when was it first created or who created it, using API The only thing I find is data about the job like components and variables
Mohamed Benzarti
  • 1
0
votes
1 answer

Execute Snowflake Procedure in Matilion

I'm trying to execute Snowflake Stored Procedure in Matilion Using Sql Script component. But i'm getting error as Unknown user defined function. Can someone help me to call the procedure using Matilion Job. Thank You !
sagyy_sf
  • 45
  • 5
0
votes
0 answers

Matillion : missing environment variable type when export environment variable via ETL API v1

Using the MATILLION ETL API v1 to get environment variables, it seems that the type of the variables is missing in the output JSON. I m using the following syntax http:///rest/v1/group/name//project/name//environment/name//variable/export Link…
mwa
  • 148
  • 2
  • 9
1
2
3 4 5 6