Questions tagged [data-integration]

Data integration is the combination of technical and business processes used to combine data from disparate sources into meaningful and valuable information. A complete data integration solution encompasses discovery, cleansing, monitoring, transforming and delivery of data from a variety of sources.

Data integration is the combination of technical and business processes used to combine data from disparate sources into meaningful and valuable information. A complete data integration solution encompasses discovery, cleansing, monitoring, transforming and delivery of data from a variety of sources.

It is a huge topic for the IT because, ultimately aims to make all systems work seamlessly together.

Example with data warehouse

The process must take place among the organization's primary transaction systems before data arrives at the data warehouse.
It is rarely complete, unless the organization has a comprehensive and centralized master data management(MDM) system.

Data integration usually takes the form of conforming dimensions and facts in the data warehouse. This means establishing common dimensional attributes across separated databases. Conforming facts is making agreement on common business metrics such as key performance indicators (KPIs) across separated databases, so these numbers can be compared mathematically.

332 questions
0
votes
0 answers

Workday: Usage Type is Invalid for this Contactable

We are using SnapLogic to load records into Workday. For Put_Customer of Revenue_Management web service, I was getting the following error: I was able to work around this problem by using the following fields: Communication_Usage_Type_ID for …
Bilesh Ganguly
  • 3,792
  • 3
  • 36
  • 58
0
votes
2 answers

Workday: Put_Customer returning an error

We are using Snaplogic to load records into workday. Currently, extracting customer records from the source and trying to load them into workday using the object Put_Customer of web service Revenue_Management. I was getting the following error: But…
Bilesh Ganguly
  • 3,792
  • 3
  • 36
  • 58
0
votes
3 answers

export jobs from talend DI to talend big data

I am new to talend ETL tool.I have created jobs workflow in talend DI(data integration) tool now I want to switch/implement same jobs using hadoop for that I am using talend Big Data tool. Can anybody explain me how could I achieve this. Talend DI…
code
  • 123
  • 3
  • 11
0
votes
0 answers

Creating trigger file using pentaho kettle

I have a log table where it captures log each and every time the main table is loaded, and what i need is that i need to create a trigger file using pentaho kettle each and every time the log table gets updated. And the log table is in teradata. Any…
Lavanya D.
  • 491
  • 2
  • 6
  • 15
0
votes
0 answers

Talend Open Studio v6.2.0, on startup throws error "Could not resolve module: org.talend.designer.business.diagram"

I have java 8 installed on ubuntu 14.04, have downloaded Talend open studio for DI v 6.2.0. I have followed the steps to install talend for a 32 bit ubuntu box.But whenever I start the talend studio , it throws the above error. Please find the…
dexter
  • 451
  • 1
  • 4
  • 19
0
votes
1 answer

ClassNotFoundException when trying to run pan.bat with cmd

I want to create a Windows script that runs a Kettle transformation (.ktr). First, I tried to run my script but it does nothing. After that, I decided to try it by cmd, but it still is not working. It outputs a ClassNotFoundException: Exception in…
Lyd
  • 2,106
  • 3
  • 26
  • 33
0
votes
1 answer

Java Code to be used in Talend Java Custom components

I have written a java problem to split the data from a single column into tabular form. How can I use the same code in Talend's Java Component. The input File will have a column which will have the data in the below…
user3454116
  • 184
  • 1
  • 12
0
votes
2 answers

SAS Data Integration - Create a physical table from metadata structure

i need to use a append object after a series of join that have a conditional run... So the join step may be not execute if the condition is not verified and his work physical dataset will not be created. The problem is that the append step take an…
Roberto
  • 1
  • 2
0
votes
2 answers

Talend unknown server host name connection with SQL Server

I want to make talend metadata dbconnection with repository I have entered these as credentials Login: sa Password: ****** Server: Localhost\SQLEXPRESS Port: 1433 Database: mydb Additional Parameter: instance=SQLEXPRESS but I get an error of…
Hassan Farooq
  • 71
  • 2
  • 12
0
votes
2 answers

Count the number of rows for each file along with the file name in Talend

I have built a job that reads the data from a file, and based on the unique data of a particular columns, splits the data set into many files. I am able to acheive the requirement by the below job : Now from this job which is splitting the output…
user3454116
  • 184
  • 1
  • 12
0
votes
1 answer

How to do a for when we have an arraylist of strings java

okay, so here it is the full code public static ArrayList procuraGeneroLiterario(String nome_escritor) throws IOException{ String link = "https://pt.wikipedia.org/wiki/" + nome_escritor; String pesquisa =""; ArrayList
0
votes
1 answer

dynamic schema xls file to mysql database

I want to create a job using Talend that imports multiple xls files to a MySQL database . I don't know the schema of those files (number of columns and names) but i can suppose that the header row corresponds to the columns names. My idea is to…
0
votes
0 answers

HL7 validator in pentaho kettle

I want to know if there is a solution in pentaho kettle to validate a message hl7 before parsing, I want some thing like exposed here http://try-it.caristix.com:9030/default.aspx but in a step pentaho kettle or a hole transformation which do the…
Mostav
  • 2,203
  • 15
  • 27
0
votes
1 answer

Creating folder in Talend after comparing data from File

I have a requirement where I have a excel file, where there are four columns in the file. The image for the columns are attached. I have created a simple job using tsystem componenent which creates folder in a specified directory. The parameter…
user3454116
  • 184
  • 1
  • 12
0
votes
1 answer

Split column values as Header in talend

I have a input file as follows: file1 : A file2 : B file3 : C file4 : D file5 : E file6 : F and i want my Target file to look like this: file1 | file2 | file3 | file4 | file5 | file6 A | B | C | D | E | F Trying to make the…