Questions tagged [ibm-infosphere]

IBM InfoSphere Platform provides all the foundational building blocks of trusted information, including data integration, data warehousing, master data management, big data and information governance.

87 questions
0
votes
0 answers

SQL Server : Login failed for user

A month ago I created a job in IBM DataStage, in the job I did ETL into database target, the job success executed. But two days ago when I was testing the connection of my database target in IBM DataStage, suddenly it failed to connect. This is the…
0
votes
1 answer

IBM Datastage assumes a column is WVARCHAR while it's date

I'm doing an ETL for a job. For the data source stage, I input custom select statement. In the output tab of data source stage, I defined the INCEPTION column data type is Timestamp. The right data type for INCEPTION is date. I check it via DBEAVER.…
0
votes
1 answer

IBM DataStage : Datetime overflow

I'm getting error which says ODBC_Connector_14,0: ODBC function "SQLExecute" reported: SQLSTATE = 22008: Native Error Code = 0: Msg = [IBM (DataDirect OEM)][ODBC SQL Server Driver]Datetime field overflow (CC_OdbcDBStatement::executeInsert, file…
random student
  • 683
  • 1
  • 15
  • 33
0
votes
1 answer

IBM DataStage : ODBC_Connector_0: Schema reconciliation detected a size mismatch for column

I have this job where i input from the source to the target database. I set the Set Fail on size mismatch to "No", the error is ODBC_Connector_0: Schema reconciliation detected a size mismatch for column plafon. When reading database column…
random student
  • 683
  • 1
  • 15
  • 33
0
votes
1 answer

IBM Datastage : Creating column that is calculation

I have a table which columns are location and credit, the location contains string rows which mainly is location_name and npl_of_location_name. the credit contains integer rows which mainly is credit_of_location_name and credit_npl_of_location_name.…
random student
  • 683
  • 1
  • 15
  • 33
0
votes
3 answers

How to create a Derived Column in IIDR CDC for Kafka Topics?

we are currently working on a project to get data from an IBM i (formerly known as AS400) system with IBM IIDR CDC to Apache Kafka (Confluent Plattform). So far everything was working fine, everything get replicated and appears in the topics. Now we…
Michael
  • 1
  • 1
0
votes
3 answers

IBM DataStage : Cannot drop duplicated records with look up stage

I'm trying to match the xls file input with the records in the database, if the records of the xls file matches with the records in the database then the records of the xls file will not be inserted to the database (preventing duplication), and if…
random student
  • 683
  • 1
  • 15
  • 33
0
votes
1 answer

How to renew database in ibm datastage

I alter my tables in the database. But in IBM DataStage, the tables are not automatically altered, it stays the same like without any alters. How do i renew/reload the database/ the tables in IBM DataStage for the new changes?
random student
  • 683
  • 1
  • 15
  • 33
0
votes
1 answer

how to insert new rows only ibm datastage

I'm trying to insert new rows only, i already tried with the insert new rows only in write mode options for the JDBC stage, but it doesn't work, it also inserts the old rows too. Maybe this is because in the column table i have id and created_at…
random student
  • 683
  • 1
  • 15
  • 33
0
votes
2 answers

how to move file after reading the file in ibm datastage

i have 1 folder which has 4 files, they are sales_jan, sales_feb, debt_jan, debt_feb.I created specific job for each sales and debt. The thing is, if i already run the job previously for sales_jan only and then there comes sales_feb after that, i…
random student
  • 683
  • 1
  • 15
  • 33
0
votes
1 answer

Connectio Faild to Kafka with IBM Info Sphere

While trying to read a Kafka topic in a InfoSpfhere Job, I got the error Kafka_Customer: java.lang.NoClassDefFoundError: org.apache.kafka.clients.consumer.ConsumerRebalanceListener at com.ibm.is.cc.kafka.runtime.KafkaProcessor.validateConfiguration…
0
votes
2 answers

How to make ibm data stage read specific job parameter value from source

I'm trying to capture filename being input to my data source into table column source_file, for the filename I created a job parameter sales*; I tested it with files sales.xlsx and sales_copy.xlsx. It successfully executed to input the data except…
random student
  • 683
  • 1
  • 15
  • 33
0
votes
2 answers

running job with different file without reloading the file

I created a job that could be reusable for new files. The entire activities in the job, the maps and everything else will remain the same except for the file name. I already tried it once but it seems that i need to re "load" the file and remap…
random student
  • 683
  • 1
  • 15
  • 33
0
votes
2 answers

run ibm data stage job with different file in same job

I created a job to input excel data into database. I need the job to be reusable for different excel version. The columns of the excel will be the same but only the values will change, it's like inserting newest excel values version to the…
random student
  • 683
  • 1
  • 15
  • 33
0
votes
1 answer

How to keep unstructured file name as value and insert into database

I'm new in using IBM Data Stage, i need to keep the file name that i set in the unstructured file in filepath as a value. Then i need to insert that value in original_file column of my table for all rows automatically. Is there any way to do this?
random student
  • 683
  • 1
  • 15
  • 33