Is there any possibility if the stage variable conversion is failed then capture the data into reject file

Question

We have a stage variable using DateFromDaysSince(Date Column) in datastage transformer. Due to some invalid dates , datastage job is getting failed . We have source with oracle.

When we check the dates in table we didnt find any issue but while transformation is happening job is getting failed

 Error: Invalid Date [:000-01-01] used for date_from_days_since type conversion

Is there any possibility to capture those failure records into reject file and make the parallel job run successfull .. ?

score 1 · Answer 1 · edited Jul 04 '20 at 13:33

1

Yes it is possible.

You can use the IsValidDate or IsValidTimestamp function to check that - check out the details here

These functions could be used in a Transformer condition to move rows not showing the expected type to move to a reject file (or peek).

When your data is retrieved from a database (as mentioned) the database ensures the datatype already - if the data is stored in the appropriate format. I suggest checking the retrieval method to avoid unnecessary checks or rejects. Different timestamp formats could be an issue.

edited Jul 04 '20 at 13:33

marc_s

732,580
175
1,330
1,459

answered Jan 14 '20 at 17:09

MichaelTiefenbacher

3,805
2
11
17

Thanks Michael .. But when i use IsValidDate i am getting all dates as valid date.. When i use DateFromDaysSince job is getting failed . – Arya Jan 14 '20 at 18:54
Strip down the amount of data to identify the data producing the problem. – MichaelTiefenbacher Jan 14 '20 at 21:44

Is there any possibility if the stage variable conversion is failed then capture the data into reject file

1 Answers1