Search code examples
kettlepentaho-data-integrationpdi

PDI - How to keep Transformation run even an error occur?

I have a transformation with several steps that run by batch script using Windows Task Scheduler.

Sometimes the first step or the n steps fail and it stops the entire transformation.

I want to transformation to run from start to end regardless of any errors, any way of doing this?

Solution

  • 1)One way is to “error handling”, however it is not available for all the steps. You can right click on the step and check whether error handling option is available or not.

    2) if you are getting errors because of incorrect datatype, for example: you are expecting a integer value and for some specific record you may get string value so it may fail , for handling such situation you can use data validation step.

    Basically you can implement logic based on the transformation you have created. Above are some of the General methods.