Search code examples
kettlepentaho-data-integrationpdi

PDI - GC Overhead Limit Exceeded

So, I have some questions about PDI and my Transformation flow. Based on my trans flow I get error GC Overhead Limit Exceeded and I have already search for solution like increase the memory for spoon.bat -Xms -Xmx2g but it doesn't work. So I think for alternative solution and I think that maybe I should change the flow (Sorte Merge used much memory and 'cause that error). Or if you guys have another solution for my problem please , i really need that.

Bellow is my trans flow pic. Thanks #SorryForMyGrammar

My Transformation Flow

Solution

  • You can skip the whole split and merge operations by including that logic in the Formula step.

    Use IF(condition;A;B), where condition is the test you defined in the filter rows step and A and B are the existing calculations from the respective formula steps. That way each row gets the right calculation and the stream never needs to be joined.