Search code examples
databasepentahopentaho-spoonpentaho-data-integration

Pentaho data alimention


I have a large KJB that feeds DMT and DWH. I want to know how a job, which contains a KTR or KJB, can be set up to require completion of another job before it starts its work. I am looking for a generic test to determine whether one function needs another, even if I change tables, so that I don't have to modify the large KJB every time I change a table. I have tried an old solution, but I am still encountering this issue


Solution

  • A job (extension file *.kjb) will execute steps serially, it doesn't launch the next step until the previous step is finished, you can add hops to next steps inconditionally, or you can add hops with the condition correct and/or error (one step in a job can have hops to more than one step).

    Is the transactions (extension file *.ktr) the ones that inialize all the steps at the beginning and the steps wait for the stream of data to reach the step to process that stream.

    You can inject metadata to transactions to execute the same operation on different tables, so you could use a transaction to insert data into different tables and you call the same transaction numerous times in the job just changing the metadata you are injecting (table name, column names, etc)