Search code examples
apache-nifikylo

what is wrangler port in data transformation in NIFI?


I would like to know what is Wrangler input/cleanup port in DATA TRANSFORMATION template . for the data ingest template nifi providing input and clean up ports , where we can define properties, directories and all.

But when comes to data transformation, not able to understand what is Wrangler ports and from where we are getting data to transform and which table being using from the data source.

kindly provide the your suggestions / links / resources .

Thanks


Solution

  • The to-wrangler-port and to-wrangler-cleanup-port ports are NiFi output ports. They allow for connecting processors between process groups. The are connected to the wrangler-input-port and wrangler-cleanup-port NiFi input ports, respectively, in the data-transformation reusable template flow.

    The Data Transformation template in Kylo actually contains two NiFi templates. The first NiFi template contains the information from your feed such as the list of transformations. The second NiFi template contains processors that are used by all Data Transformation feeds. This encourages reusability and make it easier to ensure that business policies are being adhered to.

    The Kylo team has a "Connecting to a Reusable Flow" video that explains these concepts in more detail: https://kylo.io/tutorials.html https://www.youtube.com/watch?v=Vj641MRJCd8