Search code examples
azureazure-data-factoryazure-data-lake-gen2azure-synapse-analytics

A Weird error in Azure data flow when I tried to run a innerjoin

Refer the image below ,I have the filters and conditional splits like this : enter image description here

When I datapreview the RightFilter2 (Rows are coming) ,Filtered (Rows are coming) which are going through the inner join where i have given col1from left ==col1 from right, its showing up the wierd error. If there are no matching rows ,it should have given me 0 rows /No output data .but it throws an error in datapreview as well as when i run the dataflow through pipeline. enter image description here

enter image description here

Solution

    • As shown in your image, you are using == condition on the inner join which should work as expected. However, the error message indicates usage of inequality condition for join which is unclear.

    • The following is an example where I am using joins but with inequality condition:

    enter image description here

    • When I validate it, I get the following error indicating a message similar to yours:

    enter image description here

    • To overcome this, navigate to optimize tab in the join transformation. Select one of the streams as broadcast.

    enter image description here

    • After this, you would get the result of the transformation that you are looking for. The following is an image for reference where I got the result of the join after overcoming the error.

    enter image description here