Search code examples
azure-data-factorymetadata

Azure Data Factory: 'Get Metadata' Activity Retrieving the Incorrect Column Count

Output

Hi, I'm currently running into an issue whereby the 'Get Metadata' activity is retrieving an incorrect column count from a desired table (table stored in a relational SQL Database). It's outputting a column count of 8 when the column count should be 37.

I've inputted another table from the same database with 20 columns and again the 'Get Metadata' activity outputs a column count of 8...

Has anybody come across this before or know why this might be?

Cheers in advance

Solution

  • Get Meta data activity is giving proper result for me.

    enter image description here

    I suggest you publish and retry the same.

    If still it's not working, use the lookup activity as workaround for it.

    Use the below query in lookup query option to get the column count of the table.

    SELECT COUNT(*) as count
FROM information_schema.columns
WHERE table_schema = '<your schema name>'
  AND table_name = '<your table name>';

    enter image description here

    Result:

    enter image description here

    Use the below expression later on after the lookup activity to get the column count.

    @activity('Lookup1').output.firstRow.count