Search code examples
snowflake-cloud-data-platformsnowflake-schema

Max LOB size (16777216) exceeded, actual size of parsed column is 18840934 in snowflake

I am trying to generate JSON object using object_construct and array_agg function by joining the parent table with 6 child tables in Snowflake. while executing the query got the below error. Please suggest.

Max LOB size (16777216) exceeded, actual size of parsed column is 18840934

Solution

  • The maximum length of a field in a query projection cannot exceed 16MB and is a hard limit that cannot be increased.

    https://docs.snowflake.com/en/user-guide/data-load-considerations-prepare.html?_ga=2.86776536.1713968334.1654050526-74044833.1649643991#semi-structured-data-size-limitations

    You could try NewLine delimited JSON.

    https://medium.com/@kandros/newline-delimited-json-is-awesome-8f6259ed4b4b

    You could also try the solutions mentioned in the below link

    https://community.snowflake.com/s/article/Max-LOB-size-exceeded