I am new to Azure Data Factory and have a requirement to pull data from Common Data Service (PowerApps) application to Azure SQL Database. I can pull data directly from the entities using a linked service. The problem arises when I want to include headers such as
OData-MaxVersion:4.0
OData-Version:4.0
Prefer:odata.include-annotations=*
into my pipeline. The reason for adding these headers is that my entity uses values from different option sets and when I use the above headers in my web api calls, I get the response with formatted values as well. Please advise how can I get around this problem using Common Data Service connectors available in Azure Data Factory.
Those headers will expand the attributes like Picklist (optionset) for the formatted values in CRM web api. Are you getting the picklist integer column values in query results?
Because there seems to be couple of issues opened in github stating the results are missing. You should try schema/mapping to bring those attributes. Read more .
Or use the OData connector instead of Dynamics/CDS connectors.