Search code examples
azuresharepointazure-data-factorysharepoint-onlineazure-synapse

Copying files from Sharepoint to Azure Data lake gen 2 using Azure Synapse

I am trying to copy files from Sharepoint to Azure data lake gen2 using Azure Synapse pipeline

I have set up the prerequisites and configured the pipeline as mentioned in the document (https://learn.microsoft.com/en-us/azure/data-factory/connector-sharepoint-online-list?tabs=data-factory#copy-file-from-sharepoint-online)

Web succeeds and passes a token to the Copy Data activity. However, I am getting the error in the sink side

enter image description here

Getting below error message

enter image description here

Not sure what is the issue? can anyone advise? I referred various posts but no success

Solution

  • Error – The remote server returned an error: (401) Unauthorized.

    This error occurs because of authentication issue.

    This operation requires SharePoint Online site owner permission. You can find the owner by going to the site home page -> click the "X members" in the right corner -> check who has the "Owner" role.

    Also check

    Even if an Azure AD application has FullControl permissions on SharePoint Online, you can't copy files from document libraries with IRM enabled.

    Refer - https://learn.microsoft.com/en-us/answers/questions/381621/copy-data-from-sharepoint-using-adf-1.html