I am trying to run my spark pool notebook using pipeline in azure synpase. THe notebook reads files from my ADLS Gen2. But when I am running the pipeline I am facing this issue: "This request is not authorized to perform this operation using this permission.", 403, GET, file_name.parquet?timeout=90, AuthorizationPermissionMismatch, "This request is not authorized to perform this operation using this permission.
{"error":{"code":"AuthenticationFailed","message":"Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature.
We need to give the role access to workspace as well in the subscription access control (IAM). It is working now.