Search code examples
azureazure-data-lakeazure-stream-analytics

Stream Analytics Job -> DataLake ouput


I want to set up CI/CD (ARM template) with StreamAnalytics Job with output set to DataLake Store. https://learn.microsoft.com/en-us/azure/templates/microsoft.streamanalytics/streamingjobs/outputs#microsoftdatalakeaccounts

The issue comes with refreshToken: "It is recommended to put a dummy string value here when creating the data source and then going to the Azure Portal to authenticate the data source which will update this property with a valid refresh token"

Furthermore after 90-days refresh token is outdated and you need to do "Renvew Authorization" https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-data-lake-output#renew-data-lake-store-authorization

I tried to authorize ServicePrincipal.

How to do automatic deployment for ASA with DataLake? How to handle issue with this 90-days token validitiy?

Maybe you wiped the trail :)


Solution

  • at this time it is not yet possible. Sorry for the inconvenience. However we know this is very important and we will add Service Principal auth in the near future (we are looking at the exact ETA).

    In the meantime you need to renew manually the token. This can be done without losing any data by (1) stopping the job, (2) changing the token, then (3) restarting the job last time it was stopped.

    Let me know if you have any further question.