Search code examples
azure-data-explorer

How to clear ingress queue?


I sent 1000 invalid items for ingestion through LightIngest.exe. Each individual item takes around 10 minutes before it fails due to connectivity problems:

enter image description here

I am not able to proceed with valid items as they are added to the tail of the queue. How can I reset the queue?


Solution

  • There is no way today to reset or clear the queue. You have the following options:

    1. Wait - the retries are exponential, so the impact of the rouge items will be diminished significantly as more time passes
    2. Rename the table - the ingestions in the queue will fail and the queue will be cleared up. Please note however that when you rename the table back to the original name, items that are still waiting in the queue for a "retry" will continue to fail when their time arrives (since the table is back into its original name). So the closer that you do it to the actual error the better.