Query Optimization in KQL || Pagination
I have custom or Web UI where it fetches data from ADX streaming data. UI default fetch 20 records and if user want to see more records, scroll down and next 20 of records will be fetching from ADX and load into UI.
Below picture is UI, right hand side bottom, fetched records count vs total records count(60/6512), total record count is just number but the actual records not loaded, total number of record count come from query and just display for end user. when user scroll down each time query will submitted on ADX and process records and load into UI.
Below is Log analytics query logs, each time query is running and load into UI.
Please any KQL expert need your suggestion, How to overcome this issue.
Each time query has to process all the records and fetch only 20 records based on scroll down, we can't push all the records at a time because limitations on UI side or middle ware API.
How to over come this kind of issue? Any Query, Is it possible to load all 6512 records in one temp table and provide records to end user based on user scroll down, so query will not run each time, simply take from temp table until user session exists.
But UI is accessed by multiple users and use this UI to fetch records. not sure how to achieve performance on this.
One option is for you to use stored query results.
That said, if the record count of the full result set is 6.5K, and assuming your client is running on a modern machine (e.g., its available RAM isn't measured in KBs), you might find it to be simpler to fetch the entire data set using one call, without sacrificing much.
- Create a function to calculate power of tens with a loop and reuse them in another query
- Azure Resource Graph - Database sizes
- KQL Query to filter duplicate entries and select top 1 from the log data
- Generate Chart by Type and State
- Azure Data Explorer C# querying and ORM
- How to find non distinct/duplicate messages in Azure Application Insights?
- Kusto query for time between records by group in one result list
- Application Insights KQL query - not in sub query
- Logic Apps copy action gives: The managed identity used with this operation no longer exists. To continue, set up an identity or change the connection
- Get all types of resources in a resource group
- insert an array in column of the kql table
- Stuck at PIM Diagnostics via KQL
- In Azure log analytics - where are the delete queries in KQL?
- Get the difference between Successive timestamps KQL
- Grouping on the basis of cumulative sum
- Check two different tables
- Is it possible to group rows programmatically in KQL?
- How could I parse the json array in Kusto?
- How to use table alias in KQL query
- How do I create an Azure workbook that accepts a time range in UTC?
- Azure Resource Graph Explorer :: list all VMs with number of cores
- Restrict all table and function except specific table
- Extract query string from url
- how to convert the rows into columns in Azure Data Explorer (Kusto)
- String function not parsing all characters
- free disk space overview using InsightsMetrics
- Query Azure Resource Graph and get a list of all the application registration that contains "test"
- Time difference between separate rows in same table
- How can I default a KQL Defender Vulnerability Summary to zero?
- Summarize count() multiple columns with where clauses