Since the beginning I have had the problem that the hololens freeze for half a second as soon as the buttons or toggles are recognized. Why is that lag happing, I'm using the buttons given by the mrtk-example-package? It happens only ones, after that everything is fine again.
--Edit--
Screenshot - Inspector view of my vuforia toggle
https://imgur.com/a/EFUxMi1
InteractiveToggle.cs
https://pastebin.com/PkEtGmir
Do you have any text in the Voice Command field by chance, with Requires Gaze checked? If that's the case the Voice Recognizer is initiating.