I am going throught the CNTK 204: Sequence to Sequence Networks with Text Data tutorial. A function cntk.blocks.Stabilizer() is used, but there is currently no documentation for that function. Does anyone know what it does?
It implement self stabilized from:
Self-stabilized deep neural network," P. Ghahremani and J. Droppo, ICASSP 2016
And here a direct link to the paper: https://www.microsoft.com/en-us/research/wp-content/uploads/2016/11/SelfLR.pdf