Search code examples
machine-learningdeep-learningcntk

What does the cntk.blocks.Stabilizer() function do in CNTK?


I am going throught the CNTK 204: Sequence to Sequence Networks with Text Data tutorial. A function cntk.blocks.Stabilizer() is used, but there is currently no documentation for that function. Does anyone know what it does?


Solution

  • It implement self stabilized from:

    Self-stabilized deep neural network," P. Ghahremani and J. Droppo, ICASSP 2016
    

    And here a direct link to the paper: https://www.microsoft.com/en-us/research/wp-content/uploads/2016/11/SelfLR.pdf