Search code examples
deep-learningpytorchpytorch-lightning

Weight initialization in PyTorch Lightning


Since PyTorch Lightning does most things under the hood, how can I know which weight initialization methods it use for training the model? And how can I modify the initialization method?


Solution

  • PyTorch Lightning doesn't interfere with weight initialization. It should be same as default PyTorch weights initialization. This is how Linear layers are initialized.