Skip to content

Simple implementation of the LSUV initialization in PyTorch

License

Notifications You must be signed in to change notification settings

ducha-aiki/LSUV-pytorch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Layer-sequential unit-variance (LSUV) initialization for PyTorch

NEW repo: ducha-aiki/lsuv

pip install lsuv

This is sample code for LSUV and initializations, implemented in python script within PyTorch framework.

Usage:

from LSUV import LSUVinit
...
model = LSUVinit(model,data)

See detailed example in example.py

LSUV initialization is described in:

Mishkin, D. and Matas, J.,(2015). All you need is a good init. ICLR 2016 arXiv:1511.06422.

Original Caffe implementation https://github.com/ducha-aiki/LSUVinit

Torch re-implementation https://github.com/yobibyte/torch-lsuv

Keras implementation: https://github.com/ducha-aiki/LSUV-keras

New! Thinc re-implementation LSUV-thinc