Weight initialization and learning-rate scheduling
Loading PDF…
Separate VGG-19 and ResNet-34 experiments examine how weight initialization and learning-rate scheduling affect training.
Main observations
The report records differences between initialization methods and compares constant, decaying and cyclic learning rates.
Scope and limitations
The two studies use different networks and settings. Their comparative results are specific to those experimental conditions.
Source
View the original source and its recorded versionPreserved as a historical record. The report describes the software, conditions and observations of its original experiment.