Back to all reports

Weight initialization and learning-rate scheduling

Original report

PDF · 7 pages · 2.1 MB

Loading PDF…

Separate VGG-19 and ResNet-34 experiments examine how weight initialization and learning-rate scheduling affect training.

Report date
Original authors
Pang Liu
Report language
English · 7 pages

Main observations

The report records differences between initialization methods and compares constant, decaying and cyclic learning rates.

Scope and limitations

The two studies use different networks and settings. Their comparative results are specific to those experimental conditions.

Source

View the original source and its recorded version

Preserved as a historical record. The report describes the software, conditions and observations of its original experiment.