← Back to LR Schedule

cosine warm restarts (SGDR)

LR Schedule
Used in
1 PRs
Best BPB
1.4072
Avg BPB
1.4072

Submissions

PR #377by Complexity-ML
1.4072

Hyperparameters Across PRs

pr_numberparameters
377{"cycle_lengths":[5000,10000,20000],"peak_lr_decay":0.7}