← Back to LR Schedule

linear warmup + wallclock-aware linear warmdown

LR Schedule
Used in
1 PRs
Best BPB
1.2029
Avg BPB
1.2029

Hyperparameters Across PRs

pr_numberparameters
139{"warmup_steps":50,"warmdown_steps":1200}