← Back to LR Schedule

warmdown with LR floor and cooldown fraction schedule

LR Schedule
Used in
1 PRs
Best BPB
1.6372
Avg BPB
1.6372

Submissions

PR #130by mohosy
1.6372

Hyperparameters Across PRs

pr_numberparameters
130{"lr_floor_fraction":0.1,"cooldown_fraction":0.6,"qat_lr_reduction":0.5,"qat_start_frac":0.75}