← Back to LR Schedule

cosine warmdown

LR Schedule
Used in
7 PRs
Best BPB
1.1399
Avg BPB
1.1901

Submissions

PR #243by kvmukilan
1.1704
PR #246by kvmukilan
1.1704
PR #249by kvmukilan
1.1704
PR #324by crony-io
1.1702
PR #326by crony-io
1.2890
PR #334by nathon-lee
1.2207
PR #349by Mapika
1.1399

Hyperparameters Across PRs

pr_numberparameters
243—
246{"formula":"0.5 * (1 + cos(pi * progress))"}
249{"formula":"0.5 * (1 + cos(pi * progress))"}
324{"formula":"0.5 * (1 + cos(pi*t))"}
326—
334{"warmdown_steps":3000}
349{"warmdown_steps":3000,"warmup_steps":20}