← Back to LR Schedule
warmup
LR ScheduleUsed in
13 PRs
Best BPB
1.2073
Avg BPB
1.6075
Submissions
PR #56by cschubiner
1.8440PR #240by riatzukiza
1.6660PR #248by riatzukiza
1.6231PR #258by riatzukiza
1.6572PR #276by riatzukiza
1.6577PR #649by pall23-mech
1.2073PR #1034by Jeneesh1014
1.7195PR #1299by Ribin545
1.8184PR #1300by Ribin545
1.8184PR #1434by ranausmanai
1.5207PR #1600by sayujshah
1.2781PR #1620by shiawyonglim
1.6644PR #1650by Jaredcastorena
1.4233Hyperparameters Across PRs
| pr_number | parameters |
|---|---|
| 56 | {"warmup_steps":10} |
| 240 | {"warmup_steps":4} |
| 248 | {"warmup_steps":4} |
| 258 | {"warmup_steps":4} |
| 276 | {"warmup_steps":4} |
| 649 | {"warmup_steps":20} |
| 1034 | {"warmup_steps":20} |
| 1299 | — |
| 1300 | {"warmup_steps":12} |
| 1434 | {"warmup_fraction":0.382} |
| 1600 | {"warmup_steps":20} |
| 1620 | {"warmup_steps":20} |
| 1650 | {"warmup_steps":20} |