← Back to LR Schedule

linear warmup

LR Schedule
Used in
8 PRs
Best BPB
1.1896
Avg BPB
1.3630

Submissions

PR #46by vavo
1.2697
PR #536by jaksenc
1.5140
PR #896by MVPandey
1.1896
PR #1125by jainpranjal97
1.1946
PR #1163by intelligentiaomni
1.5645
PR #1203by raider99k
1.3557
PR #1239by tmancino
1.5918
PR #1691by AVINASH0052
1.2244

Hyperparameters Across PRs

pr_numberparameters
46{"warmup_steps":100}
536{"warmup_steps":30}
896{"warmup_steps":200}
1125{"warmup_steps":20}
1163{"warmup_steps":20}
1203{"warmup_steps":5}
1239{"warmup_fraction":0.2}
1691{"warmup_steps":20}