← Back to LR Schedule

warmup + stable + cosine decay

LR Schedule
Used in
1 PRs
Best BPB
1.3587
Avg BPB
1.3587

Submissions

PR #1574by KRGulaj
1.3587

Hyperparameters Across PRs

pr_numberparameters
1574{"warmup":0.1,"stable":0.7,"decay":0.2}