← Back to LR Schedule

linear warmup + cosine decay

LR Schedule
Used in
1 PRs
Best BPB
1.3379
Avg BPB
1.3379

Submissions

PR #1061by rolandnsharp
1.3379

Hyperparameters Across PRs

pr_numberparameters
1061—