← Back to LR Schedule

warmdown cosine schedule

LR Schedule
Used in
1 PRs
Best BPB
1.1914
Avg BPB
1.1914

Submissions

PR #309by NewyorkDev
1.1914

Hyperparameters Across PRs

pr_numberparameters
309{"weight_decay":{"start":0.02,"end":0.08}}