← Back to LR Schedule

standard LR scheduling tuned for single-device run

LR Schedule
Used in
1 PRs
Best BPB
1.5252
Avg BPB
1.5252

Hyperparameters Across PRs

pr_numberparameters
719{"scaled_down_from_multi_device":true}