← Back to LR Schedule

Late QAT

LR Schedule
Used in
1 PRs
Best BPB
1.1804
Avg BPB
1.1804

Submissions

PR #543by rarce
1.1804

Hyperparameters Across PRs

pr_numberparameters
543{"activation_lr_scale_threshold":0.1,"step_activated":4070,"lr_halved_on_activation":true}