← Back to Weight Averaging

Tight SWA

Weight Averaging
Used in
16 PRs
Best BPB
0.0830
Avg BPB
0.9778

Submissions

PR #535by raahilshah
1.1204
PR #543by rarce
1.1804
PR #569by gowtham0992
1.1175
PR #609by saml212
1.1154
PR #887by anthony-maio
0.9642
PR #915by anthony-maio
0.9642
PR #932by anthony-maio
1.1580
PR #960by ADIITJ
1.1882
PR #986by sofiabod
0.0830
PR #1016by ADIITJ
1.1269
PR #1030by sofiabod
0.1130
PR #1043by okezue
1.1261
PR #1184by icryo
0.9485
PR #1247by fahmitech
1.2208
PR #1364by stukenov
1.1025
PR #1473by AVINASH0052
1.1156

Hyperparameters Across PRs

pr_numberparameters
535{"frequency_steps":50,"scale_threshold":0.2}
543{"scale_threshold":0.2,"checkpoints_averaged":6,"checkpoint_interval":50,"quality_penalty":"zero"}
569{"frequency":"every 50 steps","condition":"when LR scale < 0.2"}
609—
887—
915—
932—
960—
986—
1016—
1030—
1043{"interval":50}
1184{"interval":50}
1247{"interval":50}
1364{"every_steps":50}
1473{"start_step":6150}