← Back to Weight Averaging

Polyak averaging

Weight Averaging
Used in
7 PRs
Best BPB
0.2071
Avg BPB
0.7113

Submissions

PR #700by RoyiRa
1.0541
PR #731by pentxayc
1.0400
PR #803by pentxayc
0.4416
PR #809by AayushBaniya2006
0.2952
PR #850by callithyia
0.3212
PR #851by RoyiRa
0.2071
PR #1014by haimianbaobao007
1.6200

Hyperparameters Across PRs

pr_numberparameters
700{"decay":0.998}
731{"decay":0.998}
803{"decay":0.998}
809{"decay":0.998}
850{"decay":0.998}
851{"decay":0.998}
1014—