← Back to Regularization

label smoothing

Regularization
Used in
8 PRs
Best BPB
0.8503
Avg BPB
1.0984

Submissions

PR #375by charmquark1984
1.1257
PR #667by suchitj2702
1.1352
PR #1124by NewyorkDev
1.1194
PR #1368by JKSNS
0.8503
PR #1380by ranausmanai
1.1567
PR #1602by SPThole
1.0744
PR #1702by Buld1n
1.1092
PR #2063by alexdwu13
1.2167

Hyperparameters Across PRs

pr_numberparameters
375{"value":0.05}
667{"value":0.05}
1124{"value":0}
1368{"value":0.1}
1380—
1602—
1702{"bpb_weighted_loss":true,"weight_power":0.5,"weight_clip":2}
2063{"auxiliary_ce_on_h0":true,"aux_loss_weight":0.3}