← Back to Regularization

label smoothing

Regularization
Used in
11 PRs
Best BPB
0.8503
Avg BPB
1.0876

Submissions

PR #375by charmquark1984
1.1257
PR #667by suchitj2702
1.1352
PR #1124by NewyorkDev
1.1194
PR #1368by JKSNS
0.8503
PR #1380by ranausmanai
1.1567
PR #1602by SPThole
1.0744
PR #1702by Buld1n
1.1092
PR #2063by alexdwu13
1.2167
PR #2097by OnlyJundong
1.0585
PR #2101by OnlyJundong
1.0584
PR #2117by JulianTang2027
1.0588

Hyperparameters Across PRs

pr_numberparameters
375{"value":0.05}
667{"value":0.05}
1124{"value":0}
1368{"value":0.1}
1380—
1602—
1702{"bpb_weighted_loss":true,"weight_power":0.5,"weight_clip":2}
2063{"auxiliary_ce_on_h0":true,"aux_loss_weight":0.3}
2097{"label_smooth":0}
2101{"label_smooth":0}
2117{"label_smooth":0.05}