← Back to Regularization

dropout

Regularization
Used in
8 PRs
Best BPB
1.0824
Avg BPB
1.4126

Submissions

PR #340by starfly-web
1.2182
PR #345by anandks2006
1.8522
PR #820by mtybadger
1.6252
PR #1021by abaybektursun
1.3250
PR #1491by wisebreadloaf
1.6924
PR #1520by taka6745
1.0824
PR #1520by taka6745
1.0824
PR #1650by Jaredcastorena
1.4233

Hyperparameters Across PRs

pr_numberparameters
340{"rate":0.1,"scope":"attention and MLP blocks"}
345{"loop_dropout":true}
820{"rate":0}
1021{"rates":[0.3,0.05]}
1491{"rate":0}
1520{"type":"Norm-PCT-Dropout","top_l2_norm_row_fraction":0.01,"target":"FFN intermediate activations"}
1520{"type":"skip gates","description":"sigmoid-gated U-Net skip connections"}
1650—