← Back to Architecture

attention modification

Architecture
Used in
4 PRs
Best BPB
1.0756
Avg BPB
1.2137

Submissions

PR #1212by Gusanidas
1.1108
PR #1239by tmancino
1.5918
PR #1530by samacqua
1.0764
PR #1648by mikeapedia
1.0756

Hyperparameters Across PRs

pr_numberparameters
1212{"window_size":512,"layers":[2,4,6,8,10]}
1239{"curvature_range":[0.1,2]}
1530—
1648{"layers":11}