← Back to Architecture

SparseAttnGate

Architecture
Used in
10 PRs
Best BPB
0.9019
Avg BPB
1.0460

Submissions

PR #1869by ZanePeycke
1.0665
PR #1881by ndokutovich
0.9019
PR #1883by robbiebusinessacc
1.0678
PR #1915by AidenGeunGeun
1.0650
PR #1935by vimeto
1.0600
PR #1945by alertcatRECORD
1.0593
PR #2009by SlavH
1.0500
PR #2014by simonbissonnetteRECORD
1.0576
PR #2051by dexhunter
1.0605
PR #2143by upascal
1.0713

Hyperparameters Across PRs

pr_numberparameters
1869—
1881—
1883—
1915—
1935—
1945—
2009—
2014{"gate_window":12,"scale":0.5}
2051—
2143{"params_per_layer":96}