← Back to Architecture
ReLU²
ArchitectureUsed in
62 PRs
Best BPB
0.0972
Avg BPB
1.1413
Submissions
PR #85by hydeh3r3
1.2156PR #587by newjordan
1.1208PR #623by SPThole
1.1507PR #903by CiprianFlorin-Ifrim
1.2064PR #920by CiprianFlorin-Ifrim
1.1539PR #922by greqone
0.0972PR #923by CiprianFlorin-Ifrim
1.1090PR #958by shouryamaanjain
1.1382PR #975by Abhishek8108
1.1216PR #992by TimS-ml
1.4054PR #1001by ibarrajo
1.1188PR #1029by fielding
1.1520PR #1046by Jayteare
1.2174PR #1055by sanyalsunny111
0.9693PR #1100by agalimova
1.1465PR #1101by amrayach
1.1290PR #1106by agalimova
1.1465PR #1111by MichaelMcCulloch
0.2532PR #1129by EthanYangTW
1.1174PR #1136by Hieuabssy
1.3069PR #1144by inFaaa
1.3572PR #1180by estesryan
1.0577PR #1205by SergheiBrinza
1.1431PR #1226by Wolfie8935
1.1428PR #1234by ibarrajo
1.1461PR #1237by ibarrajo
1.1198PR #1241by aiejvn
0.9901PR #1246by deborahnelson8788726
0.9650PR #1259by himanshudongre
1.1533PR #1268by samquiring
1.1875PR #1273by DushyantChetiwal
1.2196PR #1293by 5en5e1
1.2409PR #1337by sergimichi
1.2079PR #1403by Rhoahndur
1.3485PR #1418by Park-Tae-Hwan
1.4192PR #1447by shram86
1.1834PR #1448by shram86
1.1834PR #1449by codeprakhar25
1.3680PR #1474by shram86
1.1434PR #1488by ndokutovich
0.8265PR #1495by shram86
1.1077PR #1496by shram86
1.1920PR #1512by Itssshikhar
1.1117PR #1555by andrewbaggio1
1.0764PR #1582by He-Wenhao
1.3428PR #1672by andrewbaggio1
1.0119PR #1684by camden-git
1.2554PR #1691by AVINASH0052
1.2244PR #1699by lsb
1.4831PR #1728by mikeapedia
1.0771PR #1791by genji0306
1.0339PR #1794by Programmerryoki
1.0849PR #1851by aquariouseworkmanRECORD
1.0613PR #1866by deborahnelson8788726
1.5042PR #1919by dev-pratap-singh
1.0587PR #1940by skamalad
1.3066PR #1970by bsisduck
1.0674PR #1973by harborglowvintage-oss
1.2193PR #2029by alexdwu13
1.3771PR #2070by vardanbobo007
1.1730PR #2073by vardanbobo007
1.1726PR #2086by deniskurlov
1.1384Hyperparameters Across PRs
| pr_number | parameters |
|---|---|
| 85 | — |
| 587 | — |
| 623 | — |
| 903 | — |
| 920 | — |
| 922 | {"mlp_multiplier":3} |
| 923 | — |
| 958 | — |
| 975 | — |
| 992 | — |
| 1001 | — |
| 1029 | — |
| 1046 | — |
| 1055 | — |
| 1100 | — |
| 1101 | — |
| 1106 | — |
| 1111 | — |
| 1129 | — |
| 1136 | — |
| 1144 | — |
| 1180 | — |
| 1205 | {"hidden":1536} |
| 1226 | — |
| 1234 | — |
| 1237 | — |
| 1241 | — |
| 1246 | — |
| 1259 | — |
| 1268 | — |
| 1273 | {"mlp_multiplier":4} |
| 1293 | — |
| 1337 | — |
| 1403 | — |
| 1418 | — |
| 1447 | — |
| 1448 | — |
| 1449 | — |
| 1474 | — |
| 1488 | — |
| 1495 | — |
| 1496 | — |
| 1512 | — |
| 1555 | — |
| 1582 | {"hidden_dim":1024} |
| 1672 | {"block_m":128,"block_n":128,"block_k":64} |
| 1684 | — |
| 1691 | — |
| 1699 | {"mlp_hidden_dim":1152} |
| 1728 | — |
| 1791 | — |
| 1794 | — |
| 1851 | — |
| 1866 | — |
| 1919 | — |
| 1940 | — |
| 1970 | {"slope":0} |
| 1973 | — |
| 2029 | — |
| 2070 | — |
| 2073 | — |
| 2086 | {"mlp_mult":4,"hidden_dim":2304} |