← Back to Architecture

depth

Architecture
Used in
12 PRs
Best BPB
1.0981
Avg BPB
1.1992

Submissions

PR #81by polarizedfortnite-cpu
1.1670
PR #215by JayCheng113
1.1548
PR #447by CREVIOS
1.1431
PR #450by zachgoldfine44
1.1466
PR #474by joshuaswarren
1.1690
PR #675by ChideraIbe123
1.2302
PR #858by nickferrantelive
1.2135
PR #939by brian386
1.2519
PR #1085by adityasasidhar
1.2831
PR #1774by aruniyer
1.0981
PR #1940by skamalad
1.3066
PR #2112by fingoldin
1.2268

Hyperparameters Across PRs

pr_numberparameters
81{"layers":10}
215{"layers":11,"encoder_layers":5,"decoder_layers":6}
447{"layers":10}
450{"layers":12}
474{"layers":12}
675{"layers":10}
858{"layers":11}
939{"layers":7}
1085{"layers":11}
1774{"layers":12}
1940{"layers":11}
2112{"layers":10,"model_dim":1024,"mlp_mult":2}