← Back to Architecture

Mixture of Depths

Architecture
Used in
1 PRs
Best BPB
1.1716
Avg BPB
1.1716

Hyperparameters Across PRs

pr_numberparameters
1783{"capacity":0.5}