← Back to Architecture

Token-routed MoE

Architecture
Used in
1 PRs
Best BPB
1.4072
Avg BPB
1.4072

Submissions

PR #377by Complexity-ML
1.4072

Hyperparameters Across PRs

pr_numberparameters
377{"experts":4}