← Back to Architecture

Sort-Split MoE

Architecture
Used in
1 PRs
Best BPB
1.4072
Avg BPB
1.4072

Submissions

PR #377by Complexity-ML
1.4072

Hyperparameters Across PRs

pr_numberparameters
377{"experts":4}