← Back to Architecture

Gated XSA

Architecture
Used in
1 PRs
Best BPB
1.0593
Avg BPB
1.0593

Submissions

PR #2123by vaibhavmishra1
1.0593

Hyperparameters Across PRs

pr_numberparameters
2123{"layers":11,"dim":512,"heads":8,"kv_heads":4}