← Back to Architecture

MHA 8/8

Architecture
Used in
1 PRs
Best BPB
0.1582
Avg BPB
0.1582

Submissions

PR #859by bigbag
0.1582

Hyperparameters Across PRs

pr_numberparameters
859{"layers":8,"heads":8}