← Back to Architecture

MHA

Architecture
Used in
2 PRs
Best BPB
1.0618
Avg BPB
1.1298

Submissions

PR #1052by demouo
1.1978
PR #1987by TimS-ml
1.0618

Hyperparameters Across PRs

pr_numberparameters
1052{"kv_heads":8}
1987{"num_kv_heads":8}