← Back to Architecture

QKV fusion

Architecture
Used in
1 PRs
Best BPB
1.1171
Avg BPB
1.1171

Submissions

PR #670by abaybektursun
1.1171

Hyperparameters Across PRs

pr_numberparameters
670{"q_heads":8,"kv_heads":4}