← Back to Architecture

Attention Output Gate

Architecture
Used in
1 PRs
Best BPB
1.0573
Avg BPB
1.0573

Submissions

PR #1693by dexhunter
1.0573

Hyperparameters Across PRs

pr_numberparameters
1693{"layers":11,"heads":8,"width":12}