← Back to Architecture

Block Attention Residuals

Architecture
Used in
2 PRs
Best BPB
1.1224
Avg BPB
1.2987

Submissions

PR #607by Neopolita
1.4750
PR #1696by kings-crown
1.1224

Hyperparameters Across PRs

pr_numberparameters
607—
1696{"blocks":2,"mix":0.25,"temperature":1.1}