← Back to Architecture

shared attention

Architecture
Used in
2 PRs
Best BPB
1.3527
Avg BPB
1.3553

Submissions

PR #1025by Zagot-byte
1.3579
PR #1235by maksblu
1.3527

Hyperparameters Across PRs

pr_numberparameters
1025{"layers":11,"bases":10,"rank":128}
1235{"shared_pairs":4}