← Back to Architecture

Transformer depth

Architecture
Used in
7 PRs
Best BPB
1.1550
Avg BPB
1.2327

Submissions

PR #60by notapplicaRECORD
1.1748
PR #63by yahya010RECORD
1.1598
PR #166by chinesepowered
1.1550
PR #242by jamesrziggy
1.2988
PR #793by pall23-mech
1.2500
PR #805by zeytx
1.1807
PR #830by zlxi02
1.4096

Hyperparameters Across PRs

pr_numberparameters
60{"layers":10}
63{"layers":10}
166{"layers":10}
242{"layers":10}
793{"layers":10}
805{"layers":11}
830{"layers":11}