← Back to Architecture

multi-stream Transformer

Architecture
Used in
1 PRs
Best BPB
1.2008
Avg BPB
1.2008

Submissions

PR #1863by seinare
1.2008

Hyperparameters Across PRs

pr_numberparameters
1863{"arteries":2,"layers":10,"artery_dim":384,"heads":3,"windows":[1024,4096],"ctx":16384}