← Back to Architecture

Pattention

Architecture
Used in
1 PRs
Best BPB
1.3771
Avg BPB
1.3771

Submissions

PR #2029by alexdwu13
1.3771

Hyperparameters Across PRs

pr_numberparameters
2029{"p_ratio":1,"p_tokens":341,"scope":"MLP fc/proj only"}