← Back to Architecture

MTP auxiliary head

Architecture
Used in
1 PRs
Best BPB
1.1605
Avg BPB
1.1605

Submissions

PR #88by seanward
1.1605

Hyperparameters Across PRs

pr_numberparameters
88{"num_heads":1,"loss_weight":0.01}