← Back to Optimizer
Parameter Banking + Parallel Muon
OptimizerUsed in
1 PRs
Best BPB
1.1552
Avg BPB
1.1552
Submissions
Hyperparameters Across PRs
| pr_number | weight_decay | momentum | other_params |
|---|---|---|---|
| 653 | 0.04 | 0.99 | {"adam_wd":0.04,"muon_momentum_warmup_start":0.92,"muon_momentum_warmup_steps":1500,"matrix_lr":0.025,"scalar_lr":0.025,"tied_embed_lr":0.035} |