← Back to Architecture

logit softcap

Architecture
Used in
6 PRs
Best BPB
0.9076
Avg BPB
1.0970

Submissions

PR #211by dubthecat
1.1719
PR #367by ksang123
1.1770
PR #828by bigbag
0.9076
PR #970by dnldsz
1.2907
PR #1263by xexyz
0.9354
PR #1749by gracebml
1.0996

Hyperparameters Across PRs

pr_numberparameters
211{"softcap":30}
367{"value":30}
828{"value":30}
970{"degree":5,"cap":30}
1263{"softcap":30}
1749{"value":30}