← Back to Architecture

LoRA

Architecture
Used in
6 PRs
Best BPB
0.9623
Avg BPB
1.3471

Hyperparameters Across PRs

pr_numberparameters
103{"rank":4}
777{"rank":8}
1300{"rank":512,"scope":"q"}
1341{"rank":8,"targets":["Q","V"]}
1385{"rank":16}
1684{"rank":16}