← Back to Quantization
int5
QuantizationUsed in
22 PRs
Best BPB
0.0274
Avg BPB
0.8688
Submissions
PR #267by andrewgcodes
1.1374PR #288by trasnake87
1.2334PR #365by outsourc-e
1.1574PR #376by anthony-maio
1.1399PR #389by trasnake87
1.1466PR #430by sahiee-dev
1.1428PR #452by ofirkris
1.1366PR #465by LoquiAuris
1.1508PR #469by cmcdnd
1.1418PR #485by harsha-gouru
1.1522PR #602by ReNothingg
1.1422PR #671by keshav55
1.1807PR #779by deanbrr
0.6683PR #813by hypery11
0.6671PR #825by hypery11
0.5440PR #890by sofiabod
0.4405PR #945by TimPietrusky
0.0274PR #986by sofiabod
0.0830PR #1041by JoeProAI
1.1356PR #1186by andrewbaggio1
0.9850PR #1452by bsisduck
0.3509PR #1454by bsisduck
0.3509Hyperparameters Across PRs
| pr_number | bits | scope |
|---|---|---|
| 267 | 5 | all weights |
| 288 | 5 | all |
| 365 | 5 | MLP |
| 376 | 5 | mixed precision weights |
| 389 | 5 | all weights (MLP and attention) |
| 430 | 5 | all |
| 452 | 5 | MLP |
| 465 | 5 | MLP |
| 469 | 5 | MLP and attention weights |
| 485 | 5 | MLP weights |
| 602 | 5 | MLP |
| 671 | 5 | MLP weights |
| 779 | 5 | all |
| 813 | 5 | all |
| 825 | 5 | all |
| 890 | 5 | per-row |
| 945 | 5 | all |
| 986 | 5 | per-row |
| 1041 | 5 | all |
| 1186 | 5 | all |
| 1452 | 5 | all |
| 1454 | 5 | all |