← Back to Quantization
int6 QAT
QuantizationUsed in
15 PRs
Best BPB
0.9393
Avg BPB
1.1773
Submissions
PR #187by Idan3011
1.1629PR #325by Aum08Desai
1.1462PR #338by alertcat
1.1254PR #390by newjordan
1.1295PR #403by malc3om
1.1388PR #406by dentity007
1.1287PR #498by newjordan
1.1478PR #499by newjordan
1.1478PR #537by Christopher-Lee-McClendon
1.1387PR #552by loveless2001
1.1634PR #573by Sarimsaljook
1.0523PR #645by FlynnCruse
1.8990PR #702by lukacf
1.0244PR #810by Idan3011
0.9393PR #1383by nirmathur
1.3151Hyperparameters Across PRs
| pr_number | bits | scope |
|---|---|---|
| 187 | 6 | all |
| 325 | 6 | all |
| 338 | 6 | block weights |
| 390 | 6 | all |
| 403 | 6 | all |
| 406 | 6 | model weights |
| 498 | 6 | MLP and attention weights |
| 499 | 6 | MLP and attention weights |
| 537 | 6 | all model weights |
| 552 | 6 | — |
| 573 | 6 | MLP + attention |
| 645 | 6 | all |
| 702 | 6 | all |
| 810 | 6 | all |
| 1383 | 6 | model |