← Back to Quantization
int4
QuantizationUsed in
15 PRs
Best BPB
1.0599
Avg BPB
1.1670
Submissions
PR #305by Naazimsnh02
1.1672PR #375by charmquark1984
1.1257PR #477by harsha-gouru
1.1522PR #482by harsha-gouru
1.1522PR #485by harsha-gouru
1.1522PR #1732by Victory963
1.0785PR #1844by Hetul803
1.3110PR #1855by codemath3000RECORD
1.0611PR #1874by AjAnubolu
1.0677PR #2026by RahimMirani
1.0611PR #2031by deborahnelson8788726
1.0599PR #2038by FF-GardenFn
1.2000PR #2040by FF-GardenFn
1.2543PR #2044by FF-GardenFn
1.3978PR #2056by FF-GardenFn
1.2646Hyperparameters Across PRs
| pr_number | bits | scope |
|---|---|---|
| 305 | 4 | MLP and attention weights |
| 375 | 4 | all |
| 477 | 4 | bigram logit table |
| 482 | 4 | bigram logit table |
| 485 | 4 | bigram logit table |
| 1732 | 4 | MLP FC2 and residuals |
| 1844 | 4 | skip_gates and skip_weights |
| 1855 | 4 | LQER correction |
| 1874 | 4 | LQER asymmetric per-group correction |
| 2026 | 4 | LQER correction |
| 2031 | 4 | LQER correction |
| 2038 | 4 | model weights |
| 2040 | 4 | model export |
| 2044 | 4 | exported model |
| 2056 | 4 | all |