← Back to Quantization

int4

Quantization
Used in
6 PRs
Best BPB
1.0785
Avg BPB
1.1380

Submissions

PR #305by Naazimsnh02
1.1672
PR #375by charmquark1984
1.1257
PR #477by harsha-gouru
1.1522
PR #482by harsha-gouru
1.1522
PR #485by harsha-gouru
1.1522
PR #1732by Victory963
1.0785

Hyperparameters Across PRs

pr_numberbitsscope
3054MLP and attention weights
3754all
4774bigram logit table
4824bigram logit table
4854bigram logit table
17324MLP FC2 and residuals