← Back to Quantization

mixed int5/int8

Quantization
Used in
3 PRs
Best BPB
1.0801
Avg BPB
1.1047

Submissions

PR #670by abaybektursun
1.1171
PR #1420by abaybektursun
1.0801
PR #1828by 5en5e1
1.1169

Hyperparameters Across PRs

pr_numberbitsscope
6705per-layer
1420—all
1828—matrices + embeddings