← Back to Quantization

mixed int6/int8 QAT

Quantization
Used in
1 PRs
Best BPB
1.1690
Avg BPB
1.1690

Hyperparameters Across PRs

pr_numberbitsscope
4746MLP and attention int6, embeddings int8