← Back to Quantization

mixed int4/int6/int8

Quantization
Used in
1 PRs
Best BPB
1.0785
Avg BPB
1.0785

Submissions

PR #1731by Victory963
1.0785

Hyperparameters Across PRs

pr_numberbitsscope
1731—embeddings, attention, MLP, residuals