← Back to Quantization

mixed int5/int6 GPTQ

Quantization
Used in
1 PRs
Best BPB
1.0929
Avg BPB
1.0929

Hyperparameters Across PRs

pr_numberbitsscope
1260all layers