← Back to Quantization

int5 GPTQ

Quantization
Used in
2 PRs
Best BPB
1.1162
Avg BPB
1.1170

Hyperparameters Across PRs

pr_numberbitsscope
5445per-row all weights
6065all