← Back to Quantization

AWQ

Quantization
Used in
3 PRs
Best BPB
1.0587
Avg BPB
1.0985

Hyperparameters Across PRs

pr_numberbitsscope
1732weights
1919int4-bound linear layers
1976model weights