← Back to Quantization

LQER

Quantization
Used in
12 PRs
Best BPB
1.0567
Avg BPB
1.0631

Hyperparameters Across PRs

pr_numberbitsscope
1925asymmetric rank-4 correction
19342top-3 tensors
19384top-3 highest-error layers
20144correction
20344correction
20754block weights
20884rank-4
21344asymmetric rank-4
21354asymmetric rank-4
21434attn_proj and mlp_proj
21624top-3 tensors
21634top-3 tensors