← Back to Quantization

mixed int4/int5/int6

Quantization
Used in
1 PRs
Best BPB
1.1005
Avg BPB
1.1005

Submissions

PR #2066by SarooshKhan897
1.1005

Hyperparameters Across PRs

pr_numberbitsscope
2066—FFN gate/down, Mamba, attention, embeddings