fp16

Quantization

Used in

26 PRs

Best BPB

1.1361

Avg BPB

1.1885

Hyperparameters Across PRs

pr_number	bits	scope
42	16	tied embeddings / output head
60	16	tied embeddings
63	16	tied embeddings passthrough
89	16	tied embeddings / logit head
95	16	embeddings
107	16	tied embeddings
114	16	tied embedding and last 2 layers' key projections
151	16	embeddings
155	16	tied embeddings
163	16	embeddings
166	16	tied embeddings
186	16	tied embedding and late-K layers
191	16	tied embeddings and last two c_k weights
251	16	embeddings
267	16	tied embeddings and last-layer key projections
271	16	embeddings
284	16	tied embeddings
351	16	tied embeddings and small tensors
355	16	tok_emb.weight
372	16	token embedding and last layer c_k
381	16	embeddings
434	16	tied embeddings
452	16	embeddings
515	16	tied embeddings passthrough
1027	16	tied embeddings
1048	16	selected embedding rows