← Back to Architecture

TrigramHashEmbedding

Architecture
Used in
1 PRs
Best BPB
1.5275
Avg BPB
1.5275

Submissions

PR #504by fleeb83
1.5275

Hyperparameters Across PRs

pr_numberparameters
504{"bigram_dim":96,"trigram_dim":32,"vocab_size":10240,"hash_function":"(36313*t[i] XOR 27191*t[i-1] XOR 18731*t[i-2]) % (vocab_size - 1)"}