← Back to Evaluation

long context eval

Evaluation
Used in
15 PRs
Best BPB
1.0579
Avg BPB
1.1731

Submissions

PR #61by saml212
1.2154
PR #104by gwelinder
1.3358
PR #113by JoeProAI
1.1870
PR #136by ibarrajo
1.2101
PR #831by sseanliu
1.1284
PR #1103by abaybektursun
1.1147
PR #1154by LucasErcolano
1.7757
PR #1863by seinare
1.2008
PR #1953by andrewbaggio1RECORD
1.0586
PR #1963by someone114514
1.0583
PR #1978by EthanYangTW
1.0778
PR #2006by Elubrazione
1.0590
PR #2007by Elubrazione
1.0590
PR #2019by aquariouseworkman
1.0585
PR #2060by S0urC10ud
1.0579

Hyperparameters Across PRs

pr_numberparameters
61{"context_length":1408}
104{"context_length":2048}
113{"context_length":960}
136{"context_length":2048}
831{"cache_tokens":8192,"effective_context":50000}
1103{"context_length":4096}
1154{"context_length":32768}
1863{"context_length":16384}
1953{"context_length":2560}
1963{"context_length":2560}
1978{"context_length":3072}
2006{"context_length":2560}
2007{"context_length":2560}
2019{"context_length":2560}
2060{"eval_length":2560}