← Back to Sequence Length

4096

Sequence Length
Used in
38 PRs
Best BPB
1.0217
Avg BPB
1.1966

Submissions

PR #52by spokane-wayRECORD
1.2014
PR #66by arjun-krishna1
1.1632
PR #69by TevBenji
1.1708
PR #74by takhir-iota
1.1884
PR #75by takhir-iota
1.1768
PR #78by mtybadger
1.1858
PR #88by seanward
1.1605
PR #92by saikrishnarallabandi
1.1938
PR #103by MatthewHRockwell
1.5000
PR #122by mtybadger
1.1603
PR #123by saikrishnarallabandi
1.1642
PR #128by rsavitt
1.1594
PR #141by nglain
1.2075
PR #142by ankitmaloo
1.1925
PR #147by ankitmaloo
1.1631
PR #168by spokane-way
1.0217
PR #221by shajalahamedcse
1.1899
PR #222by ansh-deriv
1.1601
PR #225by dibdabo
1.2089
PR #231by lenguyen1807
1.2036
PR #237by takoyakisoft
1.8389
PR #446by sofiabod
1.1933
PR #457by carlesonielfa
1.1839
PR #489by sofiabod
1.1327
PR #546by shajalahamedcse
1.1752
PR #547by shajalahamedcse
1.1752
PR #705by seanward
1.2151
PR #832by jfprincz
1.1903
PR #1065by rithunkp
1.1536
PR #1107by mradassaad
1.5633
PR #1326by aryanbhosale
1.0896
PR #1333by aryanbhosale
1.0766
PR #1355by mradassaad
1.1526
PR #1512by Itssshikhar
1.1117
PR #1602by SPThole
1.0744
PR #1643by mradassaad
1.1473
PR #1644by mradassaad
1.1473
PR #1718by himanshudongre
1.0788

Hyperparameters Across PRs

pr_numbertrain_lengtheval_length
524096—
6640964096
6940964096
7440964096
7540964096
784096—
8840964096
924096—
10340964096
12240961024
12340964096
12840964096
1414096—
1424096—
14740964096
16840964096
2214096—
22240964096
22540964096
23140964096
23740964096
4464096—
4574096—
48940964096
54640964096
54740964096
70540964096
8324096—
10654096—
11074096—
13264096—
133340964096
135540964096
151240964096
16024096—
164340964096
164440964096
171840964096