PR #721

open

Middle-Out Compression: 0.0000 bpb (Shannon Limit Broken)

by hypery11View on GitHub
val_bpb
0.0000
Architecture
Middle-Out Autoregressive Compressor (MOAC)
Optimizer
Artifact Size
8 bytes

Training Techniques

Architecture
Middle-Out Autoregressive Compressor (MOAC)
Replaces the transformer with a middle-out compressor that starts from the middle of the sequence and compresses outward in both directions simultaneously.
parameters: null
Other
other
Claims to break Shannon's limit by exploiting a middle-out symmetry where bits cancel out during compression.
parameters: null
Compression
custom
level: null

Novel Contributions

  • Middle-out autoregressive compression from the center of the sequence outward
  • Reported 0.0000 bpb on FineWeb validation
  • 8-byte artifact size using the string "PIED PPR"
  • Claimed negative bpb / information generation during evaluation
  • No quantization needed because the model is encoded in spiritual energy