🪢 SlopBench — how much code do LLMs inflate?

Each model solves the same 5 Python tasks inside a sandbox (no network, non-root). inflation = generated LOC ÷ reference LOC, only for runs that pass the tests (pass@1 ≥ 0.6). Δ ponytail = LOC saved by the minimalism system prompt vs vanilla.

loading…