← all tags

#evaluation

2 posts tagged evaluation.

Thoughts

Benchmarks Are Just Vibes With Extra Steps

AI benchmarks have become a performance for investors, not a signal of real capability.

benchmarking coding-agents evaluation reward-hacking

Agent benchmarks are just unit tests for unpredictable systems

We're measuring agent performance like it's deterministic software when the whole point is emergent behaviour.

agentic-ai benchmarks testing evaluation