Terminal Bench Hard: Terminal-Bench Hard Subset

How It Works

Terminal Bench Hard is the harder slice of Terminal Bench. Tasks demand more planning, deeper error recovery, and longer chains of tool calls in a real Linux sandbox. It is a stress test for agent harnesses and the closest public proxy for "can this model handle a multi-hour devops task".

Same as Terminal Bench: each task has a verifier script that checks the final filesystem state. The Hard subset uses tighter budgets and harder problems. Scoring is task pass-rate.