# NVIDIA Mid-Harness raises TerminalBench-Lite Pass@1 from 50.0% to 68.0%

An NVIDIA paper on test-time compute for terminal agents says a GPT-5.6 Sol verifier choosing among eight sampled shell commands lifts TerminalBench-Lite Pass@1 from 50.0% to 68.0%. Extra samples add almost nothing when the verifier is weak.

Language: en
Time zone: America/Los_Angeles
Current time (UTC, cached as of): 2026-11-22T13:08:00.000Z
Query date (America/Los_Angeles): 2026-11-22

HTML: https://didcodexreset.com/news/3ff7d6fe58a745f7867d154b.html

Content language: en
Localization state: sameLanguage

Source: DAIR.AI · Published 10/4/2026, 04:21:34

Mid-Harness leaves the generator and harness unchanged and works between them. It samples several candidate shell commands and verifies them before one is run. The paper finds that spending more compute on the verifier is more useful than drawing extra samples.

With GPT-5.6 Sol choosing among eight sampled actions, TerminalBench-Lite Pass@1 rises from 50.0% to 68.0%. A weak verifier gains almost nothing from additional samples. When the small TMAX-9B model checks its own candidates, pairwise comparison works best, and distilling the strong verifier into TMAX-9B helps further. Combining action sampling with trajectory sampling reaches higher success at a lower estimated token cost than sampling full trajectories alone. The paper is [Mid-Harness](https://academy.dair.ai/papers/mid-harness-scaling-actions-between-model-and-harness-for-terminal-agents-2609.39982).

Tags: NVIDIA, Mid-Harness, TerminalBench, test-time compute, terminal agents

[View original post](https://x.com/dair_ai/status/2106700907106943107)
