Scale AI releases SWE-Bench Pro V2
Scale AI released SWE-Bench Pro V2 on September 22, 2026. It is a refreshed public split of SWE-Bench Pro.
Related AI news
Scale AI and Google Cloud partner on a reference architecture for the Scale GenAI Portfolio
The joint blueprint brings the Scale GenAI Portfolio to Google Cloud and includes Gemini Enterprise integration. Scale AI says it is meant to give builders a proven foundation for putting AI to work faster.
BRIDGE ASR 2.0 tests 23 speech recognition models on long multilingual conversations
elvis says humynlabs built BRIDGE ASR 2.0 to evaluate speech recognition on real two-person conversations lasting 10 to 15 minutes, in 18 Indic languages plus Spanish, Portuguese, and Vietnamese.
Microsoft paper reports a 16.6-point average gain for CASD prompt optimization
CASD has an off-the-shelf coding agent analyze a full set of agent logs and write the findings as rules in one prompt, with no environment access or validation data. DAIR.AI says one pass beat GEPA and SkillOpt on the reported benchmarks at about $1.60 per optimized prompt.
Best Taste-Bench model chooses the better direction 59.7% of the time
A paper from Microsoft and colleagues reports that the best model answers 59.7% of Taste-Bench questions correctly when choosing the better open direction in long engineering and research tasks. Forks decided by later evidence are much harder, a larger reasoning budget does not raise accuracy, and distilling a teacher’s outcome judgment improves held-out SWE-bench Pro success.
Cline offers Gemini 3.8 Flash for free
Gemini 3.8 Flash is free in Cline. Cline says it scores 41 on the Artificial Analysis Intelligence Index, runs at 291 tokens per second, and has a 1 million-token context window.