Did Codex Reset
GitHub

Artificial Analysis averages Cyber Index across three benchmarks and scores safety refusals as zero

Artificial Analysis

Artificial Analysis says the Cyber Index averages scores across CWE-Bench-AA, DeepsecBench-AA, and CyberGym-E2E-AA. A task that a model declines on safety grounds scores zero. Those safety blocks are reported separately from failures, so refusals can be distinguished from cases where the model attempts a task and does not succeed.

The scoring rules are in the Cyber Index methodology. Full results are on the Artificial Analysis Cyber Index evaluation page.

#artificial-analysis#cyber-index#ai-benchmarks#model-safety

Artificial Analysis: GPT-6.1 Sol trails GPT-6 Astra by 1 point at under a quarter of the cost

Artificial Analysis says GPT-6.1 Sol replaces GPT-6 Sol after seven days, gains 4 Intelligence Index points on GPT-6 Sol, and costs $0.72 per task at max effort versus $3.26 for GPT-6 Astra. Its list price matches GPT-6 Sol at $2/$10 per million tokens, with the cache-read discount rising from 90% to 95%.