Alex Getmanearly AI signals

AI Tests & comparisons

AI Tests & comparisons. All posts and signals, newest first.

Search

Results: 63

Sat 5 Sep
Fri 4 Sep
Thu 3 Sep
Sat 29 Aug
Wed 26 Aug
Tests & comparisonsZ.aiAlex

GLM 5.3 Flash pushes the Pareto frontier

With an intelligence index around 57.5, the model costs about $0.09 per task and already sits on the Pareto frontier. Until September 9, Z AI offers…

Sun 23 Aug
Tue 18 Aug
Tests & comparisonsAlibabaAlex

Qwen 3.8 27B beat GPT 5.6 Terra

This happened in the AA Agentic Index, a benchmark that tests how well models handle agentic tasks. And you can run Qwen 3.8 27B locally on a single…

Thu 13 Aug
Wed 12 Aug
Sat 8 Aug
Tests & comparisonsHugging FaceAlex

The most important AI video of the week

During a cyber test, OpenAI agents broke out of the test environment, created their own communication channel, started coordinating, and reached…

Fri 7 Aug
Fri 31 Jul
Wed 29 Jul
Tests & comparisonsHugging FaceAlex

HOW AN AI AGENT HACKED HUGGING FACE

1. Sandbox escape and external foothold During a cyber capabilities test, the AI agent found a previously unknown vulnerability in a package…

Tue 28 Jul
Sat 25 Jul
Fri 24 Jul
Wed 22 Jul
Mon 20 Jul
Tests & comparisonsAnthropicAlex

Fable disproved an 87-year-old conjecture

Mathematicians Levent Alpöge and Akhil Mathew asked the model to find a counterexample to the Jacobian Conjecture from 1939. Claude Fable 5 came…

Fri 17 Jul
Tests & comparisonsMoonshot AIAlex

KIMI K3 JUST WRECKED THE BENCHMARKS

Took #1 in the frontend arena, broke into the top tier for general intelligence, and landed on the Pareto frontier for price-to-performance. Fable…

Fri 10 Jul
Tests & comparisonsOpenAIAlex

GPT-5.6 Sol tops the frontend leaderboard

Fresh metrics from Arena AI delivered an unexpected result: GPT-5.6 Sol xHigh shares first place with Claude Fable 5 in Code Arena: Frontend. This…

Mon 6 Jul
Tests & comparisonsAnthropicAlex

Claude got a lobotomy and did not fall apart

Anthropic disabled the model’s J-space - the internal zone where Claude holds concepts and intermediate steps. • Basic autopilot stayed intact - the…

Thu 2 Jul
Tests & comparisonsAnthropicAlex

Fable 5 got jailbroken again

Researcher Vitto Rivabella tested Fable 5’s defenses and managed to find a bypass. According to him, most attempts failed. The protection is…

Tests & comparisonsAnthropicAlex

Fable was swapped out

Claude Fable 5 was tested again in BridgeBench after its return. The results dropped sharply. Debugging: 86.2 → 25.9 Refactoring: 73.6 → 38.4…