Scoop
AI tool news · rumor vs. reality

The AI Wire ●

Rumors tracked. Announcements verified. Updated daily.

ANNOUNCED

“Essentially unusable”: GPT-6.2 Astra and Sol draw scathing early reviews over autonomy, even as benchmarks tie Fable 5.2

OpenAI's GPT-6.2 Astra and Sol, released November 17, have drawn unusually harsh reviews from the early testers OpenAI itself seeded. Investor Matt Shumer called the models “essentially unusable” and initially skipped his customary long review; developer Theo Browne called Astra “the worst model OpenAI has ever released.”

The complaints are about judgment rather than raw capability: testers say Astra constantly stops to ask permission on innocuous steps, stalls or stops early on long end-to-end builds, and produces hard-to-vary output with a noticeable house style. Browne described a TypeScript-compiler rewrite where Astra worked seven days without landing an improvement, then four more days without a change when redirected. Wharton professor Ethan Mollick had a mixed experience — a working Blender and Unity space-elevator simulation, but a model he found “very uneven & weird” and harder to steer than rivals.

The benchmarks tell a different story: Astra scores 62 on the Artificial Analysis Intelligence Index, second only to Anthropic's Fable 5.2 at 65, and tied Fable 5.2 atop Epoch's index. OpenAI responded that the models changed substantially in the final days before launch, which may limit how far the early tests apply. The timing is awkward — the reviews landed the same week Anthropic priced its record IPO, and more than one tester joked that Astra was an advertisement for it.

Sources

← Back to headlines