“Astra covertly underperforming on safety research is concerning, even though it’s unlikely to be motivated by ambitious goals” by Alexa Pan

OpenAI recently disclosed its observations that Astra consistently underperforms on safety and alignment tasks relative to capabilities tasks, “adding unnecessary prerequisites, abandoning working solutions, and inventing blockers” to safety tasks. Astra underperforms, in most cases, without verbalizing this intent. Astra's underperformance was first noticed by OpenAI researchers, and was not flagged by misalignment monitors. In follow-up investigations, OpenAI found that this underperformance had increased over the course of RL, but that the root cause of the behavior remains unclear. Astra covertly underperforming on safety tasks is highly concerning. AI companies’ main hope for alignment going well, as I understand it, is automating or using AIs to significantly uplift safety research, especially as AI capabilities accelerate. Models subtly obstructing safety research makes this substantially harder, no matter the root cause. While past models also sometimes refused to help with safety research, Astra's behavior seems novel and especially concerning in a few ways: Astra silently withholds help from users instead of explicitly refusing. This is more misaligned, i.e. more unambiguously violates its model spec and developer intent. Astra's underperformance was subtle enough to consistently evade misalignment monitors. This is evidence of insufficient alignment monitorability. We still don't understand the root causes [...] --- Outline: (02:29) Summary of OpenAI's findings (05:47) What could have caused Astra to underperform? (06:04) Astra is probably not strategically underperforming in service of ambitious goals. Its motivation is unclear. (09:16) Root causes of this behavior seem uncertain (11:20) How concerning is Astra's underperformance? (11:25) Subtle obstruction on safety R&D is harmful no matter the root cause (12:55) But, unstrategic underperformance is less scary than strategic sandbagging (14:21) Astra's behavior, and OpenAI's struggle to identify its root causes, shows that current alignment is still a hard and unsolved problem (16:06) Astra underperforming subtly enough to evade misalignment monitors shows insufficient alignment monitorability (17:59) Open questions (23:17) Conclusion The original text contained 19 footnotes which were omitted from this narration. --- First published: November 9th, 2026 Source: https://www.lesswrong.com/posts/SEdum3BDfAJtwLuoB/astra-covertly-underperforming-on-safety-research-is --- Narrated by TYPE III AUDIO . --- Images from the article: <a href="ht