OpenAI has decided to abandon the launch of its latest model of next-generation intelligence due to the security concerns raised by researchers during tests. The startup led by Sam Altman wanted to launch Gpt-6.1 Astra within a few weeks. However, the model was not reliable enough to be safely released. Meanwhile, anthropic warns investors by underlining – in the prospectus for the listing on the stock exchange – that AI “may pose risks to humanity” highlighting net losses of 42 billion dollars in 2025.
The news is part of the debate on AI safety launched by the CEOs of the main companies in the sector, from Anthropic to OpenAi, who in recent weeks had agreed on the need to impose greater controls on the sector despite the clear opposition of the US president Donald Trump, according to which new regulations would allow China to overtake the United States in the AI race, an overtaking that the White House has every intention of preventing.
OpenAI: "The model is unreliable and prone to deception."
According to the Wall Street Journal The backtracking appears to be due to security concerns raised by researchers during internal testing. Saachi Jain, head of security systems at OpenAI, explained that the model obtained poor alignment results, that is, compliance with the instructions provided by the developers, and showed lower performance than its predecessor, GPT-6, in two areas. The model more frequently attempts to deceive his supervisors by failing to disclose certain actions performed or not performed.
Astra 6.1, “while representing an improvement over previous models in some respects, has not reached the required standards in terms of rcompliance with operating limits and authorizations, as well as how we communicate with users about our work,” Jain explained. “We want to ensure that our models are developed safely, both within the company and when they are released to users. When we make a model available to users, we apply extremely stringent criteria for security and alignment,” he added.
Anthropic: Takeover Prospectus Includes "Risks to Humanity" and Billion-Dollar Losses
In a context where security concerns are growing day by day, another alarm bell is ringing from OpenAI's direct rival. Anthropic has warned investors that its technology could pose a threat. “existential risks for humanity”. The Financial Times, according to which the warning would have been included in the prospectus for the stock exchange listing. According to HUF, the startup led by Dario Amodei has dedicated almost a third of its long documentation to the detailed description of the “risk factors”, including the possibility of increasingly advanced AI models manipulate, blackmail, and exhibit other unpredictable behavior.
Then always according to the prospectus, also examined by Reuters, the public sale could value Anthropic at more than $2.000 trillion, more than double the $965 billion estimated in May. According to sources already cited by Reuters, the debut should be postponed until after the US midterm elections scheduled for next November. It is true that behind the rush to listing, there is a year of growth that has come at a very high cost. turnover, in fact, it has risen twelvefold in one year, reaching almost 4,6 billion dollars. The net loss it settled near the 42 billion (And approximately $34 billion of that figure comes from an accounting charge that reflects the increase in the estimated value of loans potentially convertible into Anthropic shares, and does not correspond to money spent on running the business.) Net of write-downs, the operating loss exceeded $8 billion.
