LLMs

Elon Musk’s lawsuit is putting OpenAI’s safety record under the microscope

Published byAIDaily Editorial Team
6 min read
Original source author: Tim Fernholz

Elon Musk's legal effort to dismantle OpenAI may hinge on how its for-profit subsidiary enhances or detracts from the frontier lab's founding mission of ensuring that humanity benefits from artificial general intelligence.

Share:

Elon Musk’s legal effort to dismantle OpenAI may hinge on how its for-profit subsidiary enhances or detracts from the frontier lab’s founding mission of ensuring that humanity benefits from artificial general intelligence.

On Thursday, a federal court in Oakland, California, heard a former employee and board member say the company’s efforts to push AI products into the marketplace compromised its commitment to AI safety.

Rosie Campbell joined the company’s AGI readiness team in 2021, and she left OpenAI in 2024 after her team was disbanded. Another safety-focused team, the Super Alignment team, was shut down in the same time period.

“When I joined, it was very research-focused and common for people to talk about AGI and safety issues,” she testified. “Over time it became more like a product-focused organization.”

Under cross-examination, Campbell acknowledged that significant funding was likely necessary for the lab’s goal of building AGI but said creating a super-intelligent computer model without the right safety measures in place wouldn’t fit with the mission of the organization she originally joined.

Campbell pointed to an incident where Microsoft deployed a version of the company’s GPT-4 model in India through its Bing search engine before the model had been evaluated by the company’s Deployment Safety Board (DSB). The model itself did not present a huge risk, she said, but the company needed “to set strong precedents as the technology gets more powerful. We want to have good safety processes in place we know are being followed reliably.”

OpenAI’s attorneys also had Campbell admit that in her “speculative opinion,” OpenAI’s safety approach is superior to that at xAI, the AI company that Musk founded that was acquired by SpaceX earlier this year.

This Week Only: Buy one pass, get the second at 50% off

This Week Only: Buy one pass, get the second at 50% off

OpenAI releases evaluations of its models and shares a safety framework publicly, but the company declined to comment on its current approach to AGI alignment. Dylan Scandinaro, its current head of preparedness, was hired from Anthropic in February. Altman said the hire would let him “sleep better tonight.”

The deployment of GPT-4 in India, however, was one of the red flags that led OpenAI’s non-profit board to briefly fire CEO Sam Altman in 2023. That incident took place after employees, including then-chief scientist Ilya Sutskever and then-CTO Mira Murati, complained about Altman’s conflict-averse management style. Tasha McCauley, a member of the board at the time, testified about concerns that Altman was not forthcoming enough with the board for its unusual structure to function.

McCauley also discussed a widely reported pattern of Altman misleading the board. Notably, Altman lied to another board member about McCauley’s intention to remove Helen Toner, a third board member who published a white paper that included some implied criticism of OpenAI’s safety policy. Altman also failed to inform the board about the decision to launch ChatGPT publicly, and members were concerned about his lack of disclosure of potential conflicts of interest.

“We are a non-profit board and our mandate was to be able to oversee the for-profit underneath us,” McCauley told the court. “Our primary way to do that was being called into question. We did not have a high degree of confidence at all to trust that the information being conveyed to us allowed us to make decisions in an informed way.”

However, the decision to boot Altman came at the same time as a tender offer to the company’s employees. McCauley said that when OpenAI’s staff started to side with Altman and Microsoft worked to restore the status quo, the board ultimately reversed course, with the members opposed to Altman stepping down.

The apparent failure of the non-profit board to influence the for-profit organization goes directly to Musk’s case that the transformation of OpenAI from research organization into one of the largest private companies in the world broke the implicit agreement of the organization’s founders.

David Schizer, a former dean of Columbia Law School who is being paid by Musk’s team to act as an expert witness, echoed McCauley’s concerns.

“OpenAI has emphasized that a key part of its mission is safety and they are going to prioritize safety over profits,” Schizer said. “Part of that is taking safety rules seriously, if something needs to be subject to safety review, it needs to happen. What matters is the process issue.”

With AI already deeply embedded in for-profit companies, the issue goes far beyond a single lab. McCauley said the failures of internal governance at OpenAI should be a reason to embrace stronger government regulation of advanced AI — “[if] it all comes down to one CEO making those decisions, and we have the public good at stake, that’s very suboptimal.”

When you purchase through links in our articles, we may earn a small commission . This doesn’t affect our editorial independence.

StrictlyVC Athens is up next. Hear unfiltered insights straight from Europe’s tech leaders and connect with the people shaping what’s ahead. Lock in your spot before it’s gone.

Hackers deface school login pages after claiming another Instructure hack Lorenzo Franceschi-Bicchierai Zack Whittaker

Hackers deface school login pages after claiming another Instructure hack

Hackers deface school login pages after claiming another Instructure hack

Hackers steal students’ data during breach at education tech giant Instructure Lorenzo Franceschi-Bicchierai

Hackers steal students’ data during breach at education tech giant Instructure

Hackers steal students’ data during breach at education tech giant Instructure

As workers worry about AI, Nvidia’s Jensen Huang says AI is ‘creating an enormous number of jobs’ Lucas Ropek

As workers worry about AI, Nvidia’s Jensen Huang says AI is ‘creating an enormous number of jobs’

As workers worry about AI, Nvidia’s Jensen Huang says AI is ‘creating an enormous number of jobs’

Anthropic and OpenAI are both launching joint ventures for enterprise AI services Russell Brandom

Anthropic and OpenAI are both launching joint ventures for enterprise AI services

Anthropic and OpenAI are both launching joint ventures for enterprise AI services

Ouster’s new color lidar is coming to replace cameras Sean O'Kane

Ouster’s new color lidar is coming to replace cameras

Ouster’s new color lidar is coming to replace cameras

This tiny, magnetic e-reader could stop you from doomscrolling Amanda Silberling

This tiny, magnetic e-reader could stop you from doomscrolling

This tiny, magnetic e-reader could stop you from doomscrolling

Uber wants to turn its millions of drivers into a sensor grid for self-driving companies Connie Loizos

Uber wants to turn its millions of drivers into a sensor grid for self-driving companies

Uber wants to turn its millions of drivers into a sensor grid for self-driving companies

Key takeaways

  • Musk's legal dispute highlights the importance of safety and ethics in AI development, especially for Brazilian companies.
  • Changes in corporate governance can impact the original mission of tech companies, emphasizing the need for solid structures.
  • The comparison between OpenAI's and xAI's safety approaches may indicate growing divides in AI development philosophies.

Editorial analysis

The legal dispute involving Elon Musk and OpenAI highlights crucial issues regarding safety and ethics in artificial intelligence development, which are particularly relevant for the tech sector in Brazil. As Brazilian companies begin to explore and implement AI solutions, the pressure for safe and transparent practices becomes increasingly evident. Rosie Campbell's experience, where she testified about OpenAI's shift from research to products, can serve as a warning for startups and established companies in Brazil, which must ensure that their innovations do not compromise safety and ethics in pursuit of quick financial results.

Moreover, the situation raises questions about corporate governance in tech companies. The fact that OpenAI faced an internal crisis that led to the temporary firing of its CEO suggests that the pressure for results can lead to decisions that are not aligned with the company's original mission. For the Brazilian market, this emphasizes the importance of a solid governance structure that prioritizes safety and social responsibility, especially in a scenario where AI is becoming increasingly integrated across various industries.

Finally, the comparison between OpenAI's safety approach and that of Musk's xAI may indicate a growing divide between different philosophies in AI development. As Brazil advances in AI regulation and implementation, it will be essential to observe how these dynamics unfold and what lessons can be learned. The future of AI in Brazil may be shaped by these discussions, and the need for a commitment to safety and ethics will be fundamental for the long-term success of the sector.

What this coverage includes

  • Clear source attribution and link to the original publication.
  • Editorial framing about relevance, impact, and likely next developments.
  • Review for readability, context, and duplication before publication.

Original source:

TechCrunch AI

About this article

This article was curated and published by AIDaily as part of our editorial coverage of artificial intelligence developments. The content is based on the original source cited below, enriched with editorial context and analysis. Automated tools may assist with translation and initial structuring, but publication decisions, factual review, and contextual framing remain editorial responsibilities.

Learn more about our editorial process