FreeTheAI

Anthropic Grants Non-Profit METR Employee-Level Access for AI Safety Oversight

BullishLow impact
ACN$224.46 4.42%

Artificial intelligence company Anthropic (NASDAQ:ANTHROPIC) has expanded its third-party safety assessments by granting employee-level access to METR, a non-profit organization that evaluates frontier AI models. As part of the arrangement, Anthropic onboarded six METR staff members, providing them with internal tools, systems, company hardware, and dedicated office space to conduct deep safety evaluations.

The initiative allows external evaluators to review technical details that cannot be released publicly due to commercial sensitivity or security risks, such as training procedures and compute resources. METR will independently publish reports on risk levels, incidents, and practices. Anthropic cannot veto publication, though it retains narrow redaction rights for protected categories, and METR remains free to publicly challenge whether those redactions were justified.

Anthropic is also working on evaluation efforts with SecureBio and Accenture Plc Class A (NYSE:ACN), whose shares rose 4.88% to $225.40 today. In addition, Anthropic is holding discussions regarding potential evaluation collaboration with Hugging Face.

Key points

  • Anthropic granted six employees from non-profit evaluator METR full access to internal systems, hardware, and office space.
  • METR will publish risk and safety assessments without Anthropic holding veto rights over the findings.
  • Anthropic can request narrow redactions for sensitive training and compute data, which METR can publicly evaluate.
  • Anthropic is also working with Accenture and SecureBio while discussing evaluation efforts with Hugging Face.

Written by our AI from expert market sources across the web. It can contain mistakes: check the facts before acting on them. Write-ups powered by the free AI API at FreeTheAI.org

How we writeDisclaimer

Questions and answers

What access did Anthropic grant to METR for AI safety evaluations?

Anthropic onboarded six METR employees with company hardware, office space, and access to internal tools and systems for model evaluation.

Can Anthropic veto publication of METR safety reports?

Anthropic cannot veto publication, but it can require narrow redactions for sensitive information, which METR can publicly critique.

Which other organizations are working with Anthropic on safety?

Anthropic is working with SecureBio and Accenture Plc Class A, and is in discussions with Hugging Face regarding safety efforts.