AI Safety - Maginative (Page 4)

Scale AI Safety

Scale Announces Test & Evaluation Platform for LLMs: A Comprehensive Approach to AI Safety and Scalability

Chris McKay• August 11, 2023 • 4 min read

The company's unique vantage point as a data partner for OpenAI, Meta, Microsoft, Anthropic, and others, positions them perfectly to usher in a new era of standardized AI testing and evaluation.

AI Safety Research

RLHF In the Spotlight: Problems and Limitations with Key AI Alignment Technique

Chris McKay• July 31, 2023 • 3 min read

A new paper takes a closer look at serious open challenges related to RLHF, and emphasizes that relying solely on it for AI alignment is profoundly risky

AI Safety Research

“Sure, I’ll Help You Build a Bomb”: New Research Reveals Alarming Gaps in AI Safety

Chris McKay• July 29, 2023 • 6 min read

The new class of adversarial attacks are capable of circumventing the alignment measures designed to prevent the generation of inappropriate or harmful content in multiple LLMs.

AI Safety

Anthropic, Google, Microsoft, and OpenAI Establish Frontier Model Forum to Promote AI Safety

Chris McKay• July 26, 2023 • 3 min read

The Forum's establishment is rooted in its members' collective commitment to pooling their expertise for the sake of safer, more responsible AI development.

Anthropic AI Safety

Anthropic Calls for Stringent Security Safeguards for Frontier AI Models

Chris McKay• July 26, 2023 • 2 min read

Given the strategic implications of this technology, Anthropic says frontier models must be secured to levels surpassing standard practices for commercial technologies.

AI Policy AI Safety

Top AI Companies Meet at White House, Commit to Voluntary Governance Measures

Chris McKay• July 21, 2023 • 3 min read

The commitments, which companies say will remain in place until relevant regulations are enacted, address key risks associated with generative AI models surpassing today’s state-of-the-art capabilities.

Google Healthcare AI Safety

Google Proposes CoDoC, a Medical AI that Knows When to Defer to Human Experts

Chris McKay• July 19, 2023 • 3 min read

The model learns when predictive AI is offering correct information, and when it's better to defer to a clinician.

OpenAI AI Safety

The Paradox of OpenAI's Superintelligence Alignment Initiative

Chris McKay• July 6, 2023 • 2 min read

The company's latest initiative aims to solve superintelligence alignment within four years.