AI Whistleblowers Call for Increased Safety Oversight and Employee Protections
The letter makes a case for stronger whistleblower protections, arguing that current measures are insufficient to address the unique challenges posed by AI.
AI Safety
A collection of 84 posts
OpenAI Releases Report on Disrupting AI-Powered Influence Operations
The report provides valuable insights into the evolving landscape of deceptive influence operations and the measures needed to address them.
OpenAI Forms Safety and Security Committee
This move comes amid scrutiny and high-profile concerns about the company's commitment to AI safety, especially following the recent departures of key personnel involved in AI safety and "superalignment" work.
Google Introduces Frontier Safety Framework to Identify and Mitigate Future AI Risks
The Frontier Safety Framework focuses on severe risks posed by advanced AI models, such as those with exceptional autonomy or sophisticated cyber capabilities.
OpenAI Introduces Tools to Help Identify AI-Generated Content
Deepfakes, or AI-generated fake content, have already impacted political campaigning and voting in various countries, including Slovakia, Taiwan, and India.
NIST Launches GenAI Program to Evaluate and Measure Generative AI Technologies
NIST GenAI will release benchmarks and evaluate generative AI technologies through a series of challenge problems. One of its key goals is to develop systems that can distinguish between human-created and AI-generated content, starting with text.
DHS Establishes AI Safety and Security Board with Industry Leaders
The Board will develop recommendations to help critical infrastructure stakeholders, such as transportation service providers, pipeline and power grid operators, and internet service providers, more responsibly leverage AI technologies.
AI as a "New Digital Species": Thoughts on Microsoft AI Chief's TED Talk
By proposing the "digital species" metaphor, he offers a new lens through which to view AI's potential and pitfalls. It invites us to consider the long-term implications of this technology and our responsibility in shaping its evolution.
Meta to Require "Made with AI" Labels for AI Generated Content
The new labels will cover a broader range of content than the company's current manipulated media policy
Anthropic Shares Research on Technique to Exploit Long Context Windows to Jailbreak Large Language Models
Many-shot jailbreaking works by prompting the model with a large number of fictitious question-answer pairs that depict the AI assistant providing harmful or dangerous responses.
U.S. and U.K. Announce Partnership on AI Safety Testing
The partnership comes at a crucial time as AI continues to develop rapidly, and both governments recognize the need for a shared approach to AI safety that can keep pace with the technology's emerging risks.
Chinese Software Engineer Arrested for Alleged Theft of AI Trade Secrets from Google
The indictment describes how, unbeknownst to Google, Ding had affiliated himself with two Chinese technology companies, Rongshu and Zhisuan, while employed at Google.
Google Launches AI Cyber Defense Initiative to Help Defenders Gain the Upper Hand
Google believes AI can address systemic issues that contribute to the imbalance favoring attackers. It provides reasoning capabilities to tackle complexity, learning to evolve defenses, speed unmatched by humans, and ability to process security data at enormous scale.
How Anthropic Is Safeguarding Users Against Election Misinformation
By combining policy, technical safeguards, and transparent communication, Anthropic aims to responsibly navigate AI through a high-stakes election year.
Leading Tech Companies Pledge to Protect 2024 Elections from Deceptive AI
As part of the accord, companies agreed to eight commitments including assessing AI systems that could enable election deception campaigns, seeking to detect deepfakes on their platforms, providing transparency around policies, and supporting public awareness efforts.
State-Affiliated Hackers from China, Russia, Iran and North Korea Used ChatGPT to Boost Cyberattacks
While concerning, Microsoft and OpenAI said the observed activities suggest AI is currently providing "only limited, incremental capabilities" for advanced hacking beyond existing methods.
Bugcrowd Lands $102M to Expand Crowdsourced Security Platform
The new capital will support continued enhancements of Bugcrowd's software-as-a-service platform, investments in sales, marketing and partnerships, as well as potential M&A opportunities to expand its capabilities.
CMS Bans Medicare Advantage Insurers From Using AI to Deny Care
CMS worries that AI could perpetuate discrimination or fail to account for unique patient needs.
F.C.C. Bans AI-Generated Robocalls
The decision aims to curb an emerging tactic used by fraudsters and scammers who leverage machine learning to mimic voices and personas.
Top US Companies Join AI Safety Institute Consortium
The AISIC represents a crucial step in implementing President Biden's executive order on AI, which directed federal agencies to address emerging issues like AI security, red team testing, deepfakes detection, and algorithmic discrimination.
Google Joins C2PA Steering Committee to Increase Transparency of Online Content
The push for transparency comes as AI-generated media grows more advanced and increasingly difficult to distinguish from authentic content.
Meta Says It Will Label AI Content Across Platforms
The company already creates labels for content created with Meta AI, however, the aim is to extend this to content created using other tools as well.
Bumble Takes On Scammers With New A.I. Safety Feature
Within two months of early testing, Bumble saw user-reported cases of spam, scams and fakes drop by 45% across its platforms.
Beware: Multi-National Company Loses HK$200 Million in Elaborate Deepfake Scam
Posing as headquarters executives, they convinced the Hong Kong employees to make a series of large money transfers, claiming it was for a confidential corporate transaction.
OpenAI and Common Sense Partner to Promote Safe, Responsible AI Use Among Kids
This collaboration aims to harness the potential of AI for the benefit of teens and families while addressing the challenges it presents.