PhysDreamer Brings Realistic, Interactive Dynamics to AI-Generated Video
The key idea behind PhysDreamer is to generate a plausible video of the object in motion and then optimize the material properties to match this synthesized motion.
Research
A collection of our articles covering the latest in AI research. Get comprehensive analyses and insights into the cutting-edge AI models and breakthroughs from leading tech companies and research labs.
Microsoft's VASA can Create a Realistic Talking Head Video from a Single Photo
VASA demonstrates superior performance compared to existing methods, delivering high-quality video frames with precise lip-audio synchronization and a diverse array of lifelike facial dynamics.
Apple Introduces MobileCLIP, a State-of-the-Art Image-Text Model for Mobile Devices
Apple's multi-modal reinforced training demonstrates 10-1000x improved learning efficiency compared to standard CLIP training.
Anthropic Shares Research on Technique to Exploit Long Context Windows to Jailbreak Large Language Models
Many-shot jailbreaking works by prompting the model with a large number of fictitious question-answer pairs that depict the AI assistant providing harmful or dangerous responses.
Google DeepMind's New Research Shows LLMs Can Outperform Humans in Fact-Checking
The research introduces a novel method for evaluating long-form factuality in LLMs, demonstrating that bigger models are more factual and that LLMs are 20 times cheaper than human annotators.
NVIDIA's LATTE3D Can Generate 3D from Text Prompts in Seconds
Like a virtual 3D printer, LATTE3D turns text prompts into 3D representations of objects and animals within a second.
Meet SIMA: Google's New AI that Can Play Video Games with You
The research is building towards more general AI systems and agents that can understand and safely carry out a wide range of tasks in a way that is helpful to people online and in the real world.
Tencent Proposes Technique to use LLMs to Make Diffusion Models More Accurate
By enabling diffusion models to more faithfully visualize the content of natural language prompts, this approach opens up exciting possibilities for creative applications and beyond.
Orca-Math Shows the Potential of Specialized Small Language Models
The research shows the value of smaller, specialized models in specific domains, where they can match or even surpass the performance of much larger models.
Meet EMO, Alibaba's New AI That Can Make Any Photo Talk or Sing
By enabling the generation of highly expressive and lifelike videos from a single reference image and audio input, EMO opens new avenues in entertainment, telepresence, and beyond.
Smart Gloves From MIT Can Teach You to Play the Piano
The adaptive smart glove is capable of sending tactile feedback to teach users new skills, guide robots with more precise manipulation, and assist in the training of surgeons and pilots.
Meta is Teaching AI to Understand and Model the Real World by Watching Videos
Yann LeCun says this approach could lead to more flexible reasoning, planning, and general intelligence.
TikTok Releases Boximator for Fine-Grained Motion Control in AI-Generated Videos
Under the hood, Boximator functions as a plug-in that infuses existing video synthesis models with these user constraints. It trains an additional module while freezing base model weights, enabling straightforward integration with state-of-the-art systems.
Cohere For AI Opensources Aya, a 101-Language AI Model
Aya is an open science project that aims to build a multilingual language model via instruction tuning that harnesses the collective wisdom and contributions of people from all over the world.
An AI That Learns Like A Baby
The system, dubbed the Child's View for Contrastive Learning (CVCL) model, was fed 37,500 utterances captured from 61 hours of first-person video recorded by a baby named Sam from ages 6 months to 2 years old.
Does ChatGPT Make Developing Bioweapons Easier?
The study aims to determine whether increased information access using language models like GPT-4 could help bad actors more easily compile knowledge for crafting biological agents vs. existing online resources.
InstantID Allows You to Easily Create Consistent Characters with Generative AI
With just a single reference image, InstantID can generate a similar persona in any style with high fidelity.
Lumiere is an Impressive New Text-to-Video AI from Google
This model is designed to create realistic, diverse, and coherent motion in videos, a task that has historically been challenging in the field of artificial intelligence and computer vision.
TikTok's Depth Anything Models Sets New Standards for Robust Image-Based Depth Estimation
In zero-shot evaluations on datasets like KITTI, NYUv2 and Sintel, Depth Anything models significantly outperformed the previous state-of-the-art MiDaS v3.1 models on both absolute relative error and accuracy metrics.
Making AI More Self-Aware: Google Introduces ASPIRE Framework to Boost Confidence in LLM Responses
ASPIRE enables models to output an uncertainty warning like "I don't know!" along with the prediction if the confidence score is low.
Google DeepMind's AI Masters Geometry at the Highest Levels
The AI exhibited expertise on par with International Mathematical Olympiad (IMO) gold medalists on a benchmark test of 30 challenging classic geometry problems.
Deceptive "Sleeper Agent" AIs Can Slip Past Sophisticated Safety Training
The ability of LLMs to retain deceptive behaviors despite safety measures isn't just a technical loophole; it’s a paradigm shift in how we perceive AI reliability and integrity.
Google Shares Research Progress on AI that Converses, Reasons and Diagnoses Like Your Doctor
AMIE demonstrated stronger diagnostic accuracy and outperformed doctors on most metrics of consultation quality in both diagnostic accuracy and clinical communication.
Google DeepMind Unveils Latest Research in Advanced Robotics with AutoRT, SARA-RT, and RT-Trajectory
These advancements build on the foundational Robotics Transformers work, aiming to streamline decision-making processes, enhance environmental understanding, and improve navigational capabilities of robots.