NVIDIA’s New AI: Erasing Reality
In this video, Two Minute Papers unveils Omnimatte Zero, a groundbreaking AI developed by NVIDIA and collaborators, capable of seamlessly deleting objects, their shadows, and reflections from videos in real-time. Unlike previous techniques that left...
Video Snippets
NVIDIA’s New AI: Erasing Reality
In this video, Two Minute Papers unveils Omnimatte Zero, a groundbreaking AI developed by NVIDIA and collaborators, capable of seamlessly deleting objects, their shadows, and reflections from videos in real-time. Unlike previous techniques that left blurry messes or missed secondary effects, Omnimatte Zero intelligently reconstructs missing video segments by leveraging existing diffusion models and copying information from adjacent frames. This innovative approach requires no additional AI training and operates at 25 frames per second, marking a significant leap forward in video editing technology, despite a minor trade-off in sharpness for enhanced stability.
https://youtube.com/watch?v=RaNay3x0Fmk