Luma AI, an a16z-backed company specializing in AI video and 3D models, released Ray3 Modify, a new model that enables users to modify existing footage using character reference images while preserving the original performance. Users supply start and end frames to generate transitional footage, addressing preservation challenges for creative studios.
Ray3 Modify tackles issues in maintaining human performance during AI-based editing or effects generation. The model adheres closely to input footage, permitting studios to employ human actors in creative or brand productions. It specifically retains the actor’s original motion, timing, eye line, and emotional delivery as it transforms the scene.
Users input a character reference to alter the human actor’s appearance into the specified character within the footage. This process preserves details such as costumes, likeness, and identity throughout the entire shoot. Such capabilities ensure consistent visual elements across sequences without additional filming.
Creators also supply start and end reference frames to produce video segments with Ray3 Modify. This feature assists in directing smooth transitions or specifying character movements and behaviors. Continuity between scenes remains intact, supporting complex narrative structures in video projects.
Amit Jain, co-founder and CEO of Luma AI, stated, “Generative video models are incredibly expressive but also hard to control. Today, we are excited to introduce Ray3 Modify that blends the real-world with the expressivity of AI while giving full control to creatives. This means creative teams can capture performances with a camera and then immediately modify them to be in any location imaginable, change costumes, or even go back and reshoot the scene with AI, without recreating the physical shoot.”
The model integrates directly into Luma’s Dream Machine platform, making it accessible to users immediately. Luma positions itself against competitors including Runway and Kling in the AI video generation space. The company introduced initial video modification capabilities back in June 2025.
This release follows a $900 million funding round announced in November, led by Humain, an AI company owned by Saudi Arabia’s Public Investment Fund. Existing investors a16z, Amplify Partners, and Matrix Partners joined the round, providing substantial capital for expansion.
Video: Luma
Luma plans to construct a 2GW AI cluster in Saudi Arabia in collaboration with Humain. This infrastructure initiative supports scaling computational resources for advanced AI video and 3D modeling operations.
