Inside The AI Tools for Generating Video

-

Good morning. It’s Wednesday, Jun 4th.

On today in tech history: 1998: Microsoft launched Windows 98, codenamed “Memphis,” succeeding Windows 95 with improved hardware support and Web Explorer 4.0 integration. This OS helped advance AI by providing a stable platform for tools like SNNS (Stuttgart Neural Network Simulator) and CLIPS (expert system framework), enabling researchers to develop early neural networks.

  • The AI Tools for Generating Video

  • Apple Finally Joins the AI Race

  • Deepmind’s Force Prompting

  • 5 Recent AI Tools

  • Latest AI Research Papers

You read. We listen. Tell us what you’re thinking that by replying to this email.

In partnership with Columbia Business School

Be the Person on Your Team Who Knows Find out how to Actually Use AI

Gain the talents that may turn you into an “AI first” leader in your role.

  • Skip the idea and go straight to practice by tackling real use cases currently being implemented on the world’s most AI-forward financial institutions and corporations

  • Learn from Columbia Business School faculty and directly from those constructing AI tools at BlackRock, Morgan Stanley, Ramp, Perplexity, and OpenAI

  • Join a rigorous program with no coding or tech background needed—we’ll guide you step-by-step from fundamentals to real-world application

Earn a certificate from Columbia Business School Exec Ed in only 8 weeks—and gain lifetime access to course materials and a worldwide skilled network.

Save $300 using code AIBREAKFAST whenever you enroll today + an additional $200 on early enrollment.

Today’s trending AI news stories

The AI Tools for Generating Video: Between Concept and Creation

AI content tools are rapidly reshaping how images, video, and audio are created, edited, and monetized, shifting the main target from manual production to automated, scalable pipelines.

Topaz Labs’ Bloom takes on image resolution, offering an AI-powered upscaler that reinforces output by as much as 8× without sacrificing core details. Its five tuning modes, from Subtle to Max, give users granular control over stylization, generating 4 outputs per pass to speed up visual iteration. In parallel, Captions’ Mirage Studio introduces digital actors with micro expressive realism, rendered in minutes from text, audio, or images via an omni-modal foundation model built for fluid performance. ManusAI extends that vision with a scene-planning video engine that maps, designs, and animates entire narratives from a single prompt, bringing storyboard-to-screen automation to a brand new level.

On the audio front, PlayAI’s PlayDiffusion replaces autoregressive editing with parallel speech inpainting, using a 20-step denoising loop to revive natural pacing and tone at lower computational cost. Rounding it out, Character.AI evolves chat into performance: animated avatars, real-time scene direction, and group streaming push beyond reactive dialogue toward scripted, persistent character arcs, soon joined by redesigned profiles and a social feed. Meanwhile, HeyGen’s AI Studio tightens control over avatar performance with tools like gesture mapping, speech mirroring, and voice-director modes, layering production polish onto a totally synthetic solid.

Apple reportedly tests AI models that match ChatGPT’s capabilities in internal benchmarks

Tim Cook, chief executive officer of Apple. Image: David Paul Morris/Bloomberg

Apple plans to open its small on-device AI models, reportedly with around 3 billion parameters, to third-party developers at WWDC 2025, enabling basic features similar to text summarization. These compact models run directly on Apple hardware but are far less capable than larger in-house models used internally.

Apple is internally testing cloud-based foundation models with 3, 7, 33, and 150 billion parameters; the most important matches ChatGPT’s performance in benchmarks, in accordance with employees. Yet these advanced systems remain confined to the corporate’s “Playground” testbed, with no timeline for public release. Insiders cite executive hesitancy over accuracy and hallucinations, leaving Apple to quietly license OpenAI’s chatbot as an alternative. Meanwhile, splashier projects, including a chatty recent Siri, AI-enhanced Shortcuts, and a health assistant dubbed “Mulberry,” have slipped to 2026 or later. Read more.

Deepmind’s “force prompting” lets AI create realistic video motion without physics engines

Researchers from DeepMind and Brown University introduced force prompting, a way that permits generative video models to simulate realistic motion using directional force inputs, without counting on physics engines or 3D modeling. Users define global or local forces as vector fields., wind across a scene or a faucet on a degree, which the system processes through a ControlNet-integrated Transformer model built on CogVideoX-5B-I2V.

The model found out that a full laundry basket moves slower than an empty one when pushed. | Image: Gillman et al.

The model, trained for at some point on 4 Nvidia A100 GPUs, uses synthetic datasets: 15,000 clips of wind-driven flags, 12,000 of rolling balls, and 11,000 of flower impacts. It generalizes well, preserving physical plausibility and elegance features, while learning intuitive concepts like mass. Despite outperforming text-based and motion-path baselines, and even PhysDreamer in realism and alignment with input forces, it still falters in complex scenarios. Force prompting offers a light-weight strategy to steer AI-generated motion through intuitive physical cues. Read more.

5 recent AI-powered tools from around the online

arXiv is a free online library where researchers share pre-publication papers.

Your feedback is precious. Reply to this email and tell us how you’re thinking that we could add more value to this article.

Fascinated about reaching smart readers such as you? To change into an AI Breakfast sponsor, reply to this email or DM us on 𝕏!

ASK ANA

What are your thoughts on this topic?
Let us know in the comments below.

0 0 votes
Article Rating
guest
0 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments

Share this article

Recent posts

0
Would love your thoughts, please comment.x
()
x