AI Video Goes Open-Source

A team of researchers has introduced Pyramid Flow, an open-source AI model for generating high-resolution (768p) video imagery. This model provides a cheap alternative for creating virtual video content, bypassing the necessity for traditional filming. Pyramid Flow utilizes a multi-stage generation process, producing videos in lower resolutions before reaching the ultimate output.

The inference shell can create a five-second video in 56 seconds at 384p resolution while using significantly less computing power and minimizing token requirements for generation. The developers have released the model’s code on GitHub under an MIT License, together with sample videos demonstrating its performance and the open-source datasets utilized for training, totaling 10 million short videos. Read more.

Adobe has begun rolling out its Firefly Video Model, an AI tool that generates video from text prompts, entering a competitive space alongside OpenAI’s Sora and Meta’s recent video AI efforts. While major players like ByteDance and Meta have released similar tools, Adobe is distinguishing itself by training models on legally cleared data, ensuring that business use is hassle-free.

Although a general release date for the tool remains to be pending, Adobe has opened access to users on its waitlist. PepsiCo’s Gatorade and Mattel’s Barbie packaging designs are already utilizing Adobe’s image AI, signaling practical applications for its technology.

Adobe’s focus with Firefly is on fine-grain control, offering video creators tools that integrate seamlessly with traditional footage. This positions Adobe to cater to on a regular basis users, especially video editors, by enabling precise control over elements like camera motion and angles.

Alongside the Firefly Video Model, Adobe has also enhanced its Photoshop tools and introduced recent features in Illustrator and InDesign, further solidifying its commitment to advancing AI capabilities inside its Creative Cloud suite. Read more.

Northwestern University engineers have introduced MobilePoser, a brand new app that performs real-time, full-body motion capture using sensors already embedded in consumer devices like smartphones, smartwatches, and wireless earbuds.

By utilizing inertial measurement units (IMUs) and advanced AI algorithms, MobilePoser accurately estimates joint positions, rotations, and walking speed without requiring specialized equipment. A physics-based optimizer further enhances motion prediction accuracy.

With a tracking error of 8 to 10 centimeters, the system adapts to varied device setups and has potential applications in gaming, fitness, and healthcare, allowing for improved tracking of mobility and posture evaluation. Read more.

OpenAI has landed two strategic hires after a mass exit earlier this month. First up is Sebastian Bubeck, previously Microsoft’s VP of generative AI research, credited with shaping the Phi models that power efficient on-device AI through smaller language and vision frameworks. Because the appetite for nimble, privacy-first models surges, Bubeck is ready to tackle efficiency and model development—areas where OpenAI has lagged behind.

Joining him is Dane Stuckey, ex-CISO of Palantir, who brings a wealth of experience in digital forensics and incident response. Stuckey’s recent role coincides with OpenAI’s push to strengthen its security infrastructure, particularly in its partnerships with the U.S. Department of Defense. OpenAI recently lifted its ban on selling AI technology to the military and has been working on various projects with the Pentagon, including cybersecurity initiatives. Read more.

Google has partnered with Kairos Power to deal with the rising power demands of its data centers, that are increasingly reliant on clean, reliable energy. Under the agreement, Google will source power from Kairos’ small modular reactors (SMRs), the primary of which is projected to be online by 2030, with 500 megawatts added to the grid by 2035.

Kairos’ reactors, using molten fluoride salt as a substitute of traditional water coolant, offer a more scalable and potentially cost-effective nuclear solution. This move aligns with a broader trend of tech firms, resembling Microsoft and Amazon.

Nuclear energy, offering round the clock, emissions-free power, is seen as vital for meeting the industry’s growing needs without compromising on sustainability targets. Read more.