Meta’s video AI breakthrough

Welcome, AI enthusiasts.

Meta’s latest AI can discover and track any object in a video with just a number of clicks, making Hollywood-level cutouts and effects accessible to everyone.

Could this open-source breakthrough be the important thing to unlocking a brand new era of AI-powered video editing? Let’s get into it…

In today’s AI rundown:

• Meta unveils SAM 2 for video AI

• Zuck and Huang envision AI’s future

• Learn how to automate emails from spreadsheet data

• Runway releases image-to-video AI

• 5 latest AI tools & 4 latest AI jobs

• More AI & tech news

Read time: 4 minutes

LATEST DEVELOPMENTS

META

🎥 Meta unveils SAM 2 for video AI

The Rundown: Meta just introduced Segment Anything Model 2 (SAM 2), a sophisticated AI model that may discover and track objects across video frames in real-time, marking a major leap in video AI.

The small print:

• SAM 2 extends Meta’s previous image segmentation capabilities to video, addressing challenges like fast movement and object occlusion.

• The model can segment any object in a video and create cutouts in a number of clicks — with a free demo available to try here.

• Meta can also be open-sourcing the model and releasing a big, annotated database of fifty,000 videos used for training.

• Potential applications include video editing, mixed reality experiences, and scientific research.

Why it matters: SAM 2’s ability to trace objects in real-time could make complex video editing tasks like object removal or alternative so simple as a single click. With Llama 3.1 last week and now SAM 2, Meta is constant its strategy of developing massive AI breakthroughs — while making every thing open and free to make use of.

TOGETHER WITH OCTOAI

🏋️ Optimize Llama 3.1-8B to beat GPT-4o

The Rundown: OctoAI is delivering a deep dive into optimizing small, open-source models like Llama3.1-8B to overpower the massive closed source providers — all while controlling your individual data and slashing costs.

Join the technical session on Aug. 7 to see:

• An interactive path to optimal model performance

• Efficient approaches to fantastic tune the brand new Llama 3.1-8B model family

• The continual development cycle for LLM-powered apps

• +47% quality improvements and +90% cost reduction over GPT-4o

Enroll for the session here. All registrants will receive the post-session materials, even for those who can’t attend live!

SIGGRAPH 2024

🤝 Zuck and Huang envision AI’s future

The Rundown: During a fireside chat at SIGGRAPH 2024, Meta CEO Mark Zuckerberg and NVIDIA CEO Jensen Huang spoke about their shared vision for the AI-powered future.

Key highlights:

• Each CEOs emphasized the importance of open-source AI, with Zuckerberg highlighting Llama 3.1’s release as an “inflection point.”

• Zuckerberg outlined a possible future for social media to evolve from recommending content to AI generating personalized content on the fly.

• Huang predicted a shift from turn-based AI interactions to more fluid, multi-option simulations.

• The leaders also discussed AI’s potential to rework education, entertainment, and work through smart glasses.

Why it matters: The emphasis on open-source and personalized AI signals a possible shift in how AI will likely be integrated into on a regular basis life and business. With Meta and NVIDIA’s combined influence, the shared vision could significantly shape the longer term of AI and its applications across different industries.

AI TRAINING

📧 Learn how to automate emails from spreadsheet data

The Rundown: Zapier Central permits you to routinely create emails from spreadsheet data, which might assist you save time on repetitive tasks and ultimately boost your productivity.

Step-by-step:

1. Log in or join at Zapier and go to Zapier Central.

3. Connect Google Sheets as your Data Source and arrange the “Create Draft” Motion for Gmail.

4. Test by instructing the AI to create a draft, then refine it as needed.

Pro tip: Start with email drafts as a substitute of sending emails on to help you review them and adjust if vital before scaling up the automation!

Get more AI tutorials →

PRESENTED BY APPYPIE

🎥 Convert text to video with Appy Pie

The Rundown: Appy Pie Playground is an all-in-one AI platform that revolutionizes creativity with its suite of AI tools, allowing users to effortlessly generate stunning videos, animations, and more.

Popular features include:

• AI Video Generator: Create character-consistent videos with music & voiceovers

• Animated Story Generator: Create animations with advanced story diffusion

• Background Generator: Easily generate backgrounds for products and pictures

• Cards Generator: Design and generate personalized cards

Start today to generate your first AI video!

RUNWAY

🎬 Runway releases image-to-video AI

The Rundown: Runway just announced that Gen-3 Alpha, the startup’s popular AI text-to-video generation model, can now create high-quality videos from still images.

The small print:

• In response to Runway, image-to-video greatly improves the artistic control and consistency of video generations.

• Image-to-video generations are either 5 or 10 seconds in length and take up “credits,“ which you’ve gotten to pay for through Runway’s subscription tiers.

• To make use of the tool, head to Runway’s website, click “try Gen-3 Alpha”, and upload a picture to look at it come to life.

Why it matters: The highly anticipated image-to-video generation model opens up a complete latest suite of creativity, allowing users to bring any image to life. Nonetheless, while the increased artistic control and enhancements to consistency are notable, Gen-3 Alpha doesn’t come at an affordable price tag.

P.S. our favourite use case: Turning memes to life.

NEW TOOLS & JOBS

Trending AI Tools

• 🎨 EverArt – Train AI on any product, style, or mood board

• 📝 Granola – AI-powered meeting note enhancement and organization

• 🎬 Runway Gen-3 Image to Video – Generate videos using images as guidance

• 🧑‍💻 Slater – Custom AI coding tool for Webflow website projects

• 🚀 fastn – Integrate and connect multiple data sources in a single, unified API

Browse more AI tools →

Recent AI Job Opportunities

• 💻 Robust Intelligence – Senior Software Engineer (Cloud/Security)

• 👨‍💻 Palantir – Software Engineer, Recent Grad

• 🛠️ Meta – Product Manager – Infrastructure AI

• 📈 Databricks – Senior Customer Marketing Manager – EMEA

Browse more AI jobs →

QUICK HITS

20% off AI Crash Course: Master prompting, AI productivity hacks, and proven use cases in Section’s 1-week AI Crash Course. 20% off with code RUNDOWN this week (Sponsored)

Meta launched AI Studio, a platform allowing users to create, share, and discover custom AI characters without technical skills, built on Llama 3.1.

Amazon unveiled its latest AI chip, claiming performance as much as 50% higher than NVIDIA’s at half the associated fee, as a part of efforts to cut back reliance on external chips for its AWS AI cloud services.

Apple revealed its Apple Intelligence Foundation Model technical report, revealing architecture specifics, pre-training methods, and deployment strategies for each server and on-device AI models.

Scale AI announced its latest SEAL Leaderboard on Adversarial Robustness, evaluating AI models on their ability to handle red team-generated prompts across harm scenarios — with Google’s Gemini 1.5 Pro topping the leaderboard.

Topology introduced the Continuous Learning Model (CLM), a brand new AI system that may remember interactions, learn autonomously, and develop an ‘emergent’ personality.

Elon Musk predicted a future with 10 billion humanoid robots, greater than the variety of humans, describing it as a fundamental milestone in civilization.

THAT’S A WRAP

SPONSOR US

Get your product in front of over 600k+ AI enthusiasts

Our newsletter is read by hundreds of tech professionals, investors, engineers, managers, and business owners world wide. Get in contact today.

FEEDBACK

If you’ve gotten specific feedback or anything interesting you’d wish to share, please tell us by replying to this email.