ChatGPT sees the world

Welcome, AI enthusiasts.

On the sixth day of Shipmas, OpenAI gave ChatGPT eyes.

Voice Mode’s long-awaited vision upgrade is here, countering Google’s big Gemini release — drastically changing the longer term of AI interactions. Let’s get into it…

In today’s AI rundown:

• ChatGPT Advanced Voice Mode gains vision capabilities

• Anthropic’s Claude 3.5 Haiku is now generally available

• Turn your screenshots into working prototypes

• Anthropic analyzes real-world AI use with Clio

• 5 latest AI tools & 5 latest AI jobs

• More AI & tech news

Read time: 4 minutes

Friendly reminder: We’re moving to a brand new email sending address. Be sure so as to add [email protected] to your contacts to make sure you keep receiving our emails.

LATEST DEVELOPMENTS

OPENAI

👁️ ChatGPT Advanced Voice Mode gains vision capabilities

The Rundown: OpenAI just launched a serious upgrade to ChatGPT’s Advanced Voice Mode on Day 6 of its live stream event, enabling the AI to research and reply to live video input and screen sharing during conversations.

The small print:

• Users can show live videos or share their screens while using Advanced Voice Mode, and ChatGPT can understand and discuss the visual context in real time.

• The feature works through a brand new video icon within the mobile app, with screen sharing available through a separate menu option.

• The updates can be found to ChatGPT Plus, Pro, and Team subscribers, with Enterprise and Edu users gaining access in January.

• OpenAI also introduced a festive latest voice option, allowing users to speak with Santa as a limited-time seasonal addition through early January.

Why it matters: Seven months after its initial demo, OpenAI is finally delivering on the promise of visual understanding in conversational AI — moving ChatGPT beyond text and voice into true multimodal interaction. It’s been an enormous week for vision, with Gemini and ChatGPT Advanced Voice gaining some extremely powerful latest capabilities.

TOGETHER WITH METAVIEW

✍️ Meet the world’s leading AI recruiting scribe

The Rundown: Metaview is a specialized AI tool that captures, structures, and summarizes recruiting conversations, enabling teams to give attention to candidate interactions relatively than note-taking.

Leading firms like Deel, Deliveroo, Sony and HelloFresh trust Metaview for:

• Flawless interview documentation without the manual work

• Significant time savings (10 hours per week on average for recruiters)

• Effortless integration with existing recruiting tools

Start with Metaview and check out 10 calls without spending a dime, exclusive to Rundown AI readers.

ANTHROPIC

⚡ Anthropic’s Claude 3.5 Haiku is now generally available

The Rundown: Anthropic quietly rolled out its fastest AI model, Claude 3.5 Haiku, to all Claude users on web and mobile platforms, expanding from its previous API-only availability — though no official announcement has been made.

The small print:

• Haiku 3.5 was released in November together with Claude’s computer use feature — beating the previous top model 3 Opus on key benchmarks.

• The model excels at coding tasks and data processing, offering impressive speed and performance with high accuracy.

• Haiku contains a 200K context window, which is larger than competing models, while also integrating with Artifacts for a real-time content workspace.

• The initial release drew criticism for Haiku’s API pricing, which was increased 4x over 3 Haiku to $1 per million input tokens and $5 per million output tokens.

• Free users can now access Haiku with every day message limits, while Pro subscribers ($20/month) get expanded usage and priority access.

Why it matters: It’s been a comparatively quiet holiday season of releases for Anthropic in comparison with rivals. Although Haiku is impressive in comparison with previous generations, it doesn’t feel like an enormous needle mover during an enormous week of AI releases — and it’d take a launch of a top-tier 3.5 Opus to steal the highlight from Google and OpenAI.

AI TRAINING

💻 Turn your screenshots into working prototypes

The Rundown: Claude Artifacts allows you to create functional prototypes directly from screenshots or photos, bringing your ideas to life in minutes.

Step-by-step:

1. Access Claude through your browser or mobile app.

2. Take a transparent screenshot or photo of your design.

3. Upload it with an in depth prompt requesting a React prototype with specific features and styling.

4. Enhance your prototype by requesting additional functionality and refinements.

Pro tip: Use high-contrast images and break down complex interfaces into smaller components for higher results.

PRESENTED BY INNOVATING WITH AI

💼 Start your profession as an AI Consultant

The Rundown: Innovating with AI’s latest program, AI Consultancy Project, equips AI enthusiasts with all of the resources to capitalize on the rapidly growing AI consulting market – which is ready to 8x to $54.7B by 2032.

This system offers:

• Tools and framework to seek out clients and deliver top-notch services

• A 6-month roadmap to construct a 6-figure AI consulting business

• Student landing their first AI client in as little as 3 days

Click here to request early access to The AI Consultancy Project.

ANTHROPIC

🔍 Anthropic analyzes real-world AI use with Clio

The Rundown: Anthropic introduced Clio, a brand new system that reveals patterns in how people actually use AI assistants worldwide, providing detailed insights into real-world AI adoption while maintaining user privacy.

The small print:

• Clio analyzes thousands and thousands of conversations by summarizing and clustering them while removing identifying information in a secure environment.

• The system then organizes these clusters into hierarchies, allowing researchers to explore patterns in usage without having access to sensitive data.

• Evaluation of 1M Claude conversations showed that coding and business use cases dominate, with web development representing over 10% of interactions.

• The system also uncovered unexpected use cases like dream interpretation, soccer match evaluation, and tabletop gaming assistance.

• Usage patterns vary significantly by language and region, corresponding to the next prevalence of economic and social issue chats in non-English conversations.

Why it matters: AI assistants have gotten increasingly integrated into our every day lives, but all and sundry leverages them differently — making this an enchanting window into how the tech is getting used. Understanding the dominant real-world use cases can each help improve user experience and align development with actual user needs.

NEW TOOLS & JOBS

Trending AI Tools

• 👁️ Gemini Stream Realtime – Interact with Gemini in real-time using text, voice, video, or screen sharing.

• 🎅 AI Santa by Tavus – Video chat with Santa in real-time across 30 languages

• 🌊 Detasurf – A browser, file manager, and AI assistant in a single clean app

• 🧠 Rememberall – Open-source solution to present Custom GPTs persistent memory across conversations

• 📆 Clarity AI – Turn schedule screenshots into calendar events and tasks

Latest AI Job Opportunities

• 💻 UiPath – Software Engineering Intern

• ⚙️ Shield AI – Staff Mechanical Design Engineer

• 💲 Captions – Paid Search Specialist

• 📝 Harvey – Contracts Manager

• 🏥 Tempus – Associate Director, Clinical Operations

QUICK HITS

Google announced Android XR, a brand new Gemini-powered operating system for mixed reality systems, with Samsung set to launch the primary compatible headset codenamed ‘Project Moohan’ in 2025.

ChatGPT head of product Nick Turley discussed the platform’s future in an interview with The Verge, saying that chat-based interactions may soon feel as “outdated as ‘90s fast messaging.”

Amazon Prime Video launched a brand new ‘AI Topics’ beta feature, using machine learning to group and recommend content based on viewers’ interests and watching habits.

Character.AI instituted a brand new safety overhaul featuring a separate AI model for users under 18, alongside upcoming parental controls and enhanced content filtering — following two lawsuits saying the platform contributed to self-harm.

Nvidia has expanded its hiring in China, adding over 1,000 employees in 2024, including 200 latest Beijing-based researchers focused on autonomous driving tech.

Stanford researchers proposed a worldwide initiative to create an AI-powered virtual human cell to revolutionize biological understanding and drug development through computational modeling.

THAT’S A WRAP

SPONSOR US

Get your product in front of over 800k+ AI enthusiasts

Our newsletter is read by 1000’s of tech executives, investors, engineers, managers, and business owners all over the world. Get in contact today.

See you soon,

Rowan, Joey, Zach, and Alvaro—aka The Rundown Team