Siri’s vision upgrade is coming

-

Welcome, AI enthusiasts.

Siri’s about to get a brand new pair of digital eyes, and developers are currently first in line to test-drive them.

But after a sluggish Apple Intelligence rollout and rivals racing ahead with similar features, will the tech giant finally deliver on its AI guarantees? Let’s get into it…

In today’s AI rundown:

  • Apple preps developers for Siri’s AI upgrade

  • Tencent unveils open-source Hunyuan-Large model

  • Turn any UI design into working code

  • Apple exploring smart glasses market

  • 5 latest AI tools & 5 latest AI jobs

  • More AI & tech news

Read time: 4 minutes

LATEST DEVELOPMENTS

APPLE

📱 Apple preps developers for Siri’s AI upgrade

Image source: Apple

The Rundown: Apple just began rolling out latest developer tools for upcoming Siri screen awareness features with Apple Intelligence, signaling a significant enhancement to the digital assistant’s contextual understanding capabilities.

The main points:

  • Recent ‘App Intent APIs’ allow developers to make their apps’ onscreen content accessible to Siri and Apple Intelligence.

  • The system will enable direct interactions with visible content across browsers, documents, photos, and more — all without screenshot workarounds.

  • Early ChatGPT integration testing is already available within the iOS 18.2 beta, though full-screen awareness features are expected in a future update.

  • The feature will look to compete with recent releases from competitors like Claude’s computer use feature and Copilot Vision.

Why it matters: Apple Intelligence has underwhelmed thus far, but evolving Siri beyond voice commands right into a context-aware assistant will likely be a welcomed improvement. Given the lackluster rollouts, these upgrades may require a ‘see it to consider it’ mindset before adding Apple to the AI leaderboards.

TOGETHER WITH SPEECHMATICS

The Rundown: Flow by Speechmatics is a brand latest API that’s redefining voice-driven applications — helping deliver effortless conversations powered by ultra-accurate speech technology across multiple languages.

Flow offers:

  • Real-time responsiveness to each word, embracing interruptions and crosstalk

  • Industry-first support for group conversations

  • Inclusive understanding of any language, accent, or dialect

TENCENT

🚀 Tencent unveils open-source Hunyuan-Large model

Image source: Tencent

The Rundown: Tencent just released Hunyuan-Large, a brand new open-source language model that mixes scale with a Mixture-of-Experts (MoE) architecture to realize performances on par with rivals like Llama-405B.

The main points:

  • The model features 389B total parameters but prompts only 52B for efficiency, using progressive routing strategies and learning rate techniques.

  • Hunyuan-Large was trained on 7T tokens (including 1.5T of synthetic data), enabling SOTA performance across math, coding, and reasoning tasks.

  • Tencent’s model achieved 88.4% on the MMLU benchmark, surpassing LLama3.1-405B’s 85.2% despite using fewer energetic parameters.

  • Through specialized long-context training techniques, the model also supports context lengths as much as 256K tokens, double that of comparable rivals.

Why it matters: Large open-source models are continuing to speed up. Tencent’s impressive results with fewer energetic parameters could reshape how we take into consideration scaling systems — potentially offering a more efficient path forward as a substitute of simply making models larger.

AI TRAINING

💻 Turn any UI design into working code

The Rundown: v0 can transform screenshots of your favorite interfaces into fully functional code with custom enhancements and interactive features.

Step-by-step:

  1. Take a transparent screenshot of the interface you desire to replicate.

  2. Upload the image to v0 and write a prompt describing what you desire to construct.

  3. Enhance your interface by requesting additional features like animations or responsive layouts.

  4. Export the production-ready code and customize it as needed.

Pro tip: You possibly can paste the code provided into Cursor Composer, which adds it to your project. To learn more about it, try this tutorial.

PRESENTED BY SECTION

The Rundown: Join Section and Dan Hendrycks of the Center for AI Safety to explore how humanity can navigate the not-so-distant way forward for AGI, probably the most advanced (and potentially dangerous) technology ever created.

Join on Nov 21 for a discussion around questions including:

  • Can AGI systems really dominate human interests?

  • What elements of AGI are we not talking about enough?

  • How can we ensure AGI doesn’t lead us right into a dystopian future?

Secure your free spot and join the discussion.

APPLE

👓 Apple exploring smart glasses market

Image source: Midjourney / The Rundown

The Rundown: Apple is reportedly taking its first serious steps toward potential smart glasses development with a brand new internal research initiative called ‘Atlas’, in line with a report from Bloomberg.

The main points:

  • The interior ‘Atlas’ research program is reportedly currently gathering worker feedback on existing smart glasses products and use cases.

  • The research follows Meta’s growing success within the category with its Ray-Ban smart glasses and up to date prototype demos of ‘Orion.’

  • Apple’s Vision Pro headset has faced major adoption challenges since debuting in February, with recent reports of scaled-back production.

  • While a product can be years away, entering the category could align with efforts to cut back the fee and bulkiness of the Vision Pro.

Why it matters: While the Vision Pro had all of the hype, Meta’s glasses have had way more success—and this research could also be recognition that the longer term of AR could also be on a regular basis glasses somewhat than bulky headsets. While just an idea for now, Apple glasses might be more appealing as an adjunct somewhat than a fancy latest system to learn.

NEW TOOLS & JOBS

Trending AI Tools

  • 💻 Overlay by CrispAI-powered website search engine that fights bounce rates while reducing support load

  • 🗂️ Orbit AI by Nifty – Automate project management workflows with AI-powered tools

  • ✍️ Alta 2.0 – AI writing tool offering a more human, personalized content creation experience

  • 🎥 Melies – AI filmmaking software to assist transform ideas into stunning movies

  • ⚙️ Squire AI – Customize your code review with natural language

Recent AI Job Opportunities

  • 📱 The Rundown – Social Media Manager

  • 🛠️ Anyscale – Product Manager, Infrastructure

  • 🤖 Waymo – Software Integration Engineer

  • 🧬 Mistral AI – AI Scientist, Safety

  • 🗂️ Tempus – Executive Assistant

QUICK HITS

Former Meta AR lead Caitlin Kalinowski announced she is joining OpenAI to steer the corporate’s robotics and consumer hardware efforts to ‘bring AI into the physical world’.

T-Mobile will reportedly pay $100M to OpenAI over the subsequent three years to develop an ‘intent-driven’ AI platform that may take actions for users and integrate with operations and transaction systems for customer support tasks.

Meta’s plans for a nuclear-powered AI facility hit a setback after a rare species of bees were discovered on the proposed site, causing regulatory and environmental issues.

Apple’s iOS 18.2 Beta 2 revealed that ChatGPT integration with Siri will include each day usage limits free of charge users and a $19.99 monthly Plus upgrade option offering expanded access to GPT-4o features and DALL-E image generation.

Amazon secured FAA approval to deploy its latest MK30 delivery drones, enabling beyond-line-of-sight flights and moving the corporate closer to broader autonomous deliveries.

Unitree Robotics posted a brand new video showcasing demos of its Humanoid G1 and Go2 robots, including a more natural walking gait and enhanced balance and coordination.

Google announced plans for a brand new AI hub in Saudi Arabia focused on Arabic language models and regional applications, despite previous commitments to distance itself from fossil fuel industry development.

THAT’S A WRAP

That is it for today!

Before you go we’d like to know what you considered today’s newsletter to assist us improve The Rundown experience for you.
  • ⭐️⭐️⭐️⭐️⭐️ Nailed it
  • ⭐️⭐️⭐️ Average
  • ⭐️ Fail

Login or Subscribe to take part in polls.

See you soon,

Rowan, Joey, Zach, and Alvaro—aka The Rundown Team

ASK ANA

What are your thoughts on this topic?
Let us know in the comments below.

0 0 votes
Article Rating
guest
0 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments

Share this article

Recent posts

0
Would love your thoughts, please comment.x
()
x