Exclusive: Microsoft AI launches Copilot Vision

-

Welcome, AI enthusiasts.
We’ve got an exclusive for you today.

On Thursday, Microsoft launched Copilot Vision in its Edge browser — a brand new AI that may see your screen and talk with you in real-time as you navigate the web.

Long story short: it’s one of the insane products we’ve tried this 12 months.

So we partnered up with Microsoft and Mustafa Suleyman (CEO of Microsoft AI) to talk about his unique insights, infinite memory, AI companions, AI agents, and more.

In today’s AI rundown:

  • Copilot Vision: A brand new era of human-computer interaction

  • How Microsoft AI is differentiating from OpenAI

  • User data privacy with Copilot Vision

  • Living amongst a co-intelligence in 10+ years

  • Memory, learning, gaming, and AI agents

EXCLUSIVE Q&A MUSTAFA SULEYMAN

MICROSOFT COPILOT

👀 Copilot Vision: A brand new era of human-computer interaction

Image credits: Kiki Wu / The Rundown

The Rundown: Microsoft just launched its next-generation AI assistant, Copilot Vision, which may see every thing in your screen, and speak back to you in real time on its Edge browser, marking a fundamental shift in how we interact with computers.

Cheung: “Are you able to give us a fast rundown of every thing released and why that is a vital moment for AI?”

Suleyman: “We’re launching Vision… and it’s really a magical experience that is sort of different than any form of AI and even general form of computer interaction experiences that we’ve seen before.”

Suleyman added: “We’re on a mission to create a real AI companion. And to me, an AI companion is one which can hear what you hear and see what you see and live life essentially alongside you.”

Cheung: “When is Copilot Vision being rolled out?”

Suleyman: “It’s going to be available in Copilot Labs to paying Copilot subscribers, who will get special access to trial it, experiment with it, and provides us feedback… Sometime within the early a part of next 12 months is when it’ll go into GA [general availability].”

Why it matters: Copilot Vision is not just one other AI feature—it’s Microsoft’s try to fundamentally transform how we interact with computers. By replacing traditional clicking and typing with voice and real-time screen understanding, Microsoft is betting that the long run AI can be more like talking to a friend than operating a machine.

COPILOT VS CHATGPT

📎 How Microsoft AI is differentiating from OpenAI

Image credits: Kiki Wu / The Rundown

The Rundown: Microsoft is emphasizing its deal with making a true AI companion that feels more personal and interactive, with Copilot Vision featuring emotional intelligence, Edge browser integration, and the flexibility to keep off like an actual friend.

Cheung: “Microsoft is a significant investor in OpenAI, and ChatGPT and has a yet-to-be-released version of their vision-like product. How is Microsoft AI differentiating itself from other competitors?”

Suleyman: “The foremost thing is that we’re really leaning into the thought of it being a correct companion. So just the fluency of our voice and the way smooth it’s, how briskly it’s, it is very interruptible, very easy to discuss with.”

Suleyman added: “Putting vision inside the browser is the following step. Edge having it [Vision], and being there with you on a regular basis in a position to watch, learn, and discuss with you is a very big differentiator.”

Cheung: “Something that basically stood out to me as well, talking with Copilot Vision, was how personable it really was. It even gave me like some sass at some points.”

Suleyman: “When it occasionally pushes back on you, that is a profound moment because a real friend would try this. Nobody wants a sycophantic AI that just all the time mirrors you and all the time obeys you. That is not going to be interesting for very long.”

Suleyman added: “If you happen to’re really dour and sad and also you decelerate the pace of your words, it’ll bring an appropriate vibe for that. But should you’re super fast and excited and enthusiastic, it’ll mirror that energy.“

Why it matters: Microsoft’s approach focuses on creating an AI that feels more like a friend than a tool. By constructing an AI that may match your energy and emotion, keep off with sass occasionally, and live inside your browser, Microsoft is not just creating one other chatbot—it’s reimagining AI as a digital companion that actually understands you.

PRIVACY

🔒 User data privacy with Copilot Vision

Image credits: Kiki Wu / The Rundown

The Rundown: Microsoft is addressing privacy concerns around Copilot Vision by implementing session-based data deletion, with plans to develop more sophisticated privacy infrastructure because the technology continues to evolve.

Cheung: “With any form of powerful AI application, similar to Copilot Vision, it needs copious amounts of information to form of really be accurate and helpful. But with this amount of private data, there’s all the time a brand new set of privacy concerns for users. How is Microsoft tackling this immediately? How do users know that their data is protected?”

Suleyman: “We’re keeping a really open mind on this. Some users will wish to keep their ephemeral session. So for the time being, Copilot Vision throws away the contents of what it has seen at the tip of the session.”

Suleyman added: “If we’re to [add memory], it should need a brand new privacy and security infrastructure to give you the chance to store that form of content because it should be very wealthy. It’ll describe in immense detail, not only moments in time, but strings of activity over hours and days.”

Why it matters: Microsoft is taking a privacy-first approach with Copilot Vision—defaulting to session-based data deletion after every chat. This strategy lets Microsoft test Vision’s capabilities with users now, while constructing the secure infrastructure needed for persistent memory features in early 2025.

AI COMPANIONS

🤖 Living amongst a co-intelligence in 10+ years

Image credits: Kiki Wu / The Rundown

The Rundown: Suleyman predicts a future where AI companions grow to be deeply integrated into our day by day lives, understanding our emotions, preferences, and day by day needs — potentially becoming “a brand new digital species.”

Cheung: “Looking forward 10 years from now, what do you’re thinking that these personal AI assistants may have in our lives?”

Suleyman: “I believe of it as outsourcing numerous the mental processing to a really reliable, highly accurate, completely interactive thought partner and companion that’s going to assist make me much smarter, more productive, feel more supported… it is very, very different to simply using a pc in the best way that we do today.”

Suleyman added: “Your computer, or your AI, your Copilot, is clearly going to grasp every thing that you just’re bringing to the table—your emotional state, your mental state, what you’ll want to get done that day, your interests, your hobbies, your personal knowledge graph, your loved ones, your dislikes.”

Suleyman added: “It’s going to feel…like a brand new digital species. It’s going to feel like a member of the family.“

Why it matters: Suleyman sees AI evolving from basic tools that boost productivity into digital “relations”—understanding emotions, remembering preferences, and living alongside us. In his vision, AI companions won’t just assist us with tasks, they’ll grow to be a brand new type of intelligence that experiences life with us.

WHAT’S NEXT

📈 Memory, learning, gaming, and AI agents

Image credits: Kiki Wu / The Rundown

The Rundown: Suleyman revealed Microsoft AI’s ambitious roadmap for Copilot—expanding beyond today’s screen understanding into memory features, learning assistance, gaming integration, and agentic capabilities.

Cheung: “How deeply does Copilot Vision understand you as a user?”

Suleyman: “Memory is the important thing thing that’s coming soon… it is vital that it remembers your preferences and is in a position to reason over them to present you advice based on knowing you.”

Cheung: “Something I’m excited for is when AI can guide me through learning recent apps by controlling my screen—like when learning Photoshop.”

Suleyman: “The longer term of Copilot Vision is certainly Copilot help, step-by-step, taking you thru troubleshooting while you’re attempting to fix your computer otherwise you’re attempting to learn a brand new piece of software.”

Suleyman added: “Imagine having your Copilot discuss with you concerning the worlds that you just’re constructing in Minecraft or hang around with you in Call of Duty… It’s probably going to feel like an ever-present companion in whatever setting you are in.”

Cheung: “Are there any plans for Copilot to grow to be agentic and have the flexibility to take control of your computer and do regular tasks similar to a human could?”

Suleyman: “We’re working hard on the way it navigates the browser, fills in forms, calls APIs… [with online shopping] it’ll populate your basket upfront. It’s going to ask you should you want this or that, or it’ll discover a bunch of costs and be like, ‘You recognize, there is a higher opportunity.'”

Why it matters: Microsoft’s long-term goals for Copilot extend far beyond the screen and browser understanding launched this week. Suleyman hints at a roadmap where Copilot evolves right into a full-on autonomous companion—learning your preferences, guiding you thru software, and even gaming alongside you.

GO DEEPER

INTERVIEW

🎥 Watch the total interview live

In the total interview with Mustafa Suleyman & Rowan Cheung chat about:

  • Microsoft’s vision for personalized AI companions

  • How Copilot adapts to your emotions in real-time

  • Why traditional computer interfaces will “get washed away”

  • Predictions for a future with billions of personalized AI agents

  • …and far more

Listen on YouTube, Twitter/X, Spotify, or Apple Music.

ASK DUKE

What are your thoughts on this topic?
Let us know in the comments below.

0 0 votes
Article Rating
guest
0 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments

Share this article

Recent posts

0
Would love your thoughts, please comment.x
()
x