Microsoft Copilot can now watch windows apps in action and assist you smarter

Meet the new Copilot vision

Microsoft just rolled out Copilot Vision, a significant upgrade that lets the AI assistant see and interact with what’s on your screen. Now available for Windows 10 and 11 users in the U.S., the tool allows real-time sharing of apps and windows.

Think of it as your AI co-pilot, watching and assisting you across tasks, whether writing, designing, or troubleshooting. And the best part? No Copilot Pro subscription is needed to try it out.

What Is Copilot vision, exactly?

Copilot Vision enables the assistant to “see” what you’re working on and respond in context. Instead of guessing based on vague commands, it uses visual cues from your shared apps to provide accurate suggestions, explanations, and walkthroughs.

From summarizing PDFs to interpreting error messages, it’s like giving your AI assistant eyesight. And because it works in real-time, help arrives exactly when and where you need it.

Highlights, the secret sauce

Copilot Vision includes a killer companion feature called Highlights. Ask how to complete a task in an app like cropping an image in Photoshop, and Copilot will highlight what to click, step by step.

It’s like having a personal tutor walk you through your workflow visually. Whether you’re a beginner or a power user, Highlights adds an entirely new layer of interactive guidance.

Two apps at once? no problem

You can share up to two apps with Copilot simultaneously. This means you can, for example, show Copilot your calendar and a webpage of event listings, and it’ll help you find a date that works.

This multi-window support brings more flexibility and smarter context-switching, which is ideal for juggling meetings, research, and daily productivity with AI’s help.

Launching it is easy

Ready to try Copilot Vision? Open the Copilot app, click the “glasses” icon, and choose the apps or browser windows you want to share. Once you approve screen access, Copilot instantly starts analyzing and offering suggestions.

When you’re done, click “Stop” or “X” to end the session. There is no automatic screen capture or surveillance here; just opt-in visibility with a clean exit.

Not always on you control what it sees

Unlike Microsoft’s controversial Recall feature, Copilot Vision only works when you grant access. That means no background screen tracking or silent snapshots. You’re in the driver’s seat.

Want it to help with a Word doc, but not your email? You decide. This permission-first approach is Microsoft’s way of easing privacy concerns and maintaining user trust in the era of watchful AI.

Real-time help, real results

Need help editing photos or debugging a coding error? Copilot Vision can identify what you’re looking at and respond appropriately. Ask how to remove lighting reflections in Photoshop, and it’ll guide you to the right tool.

Or if you’re staring at a confusing system alert, Copilot can decode and explain, so no tab-switching or googling is necessary.

Your own productivity partner

Whether you’re planning a trip, drafting an email, or prepping a report, Copilot Vision adapts to your task. It can help pack for your vacation, summarize a legal document, or offer budgeting tips.

You’re all based on what’s on your screen. The assistant is becoming less reactive and more intuitive, walking you through your day like a personalized virtual coach.

Highlights in action

You’re working in Excel and want to create a pivot table. You ask Copilot, which uses Highlights to show you where to click menus, options, and sections.

This hand-holding experience feels like live training, not just scripted AI advice. It’s the kind of proactive help for users who learn visually and want to avoid YouTube rabbit holes.

Privacy first, but still powerful

Microsoft is making a strong pitch for privacy with Copilot Vision. Nothing is recorded unless you share it. There’s no Recall-style memory of your screen activity.

And you can revoke access at any time. That gives it an edge over always-on tools that raise security flags while keeping the intelligence and capability users expect from a modern AI assistant.

It works across most windows apps

Copilot Vision isn’t tied to Microsoft Office or Edge. It works with virtually any Windows app, from Adobe tools and web browsers to Notepad and Paint.

Whether you’re writing code, editing video, or comparing spreadsheets, Copilot adapts to the visual interface in front of it. That flexibility sets it apart from other AI helpers limited to predefined ecosystems.

From browser help to desktop wizard

Before this update, Copilot’s usefulness was mainly limited to Edge and Microsoft 365. Now, with Vision, it breaks free of the browser and becomes a desktop-native assistant.

You can share any window, including PDFs, emails, or media players, and the AI responds in kind. It transforms Copilot from a glorified chatbot to a visual, full-spectrum productivity partner.

iOS and Android access too

Though currently rolling out on Windows 10 and 11, Microsoft plans to expand Copilot Vision’s features to mobile platforms. Android and iOS users will soon be able to use their phones as entry points for this real-time visual assistance.

Microsoft’s broader goal is to build a seamless AI experience across all your screens wherever you work or play.

Designed for work and play

Think Copilot Vision is just for professionals? Think again. Gamers can use it to get past challenging levels. Hobbyists can use it to learn new software.

Even everyday users can get guidance on booking trips or organizing files. Microsoft wants this assistant to be as helpful when you’re editing vacation photos as it is when you’re debugging code.

The new Copilot interface

Alongside Vision, Microsoft introduced a revamped Copilot interface that docks to the side of your screen. It’s subtle, fast, and stays out of the way.

With contextual prompts and a space-saving layout, it guides you when needed and disappears when you don’t. It’s one of those quality-of-life upgrades you didn’t know you needed until now.

Meanwhile, not all AI tools are getting the green light: see why Microsoft just blocked employees from using DeepSeek.

The future of windows is watching

Microsoft’s message is clear: Copilot is no longer just an assistant; it’s a sidekick. With Vision and Highlights, Copilot now learns from what you see, not just what you say.

It’s the first significant step in making AI ambient, helpful, and deeply embedded into your daily computer use.

Whether that’s empowering or eerie depends on your comfort with intelligent assistants. Either way, the future of Windows is officially watching and it’s ready to help.

And it doesn’t stop at your screen: Copilot Studio can now use websites and apps all on its own.

Are you excited about Microsoft Copilot’s new update? Will it be helpful to you? Please share your thoughts and drop a comment.

Read More From This Brand:

• GitHub Copilot Adds AI Tools, Limits Premium Access
• Microsoft Enhances Copilot with Free o1 AI
• Microsoft Layoffs Hit Programmers Hard As AI Writes More Code

Don’t forget to follow us for more exclusive content on MSN.

If you liked this story, you’ll LOVE our FREE emails. Join today and be the first to get stories like this one.

This slideshow was made with AI assistance and human editing.