When it launched, Apple 's Visual Intelligence feature allowed you to point your compatible phone's camera at things around you and either perform a Google Image Search or ask questions via ChatGPT. At WWDC 2025, the company showed off updates to broaden the usefulness of Visual Intelligence, largely by embedding it into the screenshots system. To quote the company's press release, "Visual intelligence already helps users learn about objects and places around them using their iPhone camera, and it now enables users to do more, faster, with the content on their iPhone screen."
This reminded me of the "onscreen awareness" that Apple described as one of Siri's capabilities when it announced Apple Intelligence last year. In that press release, the company said, "With onscreen awareness, Siri will be able to understand and take action with users’ content in more apps over time." Though it's not quite the same, the updated screenshot-based Visual Intelligence more or less allows for your iPhone to serve up contextual actions from your onscreen content, just not via Siri.
In a way, it makes sense. Most people are already accustomed to taking a screenshot when they want to share or save important information they saw on a website or Instagram post. Integrating Apple Intelligence actions here would theoretically put the tools where you expect them, rather than make users talk to Siri (or wait for the update to roll out).
Basically, in iOS 26 (on devices that support Apple Intelligence), pressing the power and volume down buttons to take a screenshot will result in a new page being pulled up. Instead of the thumbnail of your saved image appearing in the bottom left, you'll see the picture take up almost all of the display, with options around it for editing, sharing or saving the file, as well as getting Apple Intelligence-based answers and actions at the bottom. In the bottom left and right corners sit options for asking ChatGPT and doing a Google Image Search respectively.
Depending on what's in your screenshot, Apple Intelligence can suggest various actions below your image. This can be asking where to buy a similar-looking item, adding an event to your calendar or identifying types of plants, animals or food, for instance. If there's a lot going on in your screenshot, you can draw on an item to highlight it (similar to how you select an object to erase in Photos) and get information specific to that part of the image.
Third-party apps or services that have enabled App Intents, like Google, Etsy and Pinterest, can also appear here so you can carry out actions within this space too. For example, if you've found a bookend you like, taken a screenshot and identified it, you can shop for it on Etsy or pin it on Pinterest.
One aspect of this update to Visual Intelligence that gives me pause is that, for people like me who screenshot mindlessly and don't want to do anything other than get receipts, this might add a frustrating step between capturing a screenshot and saving it to Photos. It sounds like you may be able to turn off this interface and stick to the existing screenshot system, though.
The examples that Apple gave for Siri's ability to understand what's on your screen felt somewhat similar. In its press release from last year, Apple said "For example, if a friend texts a user their new address in Messages, the receiver can say, 'Add this address to his contact card.'"
Like Visual Intelligence in screenshots, this involves scanning the onscreen content for pertinent information and helping you put it in a place (like Contacts or Calendar) where it's most useful. However, the promise of Siri's new era was more about interacting with all parts of your phone, across first- and third-party apps alike. So you could ask the assistant to open an article you added to your Reading List in Safari or send photos from a specified event to a contact.
It's clear Apple has yet to deliver these advancements to Siri, and like Craig Federighi said at the WWDC 2025 keynote, those might only be discussed later this year. Still, as we await that status update, the changes coming to screenshots might be a preview of things to come.
This article originally appeared on Engadget at https://www.engadget.com/ai/ios-26-screenshots-could-be-an-intriguing-preview-of-apples-delayed-siri-rework-183005404.html?src=rss https://www.engadget.com/ai/ios-26-screenshots-could-be-an-intriguing-preview-of-apples-delayed-siri-rework-183005404.html?src=rssZaloguj się, aby dodać komentarz
Inne posty w tej grupie
Tesla has offic
For as long as I can remember, Nintendo's gamepads have been a core part of my life. The NES's original rectangular controller was awfully unergonomic, but I still loved it, and it set me down the
You forget how much of a hit, how much of a turnaround, the Nintendo Switch turned out to be. After the major wobble (and baffling form factor) of the Wii U, Nintendo came back with a hybrid consol
It's been a busy week! In this episode, Devindra and Senior Editor Jessica Conditt dive into their final thoughts on the Switch 2, as well as Jess's time covering Summer Game Fest. We also put a bo
Robot vacuums can save you a ton of time by automating a regular chore you'd otherwise have to do manually. But you may sometimes want a handheld or cordless vacuum to quickly clean up small messes
