iPhone 16's Latest Visual Intelligence Features Explained - MacRumorsOpen MenuShow RoundupsShow Forums menuVisit ForumsOpen Sidebar
Skip to Content

iPhone 16's Latest Visual Intelligence Features Explained

by

For ‌iPhone 16‌ models, Apple's iOS 18.3 software update added new Visual Intelligence features to the Camera Control button. Keep reading to learn what you can do with the new capabilities and how to use them.

Apple Visual Intelligence

New Visual Intelligence Features

In iOS 18.2, Apple company added Visual Intelligence functionality to its latest iPhone 16 models, allowing device owners to point the camera at the world around them and get details about places, summarize and translate text, go to website links, call phone numbers, and more.

In iOS 18.3, Apple added new capabilities to Visual Intelligence, including an option to create a calendar event when viewing a poster or flyer, as well as the ability to easily identify plants, animals, and insects.

iphone 16 hands on camera control
Bear in mind that ‌Visual Intelligence‌ is an Apple Intelligence feature that is exclusive to the ‌iPhone 16‌ models – if you have an older model, you won't have a Camera Control button below the Side button on the right-hand side of your device.

Activating Visual Intelligence

To activate Visual Intelligence, press and hold the Camera Control button for a few seconds. A regular press simply opens the camera with Camera Control, so the press-and-hold gesture is necessary. Ensure the Camera app isn't already active, as Visual Intelligence won't work if the camera is already in use.

The Visual Intelligence interface includes a camera view, a capture button, and "Ask" and "Search" options. The "Ask" button interacts with ChatGPT, while "Search" sends the captured image to Google Search.

visual intelligence buttons
To use Visual Intelligence, you must take a photo of the object or scene you're observing. Use the Camera Control button to snap a picture, then select your desired option. It doesn't support live camera views or previously saved photos.

Create a Calendar Event From a Poster

Using ‌Visual Intelligence‌ to add an event to Calendar was a promised function that Apple showed off when introducing Camera Control, and it has been usable since the release of iOS 18.3.

create event visual intelligence
To add an event, view a document such as a poster with a date, and then tap on the date when the feature pops up in the ‌Visual Intelligence‌ interface.

Identify Pets, Animals, and Insects

The Photos app is already able to provide insight into plants, animals, and insects when opting to view additional information in the editing interface, but Camera Control will now show these details in real-time.

ios 18 3 camera control animals
When viewing an animal or a plant with ‌Visual Intelligence‌, you may see a tappable bubble at the top of the viewfinder that lets you know what you're looking at. Simply tap it to view more information. If the output is incorrect, you can use the thumbs up and thumbs down icons below the card to submit feedback to Apple.

Top Rated Comments

Armeniandave Avatar
17 months ago
Kind of a dick move to exclude 15 Pro’s
Score: 14 Votes (Like | Disagree)
17 months ago
Looks like a nice feature set. Looking forward to updating and checking it out.
Score: 7 Votes (Like | Disagree)
17 months ago
Apple Intelligence has proven worthless so far. Locking this feature to only iPhone 16 models continues this useless trend.
Score: 7 Votes (Like | Disagree)
teknikal90 Avatar
17 months ago

Like I keep saying, just buy Apple stock (AAPL) then you will be happy it's only on NEW models. :) :)
we're like 80% in to the Apple Intelligence rollout - can anyone honestly tell me 1 good benefit? The big downside, the massively decreased battery life is a tangible downside. I sure hope the contextual siri actually works.

None of that is creating any upward pressure on the company's valuation.
Score: 5 Votes (Like | Disagree)
17 months ago
Can’t wait. I really like AI, but know haters gonna hate.
Score: 5 Votes (Like | Disagree)
BGPL Avatar
17 months ago
This could be a very cool feature. Too bad my one year old phone doesn't support it. Classic Apple move.
Score: 5 Votes (Like | Disagree)

Popular Stories

iOS 27 on iPhone 17 1

Apple to Unveil iOS 27 in June With These New Features Beyond Siri

Friday April 17, 2026 8:40 am PDT by
Apple is expected to unveil iOS 27 during its WWDC 2026 keynote on June 8, and the update should be released in September. Below, we outline some of the new features that are rumored to be coming with iOS 27, beyond the long-awaited more personalized version of Siri. iOS 27 will reportedly support 5G satellite internet connectivity, although this functionality might be limited to the...
Apple Visual Intelligence

4 New Apple Intelligence Features Found in Apple Code, Likely in iOS 27

Thursday April 16, 2026 4:13 am PDT by
iOS 27 is likely to introduce at least four new Apple Intelligence features that function within system apps, based on backend code discovered by Nicolás Alvarez and confirmed by MacRumors. First up, Apple is expected to lean more heavily into Visual Intelligence in iOS 27, since the company is reportedly developing AI wearable devices that will leverage the feature. Apple is reportedly...
iOS 26 Glass Photos Feature

iOS 27 to Add New Apple Intelligence Photo Editing Tools

Tuesday April 28, 2026 11:37 am PDT by
Apple will add new Apple Intelligence photo editing tools to the Photos app in iOS 27, iPadOS 27, and macOS 27, reports Bloomberg. On-device Apple Intelligence will be able to make subtle changes to image quality, positioning, and focus, with the new capabilities joining Clean Up, the sole AI editing feature that Apple has released to date. The Photos app in iOS 27, iPadOS 27, and macOS...
Related Apple News: Macbook Air M3 Buyers Guide | Rumors | Ipados | Local News | Reviews