Apple Expands Visual Intelligence With Bill Splitting, Nutrition Insights, and visionOS Support

Apple today unveiled significant upgrades to Visual Intelligence, including a new Siri mode in the Camera app that can analyze real-world objects and take actions directly from what the i Phone sees. Apple's vice president of software engineering Sebastien Marineau-Mes detailed the enhancements during today's WWDC keynote, explaining that the new ‌Siri‌ mode in Camera uses image understanding powered by Apple's foundational models to interpret what the camera is pointed at and surface contextually relevant actions. One of the headline use cases is bill splitting. Users can aim their iPhone camera at a restaurant check and immediately divide the total between friends, with Apple Cash integration allowing payments to be sent on the spot. Apple also demoed pointing the camera at a plate of food to receive nutritional insights. ‌Visual Intelligence‌ is also coming to visionOS, bringing the same capability to Apple's spatial computing platform. ‌Siri‌ can recognize real-world objects in a user's environment and surface relevant information about them on demand.Related Roundup: Apple Vision ProTags: Apple Intelligence, Visual IntelligenceBuyer's Guide: Vision Pro (Neutral)Related Forum: Apple Vision ProThis article, "Apple Expands Visual Intelligence With Bill Splitting, Nutrition Insights, and visionOS Support" first appeared on MacRumors.comDiscuss this article in our forums