Technology

Exciting AI Features Coming with iOS 18, but Siri's upgradation is Delayed

Published November 3, 2024

Apple's new AI toolkit has seen a mix of delayed features and some that may not fully meet user expectations. Nonetheless, a set of promising AI tools that Apple first introduced at WWDC earlier this year is set to launch soon.

According to the latest edition of Mark Gurman's PowerOn newsletter, the iOS 18.2 update will begin its rollout in the first week of December.

This upcoming version of iOS is currently in beta testing and showcases a variety of interesting AI upgrades for iPhone users. One standout feature is the integration of Siri with OpenAI's ChatGPT, which aims to help users handle complex inquiries more efficiently by offloading those questions to the chatbot.

Another exciting addition is Visual Intelligence. This feature allows users to use their phone's camera to capture images of their surroundings, enabling the extraction of useful information about what's in the frame. Currently, it can perform tasks such as identifying dog breeds or extracting text from a poster.

Given the deep integration with OpenAI's technology, it is expected that Visual Intelligence will continue to evolve, likely gaining capabilities similar to the latest version of ChatGPT, including multi-modal comprehension.

Furthermore, the iOS 18.2 beta includes features like the Image Playgrounds app, which enables users to create fun images from their own photos. Another feature in development is a custom emoji system called Genmoji.

Gurman also mentions that with the iOS 18.4 update, which is expected to roll out around April next year, Siri will finally reach a level that many fans have been waiting for. The virtual assistant will be able to utilize user data to respond to questions based on information displayed on their screens. This is a significant step, as currently, Google's Gemini has similar abilities, allowing it to process local files for more relevant responses.

Once Siri is upgraded, it will pull information from files and data stored locally on the devices. This means users could ask Siri about travel plans found in emails, meeting schedules from their calendars, or business data from PDFs and spreadsheets. The ultimate goal is a deeper integration with third-party applications, enabling Siri to execute commands based on voice or text inputs effectively.

Additionally, Apple is also planning to allow users to access third-party AI tools, like Gemini, that could further enhance Siri's capabilities. Siri will eventually be able to analyze and respond to content based on what is currently displayed on the user's screen.

In summary, while iOS 18.2 arrives in December with exciting AI enhancements, the more substantial Siri improvements will not be available until April 2024. This update coincides with the anticipated release of the next-generation iPhone SE, which will feature a revamped design, upgraded performance, and support for Apple's Intelligence tools.

iOS, AI, Siri