HIGHLIGHTS

1. Apple Intelligence: A suite of highly-capable generative models specialized for everyday tasks, adaptable to the user’s current activity.
2. On-Device and Server Foundation Models: A ~3 billion parameter on-device language model and a larger server-based language model, both built and adapted for efficient, accurate, and responsible performance.
3. Responsible AI Principles: Apple’s guidelines for developing AI tools and models, focusing on empowering users, representing users, designing with care, and protecting privacy.
4. Personalized AI: AI that is tailored to the individual user’s needs, preferences, and context, providing a more personalized and intuitive user experience.
5. Personal AI: AI that is deeply integrated with the user’s personal life, learning from their interactions and adapting to their unique patterns and habits, enabling a more seamless and efficient user experience.

---

1. Siri: Apple’s virtual assistant utilizes advanced natural language processing (NLP) to understand and respond to user queries, perform tasks, and control smart home devices. Siri is continually updated with more contextual understanding and capabilities, including offline functionality for some tasks.

2. Photos: The Photos app uses AI to recognize faces, objects, and scenes, allowing for automatic organization and search capabilities. Features like Memories create curated collections of photos and videos, highlighting significant moments with background music and transitions.

3. App Suggestions and Shortcuts: Apple Intelligence powers the proactive suggestions found in Siri Suggestions and the Shortcuts app. It predicts user actions based on habits and usage patterns, offering shortcuts to frequently used apps and tasks, and enabling users to create custom automation routines.

4. Messages and Keyboard: The AI in Messages and the iOS keyboard enhances communication by providing predictive text, emoji suggestions, and contextual responses. It also supports on-device processing for privacy while offering quick access to frequently used phrases and information.

5. Health and Fitness: The Health app, coupled with the Apple Watch, uses AI to track and analyze user health data. Features like Fall Detection, ECG monitoring, and blood oxygen level measurement provide insights and alerts, promoting user safety and well-being.

6. Face ID and Touch ID: Apple’s biometric authentication systems use ML models to ensure security and accuracy. Face ID adapts to changes in the user’s appearance, while Touch ID uses advanced fingerprint recognition technology.

7. Translation: The Translate app offers real-time translation across multiple languages, with on-device processing to ensure privacy. It supports text and voice input, providing seamless conversation translation capabilities.

8. Accessibility: Apple integrates AI to enhance accessibility features, such as VoiceOver, which uses screen reading technology, and Live Text, which allows users to interact with text within images. These features make devices more usable for individuals with disabilities.

9. Apple Music: The streaming service uses AI to provide personalized music recommendations, create custom playlists, and offer radio stations based on user preferences and listening history.

10. Maps: Apple Maps employs AI to deliver accurate navigation, traffic predictions, and personalized recommendations for points of interest. It also includes features like Look Around and detailed indoor maps for airports and malls.

Apple Intelligence: A white lie

Let’s look at all the promised AI capabilities that the iPhone 16 will bring and how you can access the same on Android today.

1. Visual Intelligence (VI)

What is it: When you push the newly added camera button, it will launch VI where you can search anything in front of you and get contextual answers.

In the pre-recorded livestream (Apple Event), they demonstrated that by scanning a storefront, you can get details about its menu, pricing, etc. Similarly, taking an image of a random dog will tell its breed, and capturing an image of a concert flyer will help create a calendar reminder.

Access it on Android: Gemini Advanced on flagship Android devices (Pixel 9 and Galaxy S24) can do it all today. Budget Android users can access the search function by summoning Gemini on any screen and using the image search feature. [2]

For day-to-day information retrieval and educational purposes, ChatGPT’s free plan is more than enough.

2. Writing emails and messages

What is it: Basically, a text generator that is embedded into iOS apps like iMessage and Apple Mail. The user request is sent to GPT 4o-mini (because it’s fast and lightweight, and can be run locally) which returns the output to the user.

Keep in mind that text generation was one of the fundamental things AI could do. Apple, a company that portrays itself as a company that prioritizes innovation hasn’t shipped it yet.

Access it on Android: Google Messages and Gmail app already has integrated Gemini that can be accessed on all Android phones. Moreover, this can also be used by iPhone users if they install those apps. Meta’s WhatsApp also has this functionality with Llama 3.1. [3,4]

3. Generate emoji

What is it: Generate fun emojis based on simple text prompts and send them to your friends and family, right from iMessage. Since image generation is always tricky, let’s see how Apple delivers it.

Based on the fact that Apple Intelligence is a ChatGPT wrapper, it is quite evident that the images are actually generated by Dall-E 3 or a lightweight LoRA model of the same.

Access it on Android: Image generation is only accessible on flagship Android devices as of now via the Pixel Studio. However, Gboard does enable some customization to emojis based on the context of the conversation.

4. Background object removal

What is it: Pretty self-explanatory. You can remove people and things in the background to make your photos better. They call it “Clean up”. That name is as creative as “Apple Intelligence”.

Access it on Android: The Magic Eraser is available on Google Photos. It can be accessed on all devices, including iPhones, since 2023.

Let me just remind you that Apple will deliver this over the next few months and I will be here to tell you if it’s any good. Please follow me on Medium to get that delivered straight to your inbox.

5. Search images and memories

What is it: You can find the image by describing what’s in it in the Photos app on your iPhone. Also, it will create stories based on the photos you took some time ago to help you relive the moment.

Access it on Android: Google Photos has had this since last year.