iOS 18.2 and macOS 15.2: Apple Intelligence Unleashed

Apple Intelligence expands significantly in iOS 18.2 and macOS 15.2 with several new features and improvements.

Image Generation

  • Image Playground: A new app similar to DALL·E, allowing users to create AI-generated images from text descriptions or using various settings and objects. It also allows users to select subjects from their photo library.
  • Image Wand in Notes: This tool uses the Image Playground engine to generate images from descriptions, surrounding text, or even rough sketches within the Notes app.
  • Genmoji: Integrated into the keyboard's emoji picker, Genmoji creates custom emoji-style images based on user descriptions.

Enhanced Writing Tools

  • Expanded Writing Tools: Users can now input specific instructions to modify selected text, such as making it more professional, friendly, concise, or even transforming it into a poem.
  • ChatGPT Integration: A "Compose" button within Writing Tools allows users to generate text using ChatGPT prompts, with options for refinement and suggestions.

Visual Intelligence and Siri

  • Visual Intelligence (iPhone 16): This feature allows users to get information about objects by pointing their camera at them. It leverages Siri and ChatGPT to provide details like restaurant ratings, hours, and even reservation options. For other objects, it offers Google Image Search and ChatGPT prompts for further inquiry.
  • Smarter Siri with ChatGPT: Siri now integrates with ChatGPT, offering more comprehensive answers and the ability to generate images using DALL·E 3. Users can browse their Photos library or ask about on-screen content, with prompts to send images or screenshots to ChatGPT for analysis. Settings allow users to manage ChatGPT requests and utilize their ChatGPT subscription for enhanced benefits.

For more on Apple's AI advancements, check out iOS 18.2's expanded AI language support. Also, see how this compares to Anthropic's new AI chatbot, Claude 3.5. For insights into the broader tech landscape, explore Google's AR glasses and the future of computing.