New AI, iPhone Control from Mac, and Other Highlights: Key Takeaways from WWDC 2024

Apple has once again surprised its fans. On June 10th, during the Worldwide Developers Conference (WWDC), Apple unveiled updates for the operating systems across its devices. Among these were the new visionOS for the Apple Vision Pro augmented reality headset, macOS 15 Sequoia, iOS 18, WatchOS 11, iPadOS 18, as well as features for AirPods Pro and Apple TV. The most impressive reveal was Apple Intelligence – the company’s proprietary AI system. Here’s a rundown of the most important announcements.

VisionOS 2

• Photo Mode: The new version of the operating system for the virtual reality headset now includes a special mode for viewing photos. This mode allows users to see regular images from iCloud in a “volumetric” 3D view, creating a sense of being next to the person in the photo.
• New Gestures: Additional gestures have been introduced to control the device more intuitively.
• Virtual Screen Expansion: The virtual screen has been expanded to the equivalent of two 4K monitors placed side by side, with more customization options available.
• International Availability: Vision Pro will soon be available in eight new countries.

iOS 18

Customization, Security, and Functionality are the key themes of the new iPhone operating system, set to release this fall for all users. Here are the new features of iOS 18:

• Flexible Home Screen: Icons on the home screen can now be arranged freely. Users can also change their size and color; with the dark mode, icons can also appear dark. Additionally, a unified filter can be applied to all icons, offering a stylish appearance.

• Customizable Control Center: Users can rearrange elements in the Control Center, and developers can add new modules.
• Revamped Photos App: The design of the Photos app has been updated, including content type filters and real-time collection formation.
• Lock Screen Shortcuts: Users can select which apps to launch from the lock screen. Currently, it features the “Flashlight” and “Camera,” but soon any app can be added for quick access.
• App Protection: Any app can now be password-protected or set to require Face ID or Touch ID for access. Apps can also be hidden from the device.
• Enhanced Wallet: Upgraded Wallet allows for money transfers by simply bringing phones close together (though the “Tap to Cash” feature is not yet available in Georgia).
• New Gaming Mode: A new gaming mode boosts peak performance for iPhones, much to the delight of gamers.
• iMessage Enhancements: This fall, iMessage will get delayed message sending, text editing, and quick reactions. Users can edit a message before the recipient reads it or schedule messages to be sent at a specified time.
• Mail Upgrades: Automatic email sorting into folders will be introduced in the Mail app.

Audio & Home

New Features for AirPods Pro: These updates are exclusive to the 2nd generation AirPods Pro.

• Gesture Recognition: AirPods Pro can now recognize gestures. For example, when listening to music and receiving a call, users can answer by nodding or decline by shaking their head side to side.
• Enhanced Voice Isolation: The updated voice isolation feature makes your voice clear even in noisy environments by suppressing surrounding sounds during a call. You could take a call directly from a construction site if you wish.
• Apple TV InSight Feature: Apple TV will now display information about the film’s director, actors, or soundtrack performers on the screen. This feature works with content from Apple.
• Enhanced Dialog: This feature enhances voice clarity using machine learning and works with any speakers or headphones.
• Projector Support: There is now support for projectors with a 21:9 aspect ratio.

WatchOS 11

With Apple’s technologies, keeping track of your health becomes a bit simpler and more enjoyable.

• Training Load Calculation: The new update includes the ability to calculate workout load to track progress for future sessions.
• Vitals Monitoring: A new feature called Vitals monitors your health for any abnormalities.
• Customizable Activity Rings: Activity rings can now be adjusted by day of the week – for instance, users can schedule rest days on weekends or pause activity tracking while on vacation.
• Widget Customization: Users can now customize the set of widgets on their watch, personalizing their device.
• Real-time Voice Translation: The watch can now translate conversations between two people in real-time, making it very convenient for trips and travel.
• Stay tuned for the second part where we cover more exciting updates and features from WWDC 2024!

iPadOS 18

The latest iPadOS 18 update brings several exciting features and enhancements to the iPad, offering users more customization and functionality:

• Updated Calculator App: At long last, the iPad calculator has been revamped! It now supports handwriting input and the Apple Pencil. Users can write formulas, equations, examples, and problems directly in the Notes app, and solve them using the calculator.
• Handwritten Text and Graphs: You can now draw graphs and write text by hand. The app will recognize and neatly format your handwriting, making it legible and tidy. This feature is a dream come true for students!
• Customizable Control Center: Similar to iOS 18, iPadOS 18 allows users to customize the Control Center, tailoring the layout to their preferences.
• Game Mode: A new Game Mode enhances performance during gameplay, offering a smoother experience for gamers.
• Drawing on the Home Screen: Users can now draw directly on the home screen, providing more interactive and creative ways to use the iPad.
• Remote Control of Other Apple Tablets: This new feature allows you to control other Apple tablets remotely. It’s incredibly convenient if the other device isn’t nearby, letting you make changes from a distance.

macOS 15 Sequoia

Apple introduced macOS 15, named Sequoia, which comes packed with numerous intelligent features:

• iPhone Mirroring: This standout feature gives users full access to their iPhone and its apps directly from their Mac. You’ll receive all your iPhone notifications on your Mac and can play sounds from the iPhone through the Mac’s speakers, all while the iPhone remains locked. Transferring photos, videos, or files is now easier than ever; just drag and drop from your iPhone to your Mac.
• New “Passwords” App: Previously part of the system settings, this app now stands alone and will also be available on iOS and iPadOS 18. It consolidates all your passwords in one place, encrypting them for security, and allows cross-platform usage.
• Safari Enhancements: The Safari browser has received privacy updates, a Highlights feature to emphasize important page content, and a “Picture in Picture” mode.
• Gaming Upgrades: With the update to Metal 3 and the introduction of Game Porting Toolkit 2, transferring games between your computer and phone is more seamless. Mac gamers will be thrilled to hear that games like “Prince of Persia” and “Assassin’s Creed Shadow” will be coming to Mac.

Apple Intelligence

The most talked-about announcement at WWDC is Apple’s new AI system, Apple Intelligence. This groundbreaking development will be integrated into all of Apple’s operating systems. Here’s what you can expect from Apple Intelligence:

• Language and Media Understanding: The AI will understand any language and can process text, photos, and videos. It will also excel at understanding context and making connections with your actions, such as messaging and web browsing, to provide relevant suggestions.
• On-Device Processing: For those concerned about privacy, rest easy – Apple Intelligence operates entirely on your device and doesn’t send any data to remote servers.

Other notable AI features include:

• Notification Prioritization: The system can categorize notifications into important and non-important, prioritizing emails, messages, and notes.
• Enhanced Siri: Siri gets a new animation and can now be interacted with in natural language rather than commands. You can even type your requests with a double tap on the iPhone screen.
• Photo Search by Description: Tell Siri to “find me at the beach,” and it will display the relevant photo from your gallery (assuming you have one). This functionality is built into the system and doesn’t require additional apps or an internet connection.
• AI-Generated Images: Create custom stickers or icon images for use in messaging apps.
• ChatGPT Integration: OpenAI’s ChatGPT will be integrated into iOS 18, iPadOS 18, and macOS 15, bringing advanced conversational capabilities.
• Photo Object Removal: Easily remove unwanted objects or people from photos with a single gesture, without needing extra software. Sounds almost too good to be true, right?

Apple Intelligence will be available in English this summer, with other languages to follow. Note that it will be compatible with the A17 Pro chip and newer (when released) and from M1 chips in Macs and iPads.

Some of the features announced by Apple will roll out gradually until the end of the year. Stay tuned for more details on new features for your iPhone, iPad, Mac, Apple Watch, AirPods, and Apple TV by following our blog and social media channels. Don’t miss out!