My Thoughts on What Apple Announced at WWDC24

Apple held their biggest tech event of the year between the 10th of June – the 14th of June 2024, with their main keynote taking place online and in person on the 10th.

I was blown away by the AI technology previewed at the time — though not all the new software impressed me in the same way. However, the only platforms I had time to share my views on at the time were on the PL Tech Reviews YouTube Channel and on The Accessible Technology Podcast.

So although I’m late to the party, I’m going to be summarising everything that was announced at WWDC24, as well as sharing my views on how accessible each of the software updates are now.

VisionOS 2 Coming to the Vision Pro headset

When Apple first introduced the Vision Pro earlier this year, it was clear that they had set their sights on redefining the way we interact with technology. This immersive headset promised to transport users into a world of boundless possibilities, blurring the lines between the physical and digital realms, and furthermore, it threatens to make the iPhone an old and non existent device, although that is currently only a far off dream for nerds.

It blends digital content with your physical space, enabling its users to work, watch, relive memories and connect in ways that have never been possible before. There’s a FaceTime camera in it that can appear right in front of you if you have the headset on, which enables you to have intimate conversations with your family members and friends through the headset, just in case the conversations you can actually have with them face to face and without a device is too difficult to do. Beyond this, you can also watch films and tv shows on it, play games and relive moments in your video library; discover new ways to work with the ability to connect a keyboard, a controller and other bluetooth devices; and shrink everything you add to your space so you can fit more than one digital item in.

In VisionOS 1, users got to experience Apple’s first spacial operating system whilst also getting used to using only their eyes, voice and hands. Although many of the early updates only included bug fixes, things improved after VisionOS 1.1 was released, as that introduced Mobile Device Management, which included:

• Support for device configurations, such as Wi-Fi, VPNs, email accounts and single sign in etc.
• Support for iPhone, iPad and VisionOS apps.
• Support for iMessage Contact Key Verification.
• Closed captions for viewing Apple Immersive Video.
• The Persona beta and EyeSight, which basically enabled users to control their digital avatar hands free; improved hair and makeup appearance; improved neck and mouth representation and improved rendering of the eyes for EyeSight.
• Improved accuracy and fixed issues with the virtual keyboard.
• Resolved issues discovering and connecting to a Mac.
• Introduced the ability to set up a device while using a captive Wi-Fi network such as those found at hotels, cafés and airports.

However, the only updates that came after that only included bug fixes and not a lot of the other features that came to the Vision Pro Headset made it any more outstanding than the headset already was.

But with VisionOS 2 everything is different!

The new software enables users to take advantage of the advanced machine learning algorithms and to transform their existing 2D photos into spacial experiences, which not only enhances the visual experience but also opens up new possibilities for users with physical limitations.

Beyond this, VisionOS 2 also introduces integration between photos, videos and SharePlay, enabling users to share their spatial photos and videos with loved ones, even when they’re not physically together. This collaborative feature allows users to gather around a virtual table and experience the magic of spatial computing together, fostering deeper connections and shared moments. For users with limited mobility, this feature can be particularly empowering, as it will help them take part in conversations, even when they’re not well.

When it comes to viewing the new Photos app, anyone who is familiar with it will notice a much more clean and organised interface. You’ll be able to view Spacial Video that you can record on the iPhone 15 Pro and iPhone 15 Pro Max and later on it and edit these films using Final Cut Pro through the Mac digital display on the headset.

Furthermore, you’ll also be able to trim any video in the new photos app and experience “Apple Immersive Video” format, which will let you experience stunning experiences through the headset.

Immersive Video through the Apple Vision Pro is something I am especially interested in, as this could actually be a way for disabled people to visit tourist attractions they may never be able to visit in person, such as attending a safari park or climbing the Great Pyramid of Giza.

Other features VisionOS 2 comes with are:

• Improved hand and eye gestures, capable of letting you rotate your hand and tapping your fingers together to open your apps or letting users who can’t use their hands use their eyes to do it much better than before.
• The ability to customise your Home View.
• Panoramic productivity with your Mac Virtual Display.
• New Environments.

What’s new in iOS 18?

Apple’s iOS 18 is a game-changer when compared to earlier systems, with a wealth of new customisation options, allowing you to truly make your device your own.

This includes enhanced Home Screen customisation, so you’ll be able to arrange your app icons and widgets in a way that perfectly frames your favourite wallpaper, whether you choose a classic look or a stylish dark mode design.

The Control Centre has also received a significant upgrade, however, with the user now able to access a wider range of controls with a single continuous swipe, including media playback, home controls, and more. With upgrades such as these, you’ll be able to customise the layout and size of your controls, making it much easier to access the features you use the most.

For anyone who works with apps that have sensitive information on them but also shares their devices with other people, such as a child, iOS 18 brings new ways to protect sensitive apps and any information you have stored within them. You can now lock specific apps, requiring the user to authenticate with Face ID, Touch ID, or a passcode before accessing the app’s contents, which will give peace of mind, especially to people working in the armed forces; in journalism or who is in the police force.

Beyond this, you’ll also be able to hide apps from the view of others in iOS 18. This can be particularly useful for individuals facing domestic violence or abusive relationships, who may want to conceal certain apps from others. With this new functionality, you can keep sensitive apps out of sight, while still having access to them when needed.

iOS 18 also brings significant improvements to the way we communicate and stay connected.

The Messages app, for instance, now includes special AI tools to express yourself. The expanded Tapbacks feature allows you to respond with any emoji or sticker, giving you limitless options to convey your emotions, but I personally feel like this is something I’ve seen before. Additionally, you can also now schedule messages to send at a later time.

Messages also introduces a new visual messaging experience with text effects. Whether you want to emphasise big news, bring your emojis to life, or simply add some flair to a photo, these effects allow you to add a touch of personality to your conversations.

Moving onwards to maps, iOS 18 brings along with it a bundle of improvements, making it even more valuable.

The Maps app now features detailed topographic maps, complete with comprehensive trail networks and hiking routes. You can save these maps to your device and access them offline, ensuring you have the information you need even when you’re off the grid. Furthermore, the turn-by-turn voice guidance and the ability to create your own custom hikes promises to enhance the Maps app for outdoor exploration.

It’s even a lot easier to send money to others now (as long as the person you want to send money to also has an iPhone).

The Wallet app in iOS 18 comes with a new feature called “Tap to Cash” that allows you to quickly and privately exchange Apple Cash with friends and family, by just holding your iPhones over each other. This feature eliminates the need to share phone numbers or email addresses, making it a more secure and convenient way to settle up after a shared expense.

Beyond this, Wallet also now offers two new ways to pay with Apple Pay online, with a choice between the ability to redeem rewards or to access installment options from your bank or card providers.

The Photos app has been revolutionised so you can manage and enjoy your photo library better, with the layout having been unified into a single, intuitive view, with the photo grid at the top and your library organised by theme below. It is also now possible for you to customise the order of the collections, elevating the topics that are most important to you.

Other new features new to the Photos app in iOS 18 include:

• The ability to leverage advanced intelligence in order to keep your library organised and easily accessible, as well as being able to filter out specific content types, so that you’ll ultimately be able to enjoy a clutter free version of all your cherished memories. The new “Carousel” feature further enhances the experience by highlighting your best photos in a beautiful, poster-like display that changes daily.
• Improved recognition of people and pets, making it easier to find and share photos of your furry loved ones with the human kind. As well as this, you can now access your favorite groups of people, making it simpler to revisit and relive your memorable adventures and gatherings.

iOS 18 isn’t just about personalization, communication, and outdoor exploration, however, – it also brings exciting updates for gamers and various other improvements across the system.

After years of anticipation, iOS 18 finally introduces a dedicated Game Mode, offering a tailored experience for mobile gaming. This feature promises to optimize system performance, minimize distractions, and provide a more immersive gaming environment, catering to the needs of casual and hardcore gamers alike.

A few other features coming to iOS 18 include:

• Larger app icons on the Home Screen for improved visibility.
• RCS messaging support for enhanced cross-platform communication.
• Seamless integration between Reminders and Calendar, making it easier to manage your tasks and schedule.

What’s new in audio and home?

AirPods have become one of the most beloved and widely-used headphones in the world, thanks to their exceptional audio quality, seamless connectivity, and convenient features. At WWDC24, Apple announced several enhancements to the AirPods lineup that are sure to delight both existing and new users.

One of the standout features introduced for AirPods is the ability to interact with Siri using simple head gestures. For those who may have difficulty tapping or speaking, you’ll now simply be able to nod your head “yes” or gently shake your head “no” when you want to respond to Siri commands.

Beyond this, Apple has also introduced voice isolation technology to their AirPods lineup, which is designed to ensure that your voice sounds crystal clear during phone calls, even in noisy or windy environments.

For those who rely on their AirPods for hands-free communication, this enhancement is a welcome addition, as it helps to maintain the high-quality audio experience that users have come to expect from Apple’s wireless earbuds.

In relation to spacial audio and gaming, Apple announced that they are expanding the capabilities of personalised spatial audio to include gaming, meaning spatial audio can be tailored to the individual user’s head and ear shape. This ensures that the audio cues and sound effects in games feel truly three-dimensional, placing the player right in the middle of the action.

To further enhance the gaming experience, Apple has also introduced a new API that allows game developers to easily integrate this personalised spatial audio functionality into their titles. One of the first games to take advantage of this feature is the highly anticipated “Need for Speed Mobile” by Tencent Games and EA, set to launch later this year.

Moving on to the new features coming to the next version of Apple tvOS, there were quite a few new exciting features also mentioned at WWDC.

If you’re someone who often finds yourself wondering what a song in a film is called or driving yourself mad over what someone is called, you’ll now have a special new feature to not make you feel as embarrassing.

With Apple’s new Insight feature, you’ll be able to find out whatever you want to know about a film or tv programme by simply swiping down on the Siri Remote that you’re controlling physically in your hand or via the app, until the screen displays the names and character information of the actors currently on screen or the name of a song.

At least I won’t have any embarrassing moments any more when watching The Grinch anymore when I want to add a particular song or tune that is in the film to my music library and I can’t think of what it’s actually called.

Furthermore, Apple has also introduced improved dialogue clarity to their Apple TV and TV+ experience.

This feature is particularly beneficial for those who rely on subtitles or for situations where you may need to mute the volume, such as when watching TV late at night or in a shared living space.

Other features Apple has introduced to the Apple TV experience are:

• More convenient subtitles, meaning subtitles will now appear at just the right times, even when the volume is muted or when you skip back in the timeline.
• Support for 21:9 aspect ratio projectors on the Apple TV, for anyone interested in creating a home theatre experience in their own homes.
• Enhanced screensaver functionality, including the ability to choose Portraits as your screensaver; to frame your photos like works of art in a gallery; an option to select moments from your favourite tv shows as a screensaver or to opt for the new Snoopy and Woodstock screensavers.
• A redesigned Apple Fitness+ experience that is optimised for the Apple TV, so users can enjoy workout routines on the big screen.

All of this seems great, but I just hope Apple will also start introducing more workouts for physically disabled people as well so that disabled users of the Apple TV can feel supported if they are passionate about keeping an eye on their health and weight as well.

What is new in watchOS 11?

WatchOS 11 introduces the “Training Load” feature, which provides users with a deeper understanding of the impact their workouts have on their bodies. By leveraging advanced algorithms and data from the Apple Watch’s sensors, this feature can accurately estimate the effort and strain placed on the user during their fitness activities.

Beyond this, you’ll also be able to adjust your daily goals based on the day of the week or even pause your rings temporarily if you need a rest day, giving you a large amount of customisation and control over your life as well.

However, Apple is now introducing the new Vitals app with WatchOS 11.

The Vitals app:

• Helps the Apple Watch track key vitals during sleep, such as heart rate, respiratory rate and body temperature.
• Analyses metrics and compares them to the user’s historical data, while providing valuable insights into the user’s overall health status and identifies any significant changes or deviations from their typical ranges.
• Provides health notifications to users so they can understand how changes in their health may be linked to other aspects of their lives, such as changes in activity, sleep patterns or illness.

This information can be particularly useful for individuals with chronic health conditions or those who are interested in proactively monitoring their well-being and even encourages them to take a more proactive approach with their health.

Accessibility-wise, WatchOS 11 also introduces several features aimed at improving the overall user experience and enhanced connectivity, which, depending on the disability you have, may mean you’ll be able to use it easier.

These include:

• New voice control capabilities, which may help individuals who have difficulty using their wrists or fingers.
• An intelligent Smart Stacks and Live Activities feature, which can automatically add new widgets based on the users context and needs, and can even warn users before it rains. Beyond this, widgets can also help users when travelling to a new location, provide users with information they need at the right time and more.
• Live Activities which allow developers to integrate real-time updates into Smart Stack, enabling them to stay informed about events, transportation, and other sensitive information without having to constantly check their watch.

Apple has always been open about letting Apple Watch users personalise their watch for their own liking, and with WatchOS 11, customisation has now been taken to new heights.

The redesigned Photo watch face in watchOS 11 uses machine learning to intelligently curate the best photos for the user’s watch face, considering factors such as facial expressions, aesthetics, and composition.

This allows users to create a personalised and visually stunning watch face that reflects their individual style and preferences, while furthermore, allowing users to customise their watch face by selecting bold colours or a monotone look, ensuring that their Apple Watch seamlessly integrates with their personal aesthetic.

Other features WatchOS 11 comes with include:

• A new double-tap API that lets developers define custom actions within their apps, enabling users to perform specific tasks with a simple double-tap on the Apple Watch screen.
• Monitoring during pregnancy within the health app, even capable of notifying pregnant women about bleeding during pregnancy.
• AI features for translating conventions between people who many not understand each other’s language.
• Check In, which will allow friends to receive notifications of when their friend gets back from an evening or late night run.
• Spout Baby Tracker, so you can track how long a baby has been sleeping for.

But while all the new features available on WatchOS are impressive, I think it is important that users of the Apple Watch will still be able to communicate with people on non-Apple devices, and that the watch won’t push people into fitness too hard. Sadly, Sudden Adult Death is a thing, and athletic people can sometimes push themselves too far when it comes to staying fit. For this reason, I think Apple should be including warnings in their Workout Ratings, especially because they have a Hard and All Out rating as well.

What is new in iPadOS 18?

Many of the new features in iPadOS 18 mirror what you’re getting in iOS 18, but there’s a few exciting new standalone features as well.

One of these new features is a redesigned tab bar, which makes navigating within apps a whole lot easier. With the tab bar, you’ll be able to easily switch between different sections of an app, keeping your content edge-to-edge. Furthermore, you can also morph the sidebar over to the side, and if you use a certain menu item more often, you can move it into the menu at the top of the screen.

On top of this, there’s also an updated document browsing experience and advanced animations that you’ll notice when going into apps.

Beyond this, Apple has also improved their Screen Sharing feature that was introduced last year. With iPadOS 18, you can now tap and draw on the screen to point out to a friend any specific areas or actions. But the real game-changer is the ability to request to remote control the other person’s iPad or iPhone, allowing you to directly assist them with tasks or other issues.

This feature is particularly valuable for individuals who may need additional support, such as those with accessibility needs or those who are less tech-savvy. By enabling remote control, you can guide them through complex tasks, step-by-step, ensuring they can fully leverage the capabilities of their iPad or iPhone.

This feature is particularly valuable for individuals who may need additional support, such as those with accessibility needs or those who are less tech-savvy. By enabling remote control, you can guide them through complex tasks, step-by-step, ensuring they can fully leverage the capabilities of their iPad or iPhone.

Moving on to a feature I believe many iPad users will be the most excited for, a Calculator app has finally be introduced to the iPad, and it is not one that you’ll have to download from the app store. But this is no ordinary calculator! It’s a powerful tool that integrates the Apple Pencil with the calculator and AI… and makes me incredibly jealous that I had to sit through maths classes ten years ago and struggle through them with no AI, while kids get a lot more assistance now.

The standout feature on the iPad Calculator is the new Math Notes feature, which allows you to write equations and variables directly on the screen using the Apple Pencil. As you write, the Calculator will instantly recognise and solve the equation, displaying the results in your own handwriting. This feature is a game-changer for students, researchers, and anyone who needs to perform complex calculations, although moves will be made to make sure one of these groups doesn’t take advantage of the technology that is available, depending on what they are doing on a particular day in school.

Plus you can create graphs using to visualise everything you’ve written down and it integrates perfectly with the Notes app too.

In addition to the Calculator’s capabilities, iPadOS 18 also introduces a new feature called Smart Script, which revolutionises the handwriting experience in Notes. Not only will the update make sure your handwriting will end up looking as neat and tidy as possible, but the system also automatically adjusts the spacing and alignment of your text, ensuring a seamless and natural writing experience. But if you decide you’d like to blend writing and digital elements together, Smart Script also allows you to easily integrate typed text into your handwritten notes, so you get the best of both worlds.

If you’re someone who uses your iPad for more creative reasons, iPadOS 18 has you covered even more with this latest update! With Final Cut Pro and Logic Pro now being on the iPad, Apple is enabling it’s users to harness the full creative potential of their devices.

Whether you’re a professional filmmaker, a musician, journalist, or someone who simply enjoys creating content, the seamless integration of these apps with the iPad’s hardware and software capabilities opens up a world of possibilities. You’ll be able to edit footage and audio using your Apple Pencil and Apple Magic Keyboard Case for the iPad, and depending on if you’re someone who works with multiple cameras or not, you’ll also be able to work with more than one camera on your iPad.

On a slightly critical note, however, I hope the Apple Pencil won’t be the only stylus you can create Math Notes or Smart Script text with, because there are people in the world who can’t use it. I’ve tried to attempt using an Apple Pencil in the past, for example, but I’ve been advised not to use it because of how much pressure you have to use, which is why every feature you can perform with a stylus should be doable with WHICHEVER stylus you try to do it with.

Other features available in iPadOS 18 are:

• Apple Intelligence (but only if you have an iPad that is M1 or later).
• The ability to create images to express yourself, craft Genmoji for conversations or revisit favourite moments with memory movies.
• A more impressive version of Siri.
• Live audio transcriptions.
• Better highlighting capabilities.
• Collapsable sections in text.
• The ability to give apps their own icons and to look a completely different colour.
• The ability to hide or lock apps.
• A redesigned version of Control Centre that also allows for customisation.
• A redesigned photo library.
• Messages with effects.
• The ability to schedule messages for later.
• Game Mode, which minimises background activity to sustain constant high frame rates for hours of continuous gameplay.
• The Passwords app where all your passwords will be stored.
• Scenes, labels and more elements available to you in the Freeform app.
• Control over how you share contacts with apps.
• Updated privacy settings.
• Improved Bluetooth privacy.
• Eye Tracking and Vocal Shortcuts so disabled people have more ways of controlling their iPad if they can’t do it through touch.
• Detailed trail networks with topographic maps.
• A new design for Fitness+.

What Will You Be Able to do in MacOS Sequoia?

Just like iOS 18 on the iPhone and iPad, MacOS Sequoia will be getting many of the same updates. But the Mac will also be getting other features in MacOS Sequoia that help it stand out more as itself.

One of these standout features is the enhanced continuity experience you’ll get either the introduction of iPhone Mirroring, allowing users to access and control their iPhone directly from their Mac.

With just a click in the dock, I can now see the exact contents of my iPhone’s screen on my Mac, and even interact with it using the Mac’s trackpad and keyboard. This is a game-changer for someone like me, who can’t get up and grab her phone by herself, so often has to ask for her phone to be brought over, even when the people around me aren’t free.

At least with the New Phone Mirroring feature, I can transfer money into my bank account while still on my Mac or grab film footage and images better.

It isn’t perfect, and I could definitely think up a large list that could make iPhone Mirroring more accessible. But as that gives me an idea for a blog post I could send out in future, I’ll just leave it there.

MacOS Sequoia also introduces a load of features aimed at streamlining your workflow and helping you stay organised, particularly when you’re managing multiple windows and applications simultaneously.

With the new automatic window tilling functionality, you’ll be able to drag a window to the edge of the screen, which is when MacOS Sequoia will intelligently suggest a tiled position, offering a effortless way of arranging windows in the optimal layout for tasks. This is a massive time-saver, that will give many Mac users an easier way to juggle various media projects.

Complementing the window tiling feature are the new keyboard and menu shortcuts, which enable me to quickly and efficiently rearrange my windows with just a few keystrokes. As someone who relies heavily on keyboard-driven workflows, these enhancements are a welcome addition that will significantly boost my productivity.

Moving into the improvements that have been made to video conferencing, Apple have introduced good features that will make video conferencing easier with MacOS Sequoia.

One of these features is the new Presenter Preview function, which will allow you to see what you’re sharing with your meeting participants before you actually share it.

Another exciting feature is the ability to customise your video conference background. The built-in background option can be replaced with your own photos, but somehow I think that’s an old feature recycled, if you know what I’m referring to.

In relation to gaming, MacOS Sequoia includes advancements in the gaming realm that will make Mac-based gamers excited about what they’ll get to experience as we dive into the future.

The tight integration of Metal, Apple’s graphics API, and the power of Apple silicon have made the Mac a more capable gaming platform than ever before, and I’m excited to see where we’ll be going with this in future.

With the ability to unify game code and shaders across iPhone, iPad, and Mac, developers can now create truly seamless gaming experiences that follow me wherever I go, allowing you to pick up where you left off on any device.

Furthermore, many of the games coming to the Mac will feature built-in accessibility settings, similar to to what I’ve experienced on game consoles. Saying that, it is still up to debate over how accessible games on a Mac are, but that’s something I’d rather write about in another blog post when I get time to do it as well.

Other features coming to MacOS Sequoia are:

• Apple Intelligence (if your Mac is M1 and later).
• AI writing tools, that can make your email sound funnier, friendly or more professional etc.
• The ability to create AI images.
• A new version of Siri.
• iPhone notifications on Mac.
• More control over web videos that help you put them front and centre.
• Access to the new Passwords app.
• Access to Math Notes.
• Access to everything else you get with iOS 18.

What exactly is Apple Intelligence?

So yes, Apple told us a lot about what’s available in the newest software updates that are coming to their main devices at WWDC24 this year. But something I haven’t been able to chat about as of yet is what exactly we’ll be getting as part of Apple Intelligence, which I’ll start chatting about now.

Apple Intelligence offers a wide range of capabilities that promise to enhance our daily digital interactions.

It will be able to:

• Translate across large language models.
• Rewrite, proofread and summarise text across a wide range of applications.
• Generate original images in a variety of styles, including sketch, illustration, and animation.
• Automate a wide range of tasks on behalf of the user.

Furthermore, Apple Intelligence will come with ChatGPT from OpenAI, which will be integrated into Siri and Writing Tools. If you enter just a few words into Compose in Writing Tools, you’ll be able to create and illustrate original content from scratch.

But on a slightly safer note, you can control when ChatGPT is used and will be asked before any of your information is shared. This at least should help give some AI sceptics peace of mind.

After it is released, Apple Intelligence will be compatible with:

• iPhone 16
• iPhone 16 Plus
• iPhone 16 Pro Max
• iPhone 16 Pro
• iPhone 15 Pro Max
• iPhone 15 Pro
• iPad Pro (M1 and later)
• iPad Air (M1 and Later)
• iPad Mini (A17 Pro)
• MacBook Air (M1 and later)
• MacBook Pro (M1 and later)
• iMac (M1 and later)
• Mac mini (M1 and later)
• Mac Studio (M1 Max and later)
• Mac Pro (M2 Ultra)

Conclusion

So what are my thoughts on everything Apple announced at WWDC24 overall?

Well overall, I think there’s a mix of absolute fabulous and slightly worrying things.

All jokes aside, I do think Math Notes has the potential to help people in good ways, especially if they have Dyscalculia. As someone who finds maths and numbers difficult myself, I do think it could be beneficial to have a computer that will just give you the right number, especially if you’re just needing to do a couple of quick equations and nothing too difficult.

But on a slightly more worrying note, I do think there’s something slightly worrisome about AI being capable of writing stories for you. While some people may be happy for a computer to write a story for them, I’m definitely not one of those people, and honestly, I’m happy I have an old 2015 MacBook Pro for writing my book, because while I could rely on AI to write the end of it, I will choose the relationships I have with my characters over it.

So are the updates and new features Apple announced at WWDC this year software that I’m looking forward to?

Yes, because accessibility-wise, they could be a game-changer having.

But will I be using Apple’s new intelligence features for everything?

For once, I’m not quite sure.