Earlier this week, Apple launched the first public beta of iOS 27. With it comes the new, smarter Siri, which is now both a standalone app and a set of features embedded in various apps across the operating system.
The new Siri really is smarter, but the naming confusion (Siri is now called Siri AI) as well as the fact that some features are built into other Apple apps can be overwhelming for users. Let’s take a look at which new Siri AI features are actually worth trying.
SEE ALSO:
How to test the Siri AI beta: Join the waiting list
Before we begin, a caveat: Due to regulatory issues, almost none of these features are available in China and Europe. Although the problems in China appear to be resolved, Apple still has no timeline for launching Siri AI in Europe.
Mashable’s also published a guide that includes instructions on how to install the public beta and access the new features.
Table of Contents
Siri, the app
For a long time (actually since 2011 when Siri was first introduced), Apple refused to give Siri a proper body. The idea is that it’s the invisible helper, the voice you interact with, but not something you want to type and chat with.
Then the OpenAI ChatGPT era came and everything changed. It took a few years for Apple to relent, and with iOS 27 the company released Siri as a standalone app.
Recommended video for you
Is ChatGPT changing the way we write?
So what is the experience like? Think of ChatGPT, Claude or Gemini. You launch the app and are greeted by a grid of your previous convos with Siri. Start a new one, either by voice or by typing, and Siri will respond. Because it’s a smarter Siri, you don’t have to be afraid to ask something more complex than “What’s the weather tomorrow?” These are not just general questions like “Will the yellow cards in the World Cup semi-finals carry over to the final?” – You can also ask personal questions, including mentioning the content of your past emails, notes and events.
Visual intelligence
This is indeed a traditional cricket ball.
Photo credit: Apple
This is really useful because it relates to the way you use your iPhone in ways that weren’t possible before. Suppose you are on YouTube and a video appears showing a moment from a famous television show. The problem is that you just can’t remember the name of the show. No problem; Invoke Siri by long-pressing your phone’s side button and ask it about the content you’re currently watching on the display. Pretty cool, right?
You can do this in different contexts; Whatever is on your screen, Siri can tell you something about it.
The same goes for the things that lie before you in real life. With the new Siri Mode in the Camera app, you can point your lens at anything and get Siri to provide some information about what you’re seeing.
Picture playground
This feature has existed before, but it was… well, maybe not a complete joke, but definitely a cartoon version of the original; That is, the only type of images it could produce were cartoon-style images.
Destructible speed of light
That has changed with Siri AI. You can now capture realistic photos like futuristic cityscapes and beautiful landscapes, or combinations like a bear dancing on a giant block of cheese.
Even better, once an image is created, you can optimize it with additional prompting. If you want a sign that says “CHEESE” above the image you just created, tell Siri to add it. It will then appear in the next iteration.
It’s not the most advanced AI-based image generation on the market, but it gets the job done and is the fastest and most convenient option for many users.
Photo editing
The image is good, I just need more space around the subject.
Photo credit: Apple
Open a photo, tap the “Edit” button, and you’ll see an option called “Tools” at the bottom right. Tap on it and you will see three options. When cleaning up, you can tap or circle an unwanted object to make it disappear. This feature already existed (maybe it works a little better now), but the other two are new.
Extend uses Siri AI to enlarge the image. Pinch to zoom out and the AI will analyze the photo and add more elements around the edges to enlarge the photo. It doesn’t always work, but when it does it feels a little magical.
The other new option is Reframe, which allows you to change the perspective of the photo after you take it. Don’t expect miracles here (I would only use this for photos that desperately need it), but when it works it’s pretty cool.
Write with Siri
Siri AI is now integrated into various writing and communication tools on iOS. For example, in the Notes app, you’ll see an option called “Write with Siri” right above the keyboard. Tap it and write using a command prompt instead of actually typing text.
This can be pretty powerful. Let’s say you want to summarize an entire itinerary or write a movie plot (without spoilers!), but you don’t want to write everything down. Instead, just tell Siri what you want and it will automatically generate the text for you.
You can also highlight a section of text and tell Siri to generate an image related to it, or use it to solve math problems.
Smarter calendar and reminders
Sometimes you have to tap on things and provide additional context, but the new calendar is much better than before.
Photo credit: Apple
Siri is also integrated into Apple’s Calendar app and enables natural language recognition. For example, you can create a new event and describe what you want to do (dinner with your wife at Joe’s tomorrow at 7 p.m.), and the Calendar app will automatically recognize the right people from your contacts and create the event at the right time.
The same goes for Reminders, an app I think I should use more often, but it just never clicked for me. Describe again what you need to be reminded of. Details such as location, time and date are then recorded automatically.
Shortcuts you actually want to use
Let’s face it: Shortcuts are the best iOS feature that almost no one uses, simply because the idea of converting a chain of events/commands into a single command sounds too intimidating for many people.
Thanks to Siri AI, you can now easily describe the shortcut and have it created automatically. To access this feature, open Shortcuts, tap New Shortcut, and describe what you want the shortcut to do. Would you like the iPhone to audibly tell you that it is 90 percent charged? Just type that into the Shortcuts app and you’re done.
Do you want to get started? Here’s how to try out the Siri AI beta.
https://mashable.com/tech/siri-ai-new-features
