Onboard AI chips will allow this to be local.
Phones do not have the power to ~~~
Perhaps this is why these features will only be available on iPhone 15 Pro/Max and newer? Gotta have those latest and greatest chips.
It will be fun to see how it all shakes out. If the AI can’t run most queries on the phone with all this advertising of local processing…there’ll be one hell of a lawsuit coming up.
EDIT: Finished looking for what I thought I remembered…
Additionally, Siri has been locally processed since iOS 15.
https://www.macrumors.com/how-to/use-on-device-siri-iphone-ipad/
You would go for a Raspberry Pi when you need something it was invented for.
Putting a computer on your motorcycle or robot or solar powered RV. Super small space or low-low power availability things, or direct GPIO control.
A MiniMicro will run laps around a Pi for general compute, but you can’t run it off a cell phone battery pack. People only related Pis to general compute because of the push to sell them as affordable school computers, not because they were awesome at it, because they were cheap and just barely enough.