![](https://beehaw.org/pictrs/image/6ff64108-3d32-418f-a67e-bd7dc7c16dec.png)
![](https://beehaw.org/pictrs/image/c0e83ceb-b7e5-41b4-9b76-bfd152dd8d00.png)
Apple added (a while back) what they call a “Neural Engine,” which is hardware dedicated to efficient execution of ML workloads.
https://en.m.wikipedia.org/wiki/Apple_A11
They have been refining it ever since. I would not be surprised if they made advancements in both the hardware and software used for local GAI.
https://news.ycombinator.com/item?id=39358112