Hacker News new | past | comments | ask | show | jobs | submit login

i think you're overlooking iOS instances with "neural" accelerators in the pockets of the people in those corporations.



And how will that materialize? Will Apple build a new AI chip that would be affordable enough to embed in every iPhone, or whatever new device they will invent? Or will it all be cloud based where it should be able to support hundreds of millions of users?

Microsoft already has the cloud infrastructure ready. They don't need to build a new device, or a new operating system, or whatever. They're milking the AI cow as we speak.


Apple has had "AI chips" in the iOS devices for years already. I wonder what you define as an AI chip, though, since we could be discussing different sorts of custom accelerators.


Look at what a company called Groq does. Their chip can generate 500 tokens/second from a model like Llama 2 70b.

https://groq.com/




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: