Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I was hopeful for on-device AI too but any AI processing so far sucks up the battery, heats up the phone and most importantly isn't even nearly good enough. Without a breakthrough in battery, chips or the models and algorithms the way forward is thin clients that connect to some servers close to a solar farm or nuclear energy plant.


A 64GB Mac mini can run a local model at speed that solves the majority of every day user queries.

It won't rewrite a large code case (although the local coding models can do small functions) but it can do a kid's homework or rewrite an email.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: