Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You can run 25-30b model easily if you use Q3 or Q4 quants and llama-server with a pretty long list of options.


Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: