Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Had it for 3 days running with nary a request. Perhaps it's the chosen model that I am serving (Gemma 4 26b)? I did see some WARN logs right after startup but the description don't suggest any problems that would block accepting requests or processing them.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: