Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

So many variants of these models. The ggufs from unsloth don't work with ollama. Perhaps wait for a bit for the latest llama.cpp to be picked up by downstream projects.

If you're on a 16GB Mac mini, what's a good variant to run?



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: