If you can run sota on a 40k setup, why do openai etc spend maybe 100x that? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

bcjdjsndon 69 days ago | parent | context | favorite | on: Jamesob's guide to running SOTA LLMs locally

If you can run sota on a 40k setup, why do openai etc spend maybe 100x that?

dwroberts 69 days ago [–]

Obvious one: Because they are serving it to millions of people at the same time, not just one local user

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact