>Personally I think today's frontier models can be beat by training from scratch... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		TZubiri 13 days ago \| parent \| context \| favorite \| on: I trained a small transformer in 1.5hrs and it bea... >Personally I think today's frontier models can be beat by training from scratch You mean for a specific usecase? Also aren't frontier models trained 'from scratch'?
		help

evilmathkid 13 days ago [–]

> You mean for a specific usecase?

Yepp

> Also aren't frontier models trained 'from scratch'?

The full sentence was supposed to be "training from scratch only on ARC data"

the point was you dont need large scale pretraining

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact