Knowledge is non-rivalrous, but it's not settled that the value of a college education comes mostly from added knowledge. If instead it comes from signaling, then it's no longer the case.
Agree with you on the signally aspect. As a nation we've become obsessed with college degrees and college may not be the right choice for everyone. But that's a whole other discussion thread.