> “speak the language” of the concepts the LLMs have produced
LLMs don't produce concepts, they just predict next tokens; they can't invent new concepts, only synthesize what is in their probability distribution already. They can mix/fuse vast areas of math together that are inaccessible to individual mathematicians, but can't create new concepts not present in their probability distribution.
LLMs don't produce concepts, they just predict next tokens; they can't invent new concepts, only synthesize what is in their probability distribution already. They can mix/fuse vast areas of math together that are inaccessible to individual mathematicians, but can't create new concepts not present in their probability distribution.