Tbh, what else is there but mountains of data? Read this article about how they train these things on basically the whole internet. That's text, images, code, you name it. Every chat, every book scan, every public photo feed is more fuel. The scale is just hard to even picture, but that's the whole game right now.