> the models they do release are probably toys in comparison to their internal models.

I'm not sure if that's true. They did say they're going to make Llama 3 400B public and if they follow through, that's no toy and I doubt they have something significantly better internally.