I guess you mean non-textual data then because the amount of text data they are ... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

worldsayshi 8 months ago | parent | context | favorite | on: Viking 7B: open LLM for the Nordic languages train...

I guess you mean non-textual data then because the amount of text data they are being trained on ought to be enough for agi by now?

Some kind of diminishing returns asymptote from text volume alone must have been hit a long time ago.

imtringued 8 months ago [–]

It's not the amount that is wrong, it's how the model is trained. The model is trained for zero and few shot tasks. It is not surprising that it is performing well when you ask for that.

Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact