It was interesting to start the TPU Podcast discord server. I was annoyed Connor showed up and convinced the talented researchers to spend their time on his server. But now I get to claim correctly that Eleuther never would have started without me, so I’ll put that up on the trophy shelf. Which happens to be next to Shockley’s trophy shelf, across the hall from MySpace.
I’ve always wanted to do a postmortem writeup of my attempt at starting an open source AI lab. It was always my goal from the very moment I pressed the “create server” button, and it’s at least mildly interesting that it was successful — in spite of my efforts, not because of my efforts.
I do feel a pang of jealousy every time I see an article like this, and it would be nice if they’d occasionally link to our server (https://discord.com/invite/x52Xz3y) rather than mentioning it, but (with effort) I managed to transmute those feelings into amusement. It would have been better if I felt amused from day one.
GPT-Neo is MIT-licensed, while GPT-NeoX is licensed under Apache 2.0. These are the most freely-termed licenses that we can provide for each codebase respectively.
Mesh Transformer JAX is licenced under Apache 2.0.
> Are the models free software?
EleutherAI is licensing models under Apache 2.0. If you use our models, we would highly appreciate you citing or displaying your usage of them.
If you actually listen to this or just know what EleutherAI is (A grassroots collective of researchers working to open source AI research), it's very evident that this is not their goal at all
It was a wild and fun ride. I ended up becoming a published, cited researcher thanks to Eleuther. https://twitter.com/theshawwn/status/1480479272078913539?s=2...
I’ve always wanted to do a postmortem writeup of my attempt at starting an open source AI lab. It was always my goal from the very moment I pressed the “create server” button, and it’s at least mildly interesting that it was successful — in spite of my efforts, not because of my efforts.
I do feel a pang of jealousy every time I see an article like this, and it would be nice if they’d occasionally link to our server (https://discord.com/invite/x52Xz3y) rather than mentioning it, but (with effort) I managed to transmute those feelings into amusement. It would have been better if I felt amused from day one.