Th Pile
Language Models Want to Be Free: How EleutherAI is developing a GPT-3 clone.
A grassroots research collective aims to make a GPT-3 clone that’s available to everyone. EleutherAI, a loose-knit group of independent researchers, is developing GPT-Neo, an open source, free-to-use version of OpenAI’s gargantuan language model.