EleutherAI

5 Posts

Large Language Models Unbound: BLOOM is the Largest Open Source NLP Model to Date

A worldwide collaboration produced the biggest open source language model to date. BLOOM is a family of language models built by the BigScience Research Workshop, a collective of over 1,000 researchers from 250 institutions around the globe.

Graph Average across 14 NLP Tasks parameters versus Average Accuracy

EleutherAI

GPT-Free: Meta Releases Open Source Large Language Models OPT

Itching to get your hands on a fully trained large language model? The wait is over. Meta introduced the OPT family of transformer-based language models with nearly unfettered access to source code and trained weights.

EleutherAI

GPT-3 for All: GPT-3 NLP Model is Available for Select Azure Users

Microsoft is making GPT-3 available to selected customers through its Azure cloud service.

Series of example of accurate and inaccurate matching images to text

EleutherAI

Crawl the Web, Absorb the Bias: NLP Models Absorb Biases from Web Training Data

The emerging generation of trillion-parameter models needs datasets of billions of examples, but the most readily available source of examples on that scale — the web — is polluted with bias and antisocial expressions. A new study examines the issue.

EleutherAI

Language Models Want to Be Free: How EleutherAI is developing a GPT-3 clone.

A grassroots research collective aims to make a GPT-3 clone that’s available to everyone. EleutherAI, a loose-knit group of independent researchers, is developing GPT-Neo, an open source, free-to-use version of OpenAI’s gargantuan language model.

EleutherAI

Large Language Models Unbound: BLOOM is the Largest Open Source NLP Model to Date

GPT-Free: Meta Releases Open Source Large Language Models OPT

GPT-3 for All: GPT-3 NLP Model is Available for Select Azure Users

Crawl the Web, Absorb the Bias: NLP Models Absorb Biases from Web Training Data

Language Models Want to Be Free: How EleutherAI is developing a GPT-3 clone.

Subscribe to The Batch