Question 1

What is EleutherAI known for?

Accepted Answer

Grassroots open research: The Pile, GPT-NeoX and Pythia, and the LM Evaluation Harness everyone uses. Landmarks: The Pile: An 800GB Dataset of Diverse Text for Language Modeling (2020); GPT-NeoX-20B: An Open-Source Autoregressive Language Model (2022); Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling (2023); Language Model Evaluation Harness (2021).

Question 2

Who leads EleutherAI?

Accepted Answer

Stella Biderman, Executive Director.

Question 3

What kind of organization is EleutherAI?

Accepted Answer

Nonprofit, founded in 2020.

Year	Contribution	Source
2020	The Pile: An 800GB Dataset of Diverse Text for Language Modelingarxiv.org	arxiv.org
2021	Language Model Evaluation Harnessgithub.com	github.com
2022	GPT-NeoX-20B: An Open-Source Autoregressive Language Modelarxiv.org	arxiv.org
2023	Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingarxiv.org	arxiv.org

Where	Link
Website	eleuther.ai
Blog	blog.eleuther.ai
GitHub	EleutherAI
Hugging Face	EleutherAI
X	@AiEleuther

EleutherAI

Known for

Leaders

Links

Lab changes by email