Question 1

What is EleutherAI known for?

Accepted Answer

Grassroots open research: The Pile, GPT-NeoX and Pythia, and the LM Evaluation Harness everyone uses. Landmarks: The Pile: An 800GB Dataset of Diverse Text for Language Modeling (2020); GPT-NeoX-20B: An Open-Source Autoregressive Language Model (2022); Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling (2023); Language Model Evaluation Harness (2021).

Question 2

Who leads EleutherAI?

Accepted Answer

Stella Biderman, Executive Director.

Question 3

What kind of organization is EleutherAI?

Accepted Answer

Nonprofit, founded in 2020.

EleutherAI

Landmark work

The Pile: An 800GB Dataset of Diverse Text for Language Modeling

Language Model Evaluation Harness

GPT-NeoX-20B: An Open-Source Autoregressive Language Model

Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

Leaders

Stella Biderman

Links

Added to Labs.