Article List
Explore latest news, discover interesting content, and dive deep into topics that interest you
Pile-T5
Trained T5 on the Pile...
Yi-34B, Llama 2, and common practices in LLM training: a fa…
Setting the record straight regarding Yi-34B and Llama 2....
The Foundation Model Development Cheatsheet
Announcing a new resource, the FM Dev Cheatsheet....
Least-Squares Concept Erasure with Oracle Concept Labels
Achieving even more surgical edits than LEACE when we have concept labels at inference time....
Diff-in-Means Concept Editing is Worst-Case Optimal
Explaining a result by Sam Marks and Max Tegmark...
The third New England RLHF Hackers Hackathon
Introduction At the third New England RLHF Hackathon, several interesting projects were showcased, each focusing on different aspects of machine learn...
Extending the RoPE
What we've been up to for the past year EleutherAI....
How the Foundation Model Transparency Index Distorts Transp…
Evaluating transparency requires precision....
Llemma: An Open Language Model For Mathematics
ArXiv | Models | Data | Code | Blog | Sample Explorer Today we release Llemma: 7 billion and 34 billion parameter language models for mathematics. The...
The second New England RLHF Hackers Hackathon
Introduction Rekindling the spirit of collaboration, the New England RLHF Hackers (NERH) hosted their second hackathon at Brown University on October...
Contributor Spotlight: Mohammad Aflah Khan
Give us a brief overview of your background: I'm currently in the final year of my undergraduate program at IIIT Delhi, pursuing a BTech degree in Com...
The first New England RLHF Hackers Hackathon
Introduction Author list is alphabetical by last name. We would like to extend acknowledgements to Delta Christine Hessler and Hailey Schoelkopf. On S...
EleutherAI's Thoughts on the EU AI Act
How we are supporting open source and open science in the EU AI Act....
Minetester: A fully open RL environment built on Minetest
An overview of the minetester and preliminary work...
🐶Safetensors audited as really safe and becoming the default
Audit shows that safetensors is safe and ready to become the default Hugging Face, in close collaboration with EleutherAI and Stability AI, has ordere...
Alignment Research @ EleutherAI
A breif overview of EAIs approach to alignment...
Transformer Math 101
We present basic math related to computation and memory usage for transformers...
Exploratory Analysis of TRLX RLHF Transformers with Transfo…
A demonstration of interpretabilty for RLHF models...