Article List
Explore latest news, discover interesting content, and dive deep into topics that interest you
Chris Mattmann — ML Applications on Earth, Mars, and Beyond
Chris shares some of the incredible work and innovations behind deep space exploration at NASA JPL and reflects on the past, present, and future of ma...
Multiplexing Circuits on the Game of Life - Part 5
Abstract: Improving digital logic gates on Conway's game of life by allowing 8-bit logic gates instead of boolean logic gates....
Peter & Boris — Fine-tuning OpenAI's GPT-3
Peter and Boris dive into the world of GPT-3: how people are applying OpenAI's flagship language model, why fine-tuning GPT-3 improves performance, an...
Announcing GPT-NeoX-20B
Announcing GPT-NeoX-20B, a 20 billion parameter model trained in collaboration with CoreWeave....
Research Paper Release Checklist
This page contains a few checklists that help prevent embarrassing issues when releasing research papers online (e.g., via arXiv or a conference publi...
Ion Stoica — Spark, Ray, and Enterprise Open Source
Ion shares the stories behind developing the distributed computing frameworks Spark and Ray, and commercializing them into Databricks and Anyscale....
Stephan Fabel — Efficient Supercomputing with NVIDIA's Base…
Stephan talks about Base Command Platform, NVIDIA's software platform for its DGX SuperPOD infrastructure....
A Simple CPU on the Game of Life - Part 4
Abstract: An implementation of a minimal CPU on Conway's the Game of Life (an 'unlimited register machine'), and runs at ~10Hz....
Chris Padwick — Smart Machines for More Sustainable Farming
Chris explains how Blue River Technology is building smart robots for more sustainable farming by identifying crops and weeds and only spraying the we...
Kathryn Hume — Financial Models, ML, and 17th-Century Philo…
Kathryn explains how the Royal Bank of Canada is using machine learning, and explores what Descartes and Newton might have thought about ML....
A Preliminary Exploration into Factored Cognition with Lang…
We perform a series of experiments using GPT-3 with decomposition to perform complex toy tasks that it is otherwise unable to solve. The goal of these...
Multiple Choice Normalization in LM Evaluation
There are multiple ways of evaluating multiple choice tasks on autoregressive LMs like GPT-3/Neo/J. This post lays out the current prevalent normaliza...
Josh Bloom — The Link Between Astronomy and ML
Josh explains how astronomy and machine learning have informed each other, their current limitations, and where their intersection goes from here....
Downstream Evaluations of Rotary Position Embeddings
A comparison of Rotary Position Embedding against GPT-style learned position embeddings....
Xavier Amatriain — Building AI-powered Primary Care
Xavier shares his experience deploying healthcare models, augmenting primary care with AI, the challenges of "ground truth" in medicine, and robustnes...
Spence Green — Enterprise-scale Machine Translation
Spence shares his experience creating a product around human-in-the-loop machine translation, and explains how machine translation has evolved over th...
Roger & DJ — The Rise of Big Data and CA's COVID-19 Response
Roger and DJ share some of the history behind data science as we know it today, and reflect on their experiences working on California's COVID-19 resp...
What A Long, Strange Trip It's Been: EleutherAI One Year Re…
A look back at the first year of EleutherAI....