Open Source AI Research
News
Activation Function Ablation
An ablation of activation functions in GPT-like autoregressive language models....
An ablation of activation functions in GPT-like autoregressive language models.
Source: Blog on EleutherAI Blog
Word count: 70 words
Published on 2021-05-25 04:00