Open Source AI Research
News
Downstream Evaluations of Rotary Position Embeddings
A comparison of Rotary Position Embedding against GPT-style learned position embeddings....
A comparison of Rotary Position Embedding against GPT-style learned position embeddings.
Source: Blog on EleutherAI Blog
Word count: 78 words
Published on 2021-08-17 02:13