RoFormer: Enhanced Transformer with Rotary Position Embedding | VitaVision
PaperNeurocomputing 2024 · 2021

RoFormer: Enhanced Transformer with Rotary Position Embedding

Jianlin SuYu LuShengfeng PanA. MurtadhaBo WenYunfeng Liu
arXiv 2104.09864
0pages built on it
2more pages cite it
1narrative
0registry papers cite it

In the Atlas

Cited as a reference by 2 pages, grouped by domain

Representation learning 2
Attention MechanismPositional Encoding

Appears in 1 narrative

NarrativeFoundation Models for Vision

Lineage

Papers in the Atlas registry only · one dot per paper
Built upon by · 0
’17’18’19’20’21Attention Is All You Need (2017)
Built upon by · 0