GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints | VitaVision
PaperEMNLP 2023 · 2023

GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

0pages built on it
1more page cites it
1narrative
0registry papers cite it

In the Atlas

Cited as a reference by 1 page, grouped by domain

Representation learning 1

Appears in 1 narrative

Lineage

Papers in the Atlas registry only · one dot per paper
Built upon by · 0
’17’18’19’20’21’22’23Attention Is All You Need (2017)