Vision Transformers for Dense Prediction | VitaVision
PaperICCV · 2021

Vision Transformers for Dense Prediction

1page built on it
6more pages cite it
3narratives
0registry papers cite it

In the Atlas

ModelPrimary source of
DPT (Dense Prediction Transformer)

ViT encoder whose tokens from four layers are reassembled into image-like feature maps at multiple resolutions and fused by a convolutional decoder into full-resolution dense predictions; trained for monocular depth with the MiDaS protocol and for semantic segmentation.

Appears in 3 narratives

Lineage

Papers in the Atlas registry only · one dot per paper
Built upon by · 0
’15’16’17’18’19’20’21Fully Convolutional Networks for Semantic Segmentation (2015)U-Net: Convolutional Networks for Biomedical Image Segmentation (2015)Deep Residual Learning for Image Recognition (2016)DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs (2018)Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer (2019)Deep High-Resolution Representation Learning for Human Pose Estimation (2019)An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (2020)Training data-efficient image transformers & distillation through attention (2020)Deep High-Resolution Representation Learning for Visual Recognition (2020)