Learning Transferable Visual Models From Natural Language Supervision | VitaVision
PaperICML 2021 · 2021

Learning Transferable Visual Models From Natural Language Supervision

1page built on it
0more pages cite it
1narrative
3registry papers cite it

In the Atlas

ModelPrimary source of
CLIP

Contrastive image–text pretraining on 400M web pairs: dual encoders in one embedding space make natural language the classifier — zero-shot ImageNet at 76.2% via prompts, with unmatched robustness under distribution shift.

Appears in 1 narrative

Lineage

Papers in the Atlas registry only · one dot per paper
Built upon by · 3
’16’17’18’19’20’21’22’23’24’25WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentation (2023)AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detection (2023)SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features (2025)Deep Residual Learning for Image Recognition (2016)Attention Is All You Need (2017)A Simple Framework for Contrastive Learning of Visual Representations (2020)An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (2020)