2021 · Computer vision
Learning Transferable Visual Models From Natural Language Supervision
CLIP learns visual concepts from paired images and text, connecting language descriptions to image representations.
Paper & contextAlec Radford
Multimodal AI
Learning transferable representations through large-scale pretraining.
Radford’s research explores what models can learn from large and varied datasets. These papers connect generative visual models, language pretraining, image-text representations, and speech recognition, with an emphasis on representations that transfer across tasks.
Selected work
10 papers
2020 · LLMs
Language Models are Few-Shot Learners
GPT-3 investigates how a large language model can perform tasks from instructions and examples in its prompt, without task-specific weight updates.
Paper & context2015 · Multimodal AI
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
Selected research in multimodal ai. Read the full paper, including the methods, experiments, and reported results.
Paper & context2020 · Scaling laws
Scaling Laws for Neural Language Models
How model size, training data and compute relate to language-model performance. A foundation for understanding scaling as an empirical relationship, with limits.
Paper & context2022 · Language models
Robust Speech Recognition via Large-Scale Weak Supervision
Selected research in language models, multimodal ai. Read the full paper, including the methods, experiments, and reported results.
Paper & context2023 · LLMs
GPT-4 Technical Report
The GPT-4 technical report documents capabilities, evaluations and limitations of a multimodal model, while withholding many architecture and training details.
Paper & context2017 · Reinforcement learning
Proximal Policy Optimization Algorithms
Proximal Policy Optimization proposes a policy-gradient objective that limits overly large updates while simplifying implementation.
Paper & context2026 · Multimodal AI
Learning a Generative Meta-Model of LLM Activations
Selected research in multimodal ai. Read the full paper, including the methods, experiments, and reported results.
Paper & context2026 · Multimodal AI
Shaping capabilities with token-level data filtering
Selected research in multimodal ai. Read the full paper, including the methods, experiments, and reported results.
Paper & context2024 · Language models
GPT-4o System Card
Selected research in language models, computer vision. Read the full paper, including the methods, experiments, and reported results.
Paper & contextAn independent editorial profile. Inclusion does not imply Council membership or endorsement. Research is collaborative; coauthorship does not imply sole credit.
Selection & sources