2014 · Language models
Sequence to Sequence Learning with Neural Networks
Selected research in language models. Read the full paper, including the methods, experiments, and reported results.
Paper & contextIlya Sutskever
Language models
Using large neural networks to learn sequence transformations.
Sutskever’s work spans sequence learning, large language models, and generative systems. These papers connect early neural sequence-to-sequence translation with large-scale pretraining, multimodal learning, and work on supervision for increasingly capable models.
Selected work
10 papers
2020 · LLMs
Language Models are Few-Shot Learners
GPT-3 investigates how a large language model can perform tasks from instructions and examples in its prompt, without task-specific weight updates.
Paper & context2021 · Computer vision
Learning Transferable Visual Models From Natural Language Supervision
CLIP learns visual concepts from paired images and text, connecting language descriptions to image representations.
Paper & context2012 · Optimization
Improving neural networks by preventing co-adaptation of feature detectors
Dropout regularizes neural networks by randomly omitting units during training, reducing dependence on particular combinations of features.
Paper & context2023 · LLMs
GPT-4 Technical Report
The GPT-4 technical report documents capabilities, evaluations and limitations of a multimodal model, while withholding many architecture and training details.
Paper & context2023 · Language models
Consistency Models
Consistency models aim to generate data in one or a few steps by learning mappings that agree along a denoising trajectory.
Paper & context2024 · Language models
OpenAI o1 System Card
Selected research in language models, reasoning. Read the full paper, including the methods, experiments, and reported results.
Paper & context2024 · Language models
GPT-4o System Card
Selected research in language models, computer vision. Read the full paper, including the methods, experiments, and reported results.
Paper & context2024 · Language models
Scaling and evaluating sparse autoencoders
Selected research in language models, multimodal ai. Read the full paper, including the methods, experiments, and reported results.
Paper & context2023 · Language models
Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision
Selected research in language models. Read the full paper, including the methods, experiments, and reported results.
Paper & contextAn independent editorial profile. Inclusion does not imply Council membership or endorsement. Research is collaborative; coauthorship does not imply sole credit.
Selection & sources