2020 · Scaling laws
Scaling Laws for Neural Language Models
How model size, training data and compute relate to language-model performance. A foundation for understanding scaling as an empirical relationship, with limits.
Paper & contextDario Amodei
AI safety
Studying scaling and the reliability of learned systems.
Amodei’s coauthored work studies the capabilities and reliability of learned systems. These papers connect speech recognition and language-model scaling with alignment, evaluation, and methods for reducing harmful model behavior.
Selected work
10 papers
2020 · LLMs
Language Models are Few-Shot Learners
GPT-3 investigates how a large language model can perform tasks from instructions and examples in its prompt, without task-specific weight updates.
Paper & context2022 · Alignment
Constitutional AI: Harmlessness from AI Feedback
Constitutional AI explores training a more helpful and harmless assistant with written principles and AI-generated feedback.
Paper & context2021 · AI safety
A General Language Assistant as a Laboratory for Alignment
Selected research in ai safety, scaling laws. Read the full paper, including the methods, experiments, and reported results.
Paper & context2015 · Machine learning
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
Selected research in machine learning, ai safety. Read the full paper, including the methods, experiments, and reported results.
Paper & context2025 · AI safety
Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations
Selected research in ai safety, scaling laws. Read the full paper, including the methods, experiments, and reported results.
Paper & context2023 · AI safety
The Capacity for Moral Self-Correction in Large Language Models
Selected research in ai safety, scaling laws. Read the full paper, including the methods, experiments, and reported results.
Paper & context2022 · AI safety
Discovering Language Model Behaviors with Model-Written Evaluations
Selected research in ai safety, scaling laws. Read the full paper, including the methods, experiments, and reported results.
Paper & context2022 · AI safety
Measuring Progress on Scalable Oversight for Large Language Models
Selected research in ai safety, scaling laws. Read the full paper, including the methods, experiments, and reported results.
Paper & context2022 · AI safety
In-context Learning and Induction Heads
Selected research in ai safety, scaling laws. Read the full paper, including the methods, experiments, and reported results.
Paper & contextAn independent editorial profile. Inclusion does not imply Council membership or endorsement. Research is collaborative; coauthorship does not imply sole credit.
Selection & sources