2020 · Scaling laws
Scaling Laws for Neural Language Models
How model size, training data and compute relate to language-model performance. A foundation for understanding scaling as an empirical relationship, with limits.
Paper & contextJared Kaplan
Scaling laws
Measuring how loss changes with model size, data, and compute.
Kaplan’s AI research examines how model behavior changes with resources and training choices. These papers connect empirical scaling laws with language-model evaluation, alignment, and defenses against unwanted behavior.
Selected work
10 papers
2020 · LLMs
Language Models are Few-Shot Learners
GPT-3 investigates how a large language model can perform tasks from instructions and examples in its prompt, without task-specific weight updates.
Paper & context2022 · Alignment
Constitutional AI: Harmlessness from AI Feedback
Constitutional AI explores training a more helpful and harmless assistant with written principles and AI-generated feedback.
Paper & context2021 · AI safety
A General Language Assistant as a Laboratory for Alignment
Selected research in ai safety, scaling laws. Read the full paper, including the methods, experiments, and reported results.
Paper & context2022 · Benchmarks
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
BIG-bench collects a broad set of language-model evaluation tasks to study capabilities and limitations beyond a single benchmark.
Paper & context2026 · Scaling laws
Constitutional Classifiers++: Efficient Production-Grade Defenses against Universal Jailbreaks
Selected research in scaling laws. Read the full paper, including the methods, experiments, and reported results.
Paper & context2025 · Scaling laws
Reasoning Models Don't Always Say What They Think
Selected research in scaling laws, reinforcement learning. Read the full paper, including the methods, experiments, and reported results.
Paper & context2025 · Scaling laws
Forecasting Rare Language Model Behaviors
Selected research in scaling laws. Read the full paper, including the methods, experiments, and reported results.
Paper & context2025 · AI safety
Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations
Selected research in ai safety, scaling laws. Read the full paper, including the methods, experiments, and reported results.
Paper & context2025 · Scaling laws
Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teaming
Selected research in scaling laws, ai safety. Read the full paper, including the methods, experiments, and reported results.
Paper & contextAn independent editorial profile. Inclusion does not imply Council membership or endorsement. Research is collaborative; coauthorship does not imply sole credit.
Selection & sources