2022 · Language models
Holistic Evaluation of Language Models
Selected research in language models, ai evaluation. Read the full paper, including the methods, experiments, and reported results.
Paper & contextPercy Liang
Making language-model evaluation broader and more transparent.
Liang studies the foundations, evaluation, and social consequences of machine learning. These papers connect broad language-model evaluation with data, transparency, and questions about what model benchmarks actually establish.
Selected work
10 papers
2021 · Computer vision
On the Opportunities and Risks of Foundation Models
Selected research in computer vision, language models. Read the full paper, including the methods, experiments, and reported results.
Paper & context2022 · Benchmarks
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
BIG-bench collects a broad set of language-model evaluation tasks to study capabilities and limitations beyond a single benchmark.
Paper & context2026 · AI evaluation
Data Scarcity and Model Sparsity: Mixtures-of-Experts Overfit More to Repeated Data
Selected research in ai evaluation, language models. Read the full paper, including the methods, experiments, and reported results.
Paper & context2026 · Machine learning
Prefix Sliding for efficient test-time scaling
Selected research in machine learning, ai evaluation. Read the full paper, including the methods, experiments, and reported results.
Paper & context2026 · AI evaluation
DelusionEval: Measuring Delusion-Linked Behaviors in AI Chatbots
Selected research in ai evaluation. Read the full paper, including the methods, experiments, and reported results.
Paper & context2026 · AI evaluation
Extractable Memorization From First Principles
Selected research in ai evaluation. Read the full paper, including the methods, experiments, and reported results.
Paper & context2026 · AI evaluation
FLARE-AI: Flaw Reporting for AI
Selected research in ai evaluation. Read the full paper, including the methods, experiments, and reported results.
Paper & context2026 · AI evaluation
Economic Evaluations of Language Models
Selected research in ai evaluation. Read the full paper, including the methods, experiments, and reported results.
Paper & context2026 · AI evaluation
Fantastic Pretraining Optimizers and Where to Find Them II: Hyperball Optimization
Selected research in ai evaluation. Read the full paper, including the methods, experiments, and reported results.
Paper & contextAn independent editorial profile. Inclusion does not imply Council membership or endorsement. Research is collaborative; coauthorship does not imply sole credit.
Selection & sources