2023 · Fine-tuning
QLoRA: Efficient Finetuning of Quantized LLMs
QLoRA investigates fine-tuning quantized models with low-rank adapters to reduce memory requirements.
Paper & contextLuke Zettlemoyer
Learning language systems that can be adapted efficiently.
Zettlemoyer studies language understanding and how to train, adapt, and evaluate language models. These papers connect contextual word representations with efficient adaptation, tool use, and openly documented language-model development.
Selected work
10 papers
2018 · Language models
Deep contextualized word representations
Selected research in language models. Read the full paper, including the methods, experiments, and reported results.
Paper & context2024 · Language models
OLMo: Accelerating the Science of Language Models
Selected research in language models. Read the full paper, including the methods, experiments, and reported results.
Paper & context2023 · Agents
Toolformer: Language Models Can Teach Themselves to Use Tools
Toolformer explores teaching language models to invoke external tools with a self-supervised training approach.
Paper & context2026 · AI evaluation
Data Scarcity and Model Sparsity: Mixtures-of-Experts Overfit More to Repeated Data
Selected research in ai evaluation, language models. Read the full paper, including the methods, experiments, and reported results.
Paper & context2026 · Language models
Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall
Selected research in language models. Read the full paper, including the methods, experiments, and reported results.
Paper & context2026 · Machine learning
Prefix Sliding for efficient test-time scaling
Selected research in machine learning, ai evaluation. Read the full paper, including the methods, experiments, and reported results.
Paper & context2026 · Language models
SPADE: Self-Play in Adaptive Synthetic Executable Environments
Selected research in language models. Read the full paper, including the methods, experiments, and reported results.
Paper & context2026 · Language models
Vision-Language Grounding as Bidirectional Concept Correspondence
Selected research in language models. Read the full paper, including the methods, experiments, and reported results.
Paper & context2026 · Language models
WaiT for the Signal: Simple Frequency-Aware Flow-Matching
Selected research in language models. Read the full paper, including the methods, experiments, and reported results.
Paper & contextAn independent editorial profile. Inclusion does not imply Council membership or endorsement. Research is collaborative; coauthorship does not imply sole credit.
Selection & sources