Theoretical Limits of Language Model Alignment

Apple Machine Learning Research Version 1 original current

Imported from official source

Language model (LM) alignment improves model outputs to reflect human preferences while preserving the capabilities of the base model. The most common alignment approaches are (i) reinforcement learning, which maximizes the expected reward under a KL-divergence constraint, and (ii) best-of-NNN alignment, which selects the highest-reward output among NNN independent samples. …

This version

Version
1 of 1
Recorded
November 12, 2026 18:02
Change
Initial
Content hash
7ed4b043f3e6d9e8e5b460b7c060b9bc
All versions
Revision history

Officially records where a publication came from, not whether it is true. Imported records are reproduced from an organization's own official source.