Theoretical Limits of Language Model Alignment
AI Classified by Officially
Language model (LM) alignment improves model outputs to reflect human preferences while preserving the capabilities of the base model. The most common alignment approaches are (i) reinforcement learning, which maximizes the expected reward under a KL-divergence constraint, and (ii) best-of-NNN alignment, which selects the highest-reward output among NNN independent samples. …
This is an extract. The publication continues at the source.
Read the original at the source: https://machinelearning.apple.com/research/theoretical-limits-alignment
Officially imported this from Apple Machine Learning Research’s own source and shows an extract. If you work there, claiming the profile and verifying the domain lets you choose to show the full text here.
Provenance
- Organization
- Apple Machine Learning Research — imported from official source
- Official source
- https://machinelearning.apple.com/rss.xml RSS
- Imported
- November 12, 2026 18:02
- Versions
- 1 recorded
- Identity
-
theoretical-limits-alignment