Pluralistic Alignment in Large Language Models: Objectives, Human References, and Preference Representations
Summary
Rather than squeezing diverse human preferences into one target, alignment should keep meaningful differences intact, the work argues.
Why this matters
Covers model · Relevant to this topic
Source: arXiv cs.AI · arxiv.org