Efficiently Aligning Draft Models via Parameter- and Data-Efficient Adaptation
Summary
This work aligns speculative-decoding draft models with parameter- and data-efficient adaptation, easing the performance drop draft models suffer after target models are fine-tuned.
Why this matters
Covers model and LLM · Relevant to this topic
Source: arXiv cs.AI · arxiv.org