Efficiently Aligning Draft Models via Parameter- and Data-Efficient Adaptation
This work aligns speculative-decoding draft models with parameter- and data-efficient adaptation, easing the performance drop draft models suffer after target models are fine-tuned.
Nov 16, 13:00
Why this: Covers model and LLM · Relevant to this topic