Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models
Summary
Astraios replaces full-parameter fine-tuning with parameter-efficient methods, sharply cutting the cost of instruction-tuning code LLMs.
Why this matters
Covers model and LLM · Relevant to this topic
Source: arXiv cs.AI · arxiv.org