From Local Prediction Error to Final Outputs: A Theory of Expert Sharing in Multi-Step Reasoning
Summary
This theoretical work explains how sharing experts across layers and steps in MoE models lets local errors shape final outputs.
Why this matters
Covers model · Relevant to this topic
Source: arXiv cs.AI · arxiv.org