AI Tools & Models HOTFeaturedAll
arXiv cs.AIScore60

From Local Prediction Error to Final Outputs: A Theory of Expert Sharing in Multi-Step Reasoning

Summary

This theoretical work explains how sharing experts across layers and steps in MoE models lets local errors shape final outputs.

Why this matters

Covers model · Relevant to this topic

Open original ↗

Source: arXiv cs.AI · arxiv.org

Topics

Related items