Your Experts Have Partners. There's HOPE for Keeping Them Together
Summary
A higher-order pruning method, HOPE, keeps collaborating experts together when pruning models.
Why this matters
Official source · Relevant to this topic
Source: Hugging Face Blog · huggingface.co