SpecPrefetch: Parameter-Efficient Expert Prefetching for Sparse MoE Foundation Models

Research proposes SpecPrefetch, a parameter-efficient expert prefetching method for sparse Mixture-of-Experts (MoE) foundation models to alleviate deployment memory bottlenecks.