Learning to Select, Not Relearn: Hard-Routed Mixtures of Reasoning LoRAs

Research proposes a hard-routed mixture-of-experts approach for combining independently trained LoRA adapters in LLMs, preserving original update scales.