FRONTIER LABInvestigateNEXT 12 MONTHS
Arbitrage: Efficient Reasoning via Advantage-Aware Speculation
Apple ML Research
Factual evidence
What the source reports
Apple ML Research introduced Arbitrage, a speculative decoding technique that reduces reasoning model inference latency and computational cost.
Open source